2024-03-18T14:50:10.871 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-18T14:50:10.871 DEBUG:teuthology.run:Teuthology command: teuthology --name pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi --verbose --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} --owner scheduled_pdonnell@teuthology --archive /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860 -- /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/orig.config.yaml 2024-03-18T14:50:10.925 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T14:50:11.016 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860 branch: wip-batrick-testing-20240314.183243 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} email: pdonnell@redhat.com first_in_suite: false job_id: '7608860' kernel: client: sha1: distro kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-batrick-testing-20240314.183243 ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - mons down, quorum - out of quorum - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af kclient: syntax: v2 selinux: allowlist: - scontext=system_u:system_r:getty_t:s0 subvolume_version: 2 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-batrick-testing-20240314.183243 sha1: 4e19f704afd9957ea657ab858f9ecf76401fef6f owner: scheduled_pdonnell@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 4770 sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af sleep_before_teardown: 0 subset: 498/512 suite: fs suite_branch: wip-batrick-testing-20240314.183243 suite_path: /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa suite_relpath: qa suite_repo: https://github.com/batrick/ceph suite_sha1: 4e19f704afd9957ea657ab858f9ecf76401fef6f syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi152.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCksRV3cHBxdsEvyK7DHWX2QmJoaxL64VcPYmHZTV4Hk8Z2+s6w0V1cQ6ZA5f2XoOoQl+qrrcBVzhDQJBoLU8Y= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0MtjsXhFMj20MQvMw9MSYPKt3X6PTmgCv/fUJI4FtPLbbbKUHKsliA28MPvH0MTXnH55596gpRK8awdgwjF2o= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-18_14:19:46 tube: smithi user: pdonnell verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-03-18T14:50:11.016 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa; will attempt to use it 2024-03-18T14:50:11.017 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks 2024-03-18T14:50:11.017 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-18T14:50:11.019 INFO:teuthology.task.internal:Checking packages... 2024-03-18T14:50:11.044 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af' 2024-03-18T14:50:11.044 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-18T14:50:11.044 INFO:teuthology.packaging:ref: None 2024-03-18T14:50:11.044 INFO:teuthology.packaging:tag: None 2024-03-18T14:50:11.044 INFO:teuthology.packaging:branch: wip-batrick-testing-20240314.183243 2024-03-18T14:50:11.045 INFO:teuthology.packaging:sha1: 3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:50:11.045 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-batrick-testing-20240314.183243 2024-03-18T14:50:11.180 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2162.g3d78f5ba 2024-03-18T14:50:11.182 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-18T14:50:11.188 INFO:teuthology.task.internal:no buildpackages task found 2024-03-18T14:50:11.188 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-18T14:50:11.236 INFO:teuthology.task.internal:Saving configuration 2024-03-18T14:50:11.252 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-18T14:50:11.259 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T14:50:11.285 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:44:53.984115', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCksRV3cHBxdsEvyK7DHWX2QmJoaxL64VcPYmHZTV4Hk8Z2+s6w0V1cQ6ZA5f2XoOoQl+qrrcBVzhDQJBoLU8Y='} 2024-03-18T14:50:11.308 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:44:53.982494', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0MtjsXhFMj20MQvMw9MSYPKt3X6PTmgCv/fUJI4FtPLbbbKUHKsliA28MPvH0MTXnH55596gpRK8awdgwjF2o='} 2024-03-18T14:50:11.308 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-18T14:50:11.320 INFO:teuthology.task.internal:roles: ubuntu@smithi152.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-03-18T14:50:11.321 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-03-18T14:50:11.321 INFO:teuthology.run_tasks:Running task console_log... 2024-03-18T14:50:11.429 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc6114eb160>, signals=[15]) 2024-03-18T14:50:11.429 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-18T14:50:11.435 INFO:teuthology.task.internal:Opening connections... 2024-03-18T14:50:11.435 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:50:11.437 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:50:11.527 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T14:50:11.528 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:50:11.614 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-18T14:50:11.620 DEBUG:teuthology.orchestra.run.smithi152:> uname -m 2024-03-18T14:50:11.637 INFO:teuthology.orchestra.run.smithi152.stdout:x86_64 2024-03-18T14:50:11.637 DEBUG:teuthology.orchestra.run.smithi152:> cat /etc/os-release 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:NAME="CentOS Stream" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION="9" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:ID="centos" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:ID_LIKE="rhel fedora" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:VERSION_ID="9" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM_ID="platform:el9" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:ANSI_COLOR="0;31" 2024-03-18T14:50:11.693 INFO:teuthology.orchestra.run.smithi152.stdout:LOGO="fedora-logo-icon" 2024-03-18T14:50:11.694 INFO:teuthology.orchestra.run.smithi152.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T14:50:11.694 INFO:teuthology.orchestra.run.smithi152.stdout:HOME_URL="https://centos.org/" 2024-03-18T14:50:11.694 INFO:teuthology.orchestra.run.smithi152.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T14:50:11.694 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T14:50:11.694 INFO:teuthology.orchestra.run.smithi152.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T14:50:11.694 INFO:teuthology.lock.ops:Updating smithi152.front.sepia.ceph.com on lock server 2024-03-18T14:50:11.713 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-03-18T14:50:11.731 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-03-18T14:50:11.731 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-03-18T14:50:11.787 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:LOGO="fedora-logo-icon" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-03-18T14:50:11.788 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-18T14:50:11.789 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-03-18T14:50:11.813 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-18T14:50:11.822 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-18T14:50:11.844 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-18T14:50:11.844 DEBUG:teuthology.orchestra.run.smithi152:> test '!' -e /home/ubuntu/cephtest 2024-03-18T14:50:11.847 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-03-18T14:50:11.863 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-18T14:50:11.868 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-18T14:50:11.868 DEBUG:teuthology.orchestra.run.smithi152:> test -z $(ls -A /var/lib/ceph) 2024-03-18T14:50:11.903 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-03-18T14:50:11.923 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-18T14:50:11.976 INFO:teuthology.run_tasks:Running task kernel... 2024-03-18T14:50:11.991 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'} 2024-03-18T14:50:11.991 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2024-03-18T14:50:11.991 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2024-03-18T14:50:11.991 DEBUG:teuthology.orchestra.run.smithi152:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T14:50:11.992 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-18T14:50:12.007 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:50:12.007 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-03-18T14:50:12.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:50:12.009 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-03-18T14:50:12.063 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-361.el9.x86_64 2024-03-18T14:50:12.064 INFO:teuthology.task.kernel:Running kernel on smithi152: 5.14.0-361.el9.x86_64 2024-03-18T14:50:12.064 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y kernel 2024-03-18T14:50:12.065 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-361.el9.x86_64 2024-03-18T14:50:12.065 INFO:teuthology.task.kernel:Running kernel on smithi186: 5.14.0-361.el9.x86_64 2024-03-18T14:50:12.065 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2024-03-18T14:50:14.541 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 8.8 MB/s | 6.7 MB 00:00 2024-03-18T14:50:14.588 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 8.9 MB/s | 6.7 MB 00:00 2024-03-18T14:50:16.175 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2024-03-18T14:50:16.247 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 3.7 MB/s | 2.0 MB 00:00 2024-03-18T14:50:18.598 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 4.0 MB/s | 8.0 MB 00:02 2024-03-18T14:50:23.680 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 4.7 MB/s | 19 MB 00:04 2024-03-18T14:50:27.089 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 780 kB/s | 8.0 MB 00:10 2024-03-18T14:50:28.024 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 7.8 MB/s | 6.1 MB 00:00 2024-03-18T14:50:29.091 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 21 MB/s | 19 MB 00:00 2024-03-18T14:50:29.481 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 16 kB 00:00 2024-03-18T14:50:33.140 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 5.8 MB/s | 21 MB 00:03 2024-03-18T14:50:33.774 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.1 MB 00:01 2024-03-18T14:50:36.075 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 14 kB/s | 16 kB 00:01 2024-03-18T14:50:38.194 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 10 MB/s | 21 MB 00:02 2024-03-18T14:50:38.248 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 7.6 kB/s | 1.7 kB 00:00 2024-03-18T14:50:40.447 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-18T14:50:40.447 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-18T14:50:40.541 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-03-18T14:50:40.548 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:50:40.549 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-03-18T14:50:40.550 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-03-18T14:50:40.550 INFO:teuthology.orchestra.run.smithi186.stdout:Install 4 Packages 2024-03-18T14:50:40.550 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:50:40.550 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 100 M 2024-03-18T14:50:40.550 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 123 M 2024-03-18T14:50:40.551 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-03-18T14:50:41.125 INFO:teuthology.orchestra.run.smithi186.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 14 MB/s | 6.0 MB 00:00 2024-03-18T14:50:42.958 INFO:teuthology.orchestra.run.smithi186.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 9.2 MB/s | 21 MB 00:02 2024-03-18T14:50:43.085 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 24 kB/s | 1.7 kB 00:00 2024-03-18T14:50:44.508 INFO:teuthology.orchestra.run.smithi186.stdout:(3/4): kernel-modules-core-5.14.0-427.el9.x86_6 9.9 MB/s | 33 MB 00:03 2024-03-18T14:50:45.300 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-03-18T14:50:45.300 INFO:teuthology.orchestra.run.smithi152.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2024-03-18T14:50:45.416 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: Package Architecture Version Repository Size 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: kernel x86_64 5.14.0-427.el9 baseos 6.0 M 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core x86_64 5.14.0-427.el9 baseos 21 M 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules x86_64 5.14.0-427.el9 baseos 39 M 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core x86_64 5.14.0-427.el9 baseos 33 M 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-03-18T14:50:45.427 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T14:50:45.428 INFO:teuthology.orchestra.run.smithi152.stdout:Install 4 Packages 2024-03-18T14:50:45.428 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:50:45.428 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 100 M 2024-03-18T14:50:45.428 INFO:teuthology.orchestra.run.smithi152.stdout:Installed size: 123 M 2024-03-18T14:50:45.428 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-03-18T14:50:46.366 INFO:teuthology.orchestra.run.smithi186.stdout:(4/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 6.9 MB/s | 39 MB 00:05 2024-03-18T14:50:46.367 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:50:46.367 INFO:teuthology.orchestra.run.smithi186.stdout:Total 17 MB/s | 100 MB 00:05 2024-03-18T14:50:47.250 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-03-18T14:50:47.603 INFO:teuthology.orchestra.run.smithi152.stdout:(1/4): kernel-5.14.0-427.el9.x86_64.rpm 2.9 MB/s | 6.0 MB 00:02 2024-03-18T14:50:47.626 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-03-18T14:50:47.626 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-03-18T14:50:48.947 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-03-18T14:50:48.947 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-03-18T14:50:49.445 INFO:teuthology.orchestra.run.smithi152.stdout:(2/4): kernel-core-5.14.0-427.el9.x86_64.rpm 5.4 MB/s | 21 MB 00:03 2024-03-18T14:50:50.220 INFO:teuthology.orchestra.run.smithi152.stdout:(3/4): kernel-modules-5.14.0-427.el9.x86_64.rpm 8.4 MB/s | 39 MB 00:04 2024-03-18T14:50:51.653 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-03-18T14:50:52.297 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-18T14:50:52.433 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:50:52.545 INFO:teuthology.orchestra.run.smithi152.stdout:(4/4): kernel-modules-core-5.14.0-427.el9.x86_6 6.8 MB/s | 33 MB 00:04 2024-03-18T14:50:52.545 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:50:52.545 INFO:teuthology.orchestra.run.smithi152.stdout:Total 14 MB/s | 100 MB 00:07 2024-03-18T14:50:53.426 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-03-18T14:50:53.813 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-03-18T14:50:53.813 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-03-18T14:50:55.151 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-03-18T14:50:55.151 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-03-18T14:50:55.228 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:50:55.402 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:50:57.871 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-03-18T14:50:58.514 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-core-5.14.0-427.el9.x86_64 1/4 2024-03-18T14:50:58.657 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:51:00.152 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:51:00.279 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:01.473 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:51:01.662 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:51:05.064 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:06.411 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:51:06.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:11.280 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:34.348 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:34.348 INFO:teuthology.orchestra.run.smithi186.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-18T14:51:34.348 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:51:34.434 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:34.922 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:34.922 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-18T14:51:34.922 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:51:34.922 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:51:35.360 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-03-18T14:51:35.843 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:51:35.996 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:35.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T14:51:35.996 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-18T14:51:35.996 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T14:51:35.996 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T14:51:35.997 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-03-18T14:51:35.997 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T14:51:35.997 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:51:36.119 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:36.119 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T14:51:36.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.06 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 68.el9 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Group : Unspecified 2024-03-18T14:51:36.153 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 8264254 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : builder@centos.org 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : CentOS 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T14:51:36.154 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T14:51:36.155 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T14:51:36.155 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2024-03-18T14:51:36.155 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:51:36.155 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T14:51:36.156 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T14:51:36.156 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 5.14.0-427.el9.x86_64 2024-03-18T14:51:36.156 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T14:51:36.794 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2024-03-18T14:51:38.202 INFO:teuthology.orchestra.run.smithi186.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-18T14:51:38.232 INFO:teuthology.orchestra.run.smithi186.stderr:done 2024-03-18T14:51:38.234 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-03-18T14:51:38.249 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.n9bmDSjeb7 2024-03-18T14:51:38.249 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.n9bmDSjeb7 2024-03-18T14:51:38.316 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.n9bmDSjeb7 2024-03-18T14:51:38.460 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.n9bmDSjeb7 is 6KB 2024-03-18T14:51:38.480 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.n9bmDSjeb7 2024-03-18T14:51:38.493 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T14:51:38.562 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-18T14:51:38.562 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-18T14:51:38.562 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-18T14:51:38.562 INFO:teuthology.orchestra.run.smithi186.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-18T14:51:38.564 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-18T14:51:38.716 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2024-03-18T14:51:40.469 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:40.469 INFO:teuthology.orchestra.run.smithi152.stdout:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2024-03-18T14:51:40.470 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:51:40.554 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-modules-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:41.081 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:41.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-5.14.0-427.el9.x86_64 1/4 2024-03-18T14:51:41.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-core-5.14.0-427.el9.x86_64 2/4 2024-03-18T14:51:41.081 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-5.14.0-427.el9.x86_64 3/4 2024-03-18T14:51:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-modules-core-5.14.0-427.el9.x86_64 4/4 2024-03-18T14:51:41.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-core-5.14.0-427.el9.x86_64 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-5.14.0-427.el9.x86_64 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-modules-core-5.14.0-427.el9.x86_64 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:51:41.507 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-03-18T14:51:41.997 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:51:42.142 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:42.142 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T14:51:42.142 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-427.el9.x86_64 2024-03-18T14:51:42.142 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-18T14:51:42.142 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-18T14:51:42.142 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-03-18T14:51:42.142 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi152.front.sepia.ceph.com, path=None, version=distro) 2024-03-18T14:51:42.143 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q kernel | sort -rV | head -n 1 2024-03-18T14:51:42.262 INFO:teuthology.orchestra.run.smithi152.stdout:kernel-5.14.0-427.el9.x86_64 2024-03-18T14:51:42.263 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-427.el9.x86_64 2024-03-18T14:51:42.263 DEBUG:teuthology.orchestra.run.smithi152:> sudo rpm -qi grub2-tools 2024-03-18T14:51:42.298 INFO:teuthology.orchestra.run.smithi152.stdout:Name : grub2-tools 2024-03-18T14:51:42.298 INFO:teuthology.orchestra.run.smithi152.stdout:Epoch : 1 2024-03-18T14:51:42.298 INFO:teuthology.orchestra.run.smithi152.stdout:Version : 2.06 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Release : 68.el9 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Architecture: x86_64 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Group : Unspecified 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Size : 8264254 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:License : GPLv3+ 2024-03-18T14:51:42.299 INFO:teuthology.orchestra.run.smithi152.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Packager : builder@centos.org 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Vendor : CentOS 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-18T14:51:42.300 INFO:teuthology.orchestra.run.smithi152.stdout:Summary : Support tools for GRUB. 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout:Description : 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-18T14:51:42.301 INFO:teuthology.orchestra.run.smithi152.stdout:hardware devices. 2024-03-18T14:51:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:51:42.302 INFO:teuthology.orchestra.run.smithi152.stdout:This subpackage provides tools for support of all platforms. 2024-03-18T14:51:42.303 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-18T14:51:42.303 INFO:teuthology.task.kernel:Updating grub on smithi152 to boot 5.14.0-427.el9.x86_64 2024-03-18T14:51:42.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-18T14:51:42.906 INFO:teuthology.orchestra.run.smithi152.stderr:Generating grub configuration file ... 2024-03-18T14:51:44.334 INFO:teuthology.orchestra.run.smithi152.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-03-18T14:51:44.366 INFO:teuthology.orchestra.run.smithi152.stderr:done 2024-03-18T14:51:44.368 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-03-18T14:51:44.384 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.D0U8fNmY47 2024-03-18T14:51:44.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.D0U8fNmY47 2024-03-18T14:51:44.459 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.D0U8fNmY47 2024-03-18T14:51:44.601 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.D0U8fNmY47 is 6KB 2024-03-18T14:51:44.649 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.D0U8fNmY47 2024-03-18T14:51:44.663 DEBUG:teuthology.orchestra.run.smithi152:> sudo /bin/ls /boot/loader/entries || true 2024-03-18T14:51:44.728 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2024-03-18T14:51:44.728 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2024-03-18T14:51:44.728 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2024-03-18T14:51:44.728 INFO:teuthology.orchestra.run.smithi152.stdout:15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64.conf 2024-03-18T14:51:44.729 DEBUG:teuthology.orchestra.run.smithi152:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-427.el9.x86_64 2024-03-18T14:51:44.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo shutdown -r now 2024-03-18T14:52:08.742 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-03-18T14:52:08.743 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:52:08.743 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:52:14.886 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-03-18T14:52:14.886 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:52:14.887 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:52:27.294 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-03-18T14:52:33.438 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-03-18T14:52:36.298 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:52:36.298 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:52:39.358 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-03-18T14:52:42.442 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:52:42.443 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:52:45.502 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-03-18T14:52:51.365 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:52:51.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:52:57.509 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:52:57.510 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:53:09.790 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-03-18T14:53:15.934 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.152 2024-03-18T14:53:24.798 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:53:24.799 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:53:27.590 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-03-18T14:53:28.063 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:53:28.063 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "5.14.0-427.el9.x86_64"... 2024-03-18T14:53:28.064 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-03-18T14:53:28.077 INFO:teuthology.orchestra.run.smithi186.stdout:5.14.0-427.el9.x86_64 2024-03-18T14:53:28.077 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-18T14:53:28.078 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T14:53:28.078 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T14:53:29.079 DEBUG:teuthology.parallel:result is None 2024-03-18T14:53:30.935 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:53:30.935 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:53:31.253 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-03-18T14:53:31.656 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:53:31.657 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-427.el9.x86_64"... 2024-03-18T14:53:31.657 DEBUG:teuthology.orchestra.run.smithi152:> uname -r 2024-03-18T14:53:31.671 INFO:teuthology.orchestra.run.smithi152.stdout:5.14.0-427.el9.x86_64 2024-03-18T14:53:31.671 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-427.el9.x86_64 vs 5.14.0-427.el9.x86_64 2024-03-18T14:53:31.671 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-18T14:53:31.671 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-18T14:53:32.672 DEBUG:teuthology.parallel:result is None 2024-03-18T14:53:32.673 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-18T14:53:32.679 INFO:teuthology.task.internal:Creating test directory... 2024-03-18T14:53:32.680 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T14:53:32.682 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-18T14:53:32.699 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-18T14:53:32.719 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-18T14:53:32.744 INFO:teuthology.task.internal:Creating archive directory... 2024-03-18T14:53:32.744 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T14:53:32.747 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-18T14:53:32.777 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-18T14:53:32.785 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-18T14:53:32.785 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T14:53:32.808 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-18T14:53:32.867 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:53:32.879 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:53:32.916 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:53:32.966 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-18T14:53:32.968 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-18T14:53:32.975 INFO:teuthology.task.internal:Configuring sudo... 2024-03-18T14:53:32.976 DEBUG:teuthology.orchestra.run.smithi152:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T14:53:32.978 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-18T14:53:33.004 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-18T14:53:33.016 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-18T14:53:33.017 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T14:53:33.046 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-18T14:53:33.060 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:53:33.143 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:53:33.188 DEBUG:teuthology.orchestra.run.smithi152:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:53:33.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:53:33.311 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:53:33.311 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T14:53:33.403 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:53:33.448 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-18T14:53:33.503 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:53:33.581 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-18T14:53:33.622 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:53:33.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-18T14:53:33.687 DEBUG:teuthology.orchestra.run.smithi152:> sudo service rsyslog restart 2024-03-18T14:53:33.689 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-03-18T14:53:33.739 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:53:33.770 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T14:53:34.179 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-18T14:53:34.188 INFO:teuthology.task.internal:Starting timer... 2024-03-18T14:53:34.188 INFO:teuthology.run_tasks:Running task pcp... 2024-03-18T14:53:34.215 INFO:teuthology.run_tasks:Running task selinux... 2024-03-18T14:53:34.238 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:getty_t:s0']} 2024-03-18T14:53:34.239 DEBUG:teuthology.orchestra.run.smithi152:> sudo service auditd rotate 2024-03-18T14:53:34.295 INFO:teuthology.orchestra.run.smithi152.stdout:Rotating logs: 2024-03-18T14:53:34.297 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-03-18T14:53:34.396 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-03-18T14:53:34.401 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-18T14:53:34.401 DEBUG:teuthology.orchestra.run.smithi152:> /usr/sbin/getenforce 2024-03-18T14:53:34.425 INFO:teuthology.orchestra.run.smithi152.stdout:Permissive 2024-03-18T14:53:34.426 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-03-18T14:53:34.464 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-03-18T14:53:34.465 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi152.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-03-18T14:53:34.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T14:53:34.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:34.493 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T14:53:34.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T14:53:34.551 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-18T14:53:34.551 DEBUG:teuthology.orchestra.run.smithi152:> sudo /usr/sbin/setenforce permissive 2024-03-18T14:53:34.753 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-03-18T14:53:35.092 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-18T14:53:35.103 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-18T14:53:35.109 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-18T14:53:35.257 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-18T14:53:35.273 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-18T14:53:35.274 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi152.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-18T14:57:48.005 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi152.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-03-18T14:57:48.007 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:57:48.008 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi152.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:57:48.101 DEBUG:teuthology.orchestra.run.smithi152:> true 2024-03-18T14:57:48.177 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi152.front.sepia.ceph.com' 2024-03-18T14:57:48.177 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:57:48.178 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-18T14:57:48.266 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-03-18T14:57:48.353 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-03-18T14:57:48.353 INFO:teuthology.run_tasks:Running task clock... 2024-03-18T14:57:48.363 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-18T14:57:48.364 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T14:57:48.364 DEBUG:teuthology.orchestra.run.smithi152:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:57:48.367 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-18T14:57:48.367 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T14:57:48.396 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T14:57:48.413 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T14:57:48.424 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-18T14:57:48.440 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-18T14:57:48.441 INFO:teuthology.orchestra.run.smithi152.stderr:sudo: ntpd: command not found 2024-03-18T14:57:48.455 INFO:teuthology.orchestra.run.smithi152.stdout:506 Cannot talk to daemon 2024-03-18T14:57:48.469 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-03-18T14:57:48.472 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T14:57:48.482 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-03-18T14:57:48.488 INFO:teuthology.orchestra.run.smithi152.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T14:57:48.499 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-18T14:57:48.515 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-18T14:57:48.545 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-03-18T14:57:48.549 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:57:48.549 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-03-18T14:57:48.549 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.549 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.550 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.550 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.574 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.577 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T14:57:48.578 INFO:teuthology.run_tasks:Running task install... 2024-03-18T14:57:48.586 DEBUG:teuthology.task.install:project ceph 2024-03-18T14:57:48.587 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}} 2024-03-18T14:57:48.587 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'} 2024-03-18T14:57:48.587 INFO:teuthology.task.install:Using flavor: default 2024-03-18T14:57:48.594 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-18T14:57:48.594 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-03-18T14:57:48.594 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T14:57:48.595 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:57:48.597 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'tag': None, 'wait_for_package': False} 2024-03-18T14:57:48.597 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:57:48.749 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-18T14:57:48.750 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-18T14:57:48.864 INFO:teuthology.task.install.rpm:Pulling from https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/ 2024-03-18T14:57:48.865 INFO:teuthology.task.install.rpm:Package version is 19.0.0-2162.g3d78f5ba 2024-03-18T14:57:48.870 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:57:48.871 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:57:48.871 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:57:48.904 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-18T14:57:48.905 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:57:48.973 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:57:48.988 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/wip-batrick-testing-20240314.183243/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-18T14:57:48.988 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:57:48.988 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-18T14:57:49.019 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-03-18T14:57:49.019 DEBUG:teuthology.orchestra.run.smithi152:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/3d78f5ba07bf18880172c07d4d7b4ac00c9d30af/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-18T14:57:49.053 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:57:49.090 DEBUG:teuthology.orchestra.run.smithi152:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-18T14:57:49.119 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-03-18T14:57:49.121 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-03-18T14:57:49.171 DEBUG:teuthology.orchestra.run.smithi152:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-18T14:57:49.238 INFO:teuthology.orchestra.run.smithi152.stdout:check_obsoletes = 1 2024-03-18T14:57:49.240 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum clean all 2024-03-18T14:57:49.360 INFO:teuthology.orchestra.run.smithi186.stdout:74 files removed 2024-03-18T14:57:49.387 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-18T14:57:49.487 INFO:teuthology.orchestra.run.smithi152.stdout:74 files removed 2024-03-18T14:57:49.514 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-03-18T14:57:50.311 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 137 kB/s | 83 kB 00:00 2024-03-18T14:57:50.420 INFO:teuthology.orchestra.run.smithi152.stdout:ceph packages for x86_64 142 kB/s | 83 kB 00:00 2024-03-18T14:57:50.854 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 20 kB/s | 10 kB 00:00 2024-03-18T14:57:50.962 INFO:teuthology.orchestra.run.smithi152.stdout:ceph noarch packages 20 kB/s | 10 kB 00:00 2024-03-18T14:57:51.271 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 5.0 kB/s | 1.9 kB 00:00 2024-03-18T14:57:51.488 INFO:teuthology.orchestra.run.smithi152.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2024-03-18T14:57:51.907 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - AppStream 11 MB/s | 6.7 MB 00:00 2024-03-18T14:57:52.199 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - AppStream 9.9 MB/s | 6.7 MB 00:00 2024-03-18T14:57:53.332 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS-9 - BaseOS 6.7 MB/s | 2.0 MB 00:00 2024-03-18T14:57:53.641 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2024-03-18T14:57:54.690 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 8.0 MB 00:00 2024-03-18T14:57:58.233 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - AppStream 7.6 MB/s | 19 MB 00:02 2024-03-18T14:58:02.151 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - CRB 15 MB/s | 6.1 MB 00:00 2024-03-18T14:58:03.768 INFO:teuthology.orchestra.run.smithi152.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 16 kB 00:00 2024-03-18T14:58:05.789 INFO:teuthology.orchestra.run.smithi152.stdout:Extra Packages for Enterprise Linux 11 MB/s | 21 MB 00:01 2024-03-18T14:58:08.346 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - BaseOS 559 kB/s | 8.0 MB 00:14 2024-03-18T14:58:10.383 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - AppStream 19 MB/s | 19 MB 00:00 2024-03-18T14:58:10.686 INFO:teuthology.orchestra.run.smithi152.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-03-18T14:58:13.234 INFO:teuthology.orchestra.run.smithi152.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T14:58:13.234 INFO:teuthology.orchestra.run.smithi152.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T14:58:13.248 INFO:teuthology.orchestra.run.smithi152.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-18T14:58:13.249 INFO:teuthology.orchestra.run.smithi152.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-18T14:58:13.250 INFO:teuthology.orchestra.run.smithi152.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-18T14:58:13.251 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-18T14:58:13.253 INFO:teuthology.orchestra.run.smithi152.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T14:58:13.256 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-18T14:58:13.258 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-18T14:58:13.338 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-03-18T14:58:13.358 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-03-18T14:58:13.358 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-18T14:58:13.359 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-18T14:58:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-18T14:58:13.361 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-18T14:58:13.362 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-18T14:58:13.363 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-18T14:58:13.364 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-18T14:58:13.365 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-18T14:58:13.366 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-18T14:58:13.367 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-18T14:58:13.368 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-18T14:58:13.369 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-18T14:58:13.370 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-18T14:58:13.371 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-18T14:58:13.372 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-18T14:58:13.373 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout:============================================================================================ 2024-03-18T14:58:13.374 INFO:teuthology.orchestra.run.smithi152.stdout:Install 150 Packages 2024-03-18T14:58:13.375 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 24 Packages 2024-03-18T14:58:13.375 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:58:13.375 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 224 M 2024-03-18T14:58:13.375 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-03-18T14:58:13.929 INFO:teuthology.orchestra.run.smithi152.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 27 kB/s | 6.6 kB 00:00 2024-03-18T14:58:14.488 INFO:teuthology.orchestra.run.smithi152.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.6 MB/s | 890 kB 00:00 2024-03-18T14:58:14.572 INFO:teuthology.orchestra.run.smithi152.stdout:(3/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 6.0 MB/s | 5.4 MB 00:00 2024-03-18T14:58:14.655 INFO:teuthology.orchestra.run.smithi152.stdout:(4/174): ceph-immutable-object-cache-19.0.0-216 868 kB/s | 145 kB 00:00 2024-03-18T14:58:14.772 INFO:teuthology.orchestra.run.smithi152.stdout:(5/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 12 MB/s | 2.4 MB 00:00 2024-03-18T14:58:14.883 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - CRB 6.1 MB/s | 6.1 MB 00:00 2024-03-18T14:58:15.064 INFO:teuthology.orchestra.run.smithi152.stdout:(6/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 16 MB/s | 4.7 MB 00:00 2024-03-18T14:58:15.222 INFO:teuthology.orchestra.run.smithi152.stdout:(7/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 2.6 MB/s | 1.5 MB 00:00 2024-03-18T14:58:16.056 INFO:teuthology.orchestra.run.smithi152.stdout:(8/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x86 17 MB/s | 17 MB 00:00 2024-03-18T14:58:16.098 INFO:teuthology.orchestra.run.smithi152.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 608 kB/s | 25 kB 00:00 2024-03-18T14:58:16.332 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 9 - Extras packages 72 kB/s | 16 kB 00:00 2024-03-18T14:58:17.215 INFO:teuthology.orchestra.run.smithi152.stdout:(10/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el 4.9 MB/s | 9.8 MB 00:01 2024-03-18T14:58:17.340 INFO:teuthology.orchestra.run.smithi152.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 1.7 MB/s | 221 kB 00:00 2024-03-18T14:58:17.449 INFO:teuthology.orchestra.run.smithi152.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 249 kB/s | 27 kB 00:00 2024-03-18T14:58:17.557 INFO:teuthology.orchestra.run.smithi152.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 293 kB/s | 32 kB 00:00 2024-03-18T14:58:17.766 INFO:teuthology.orchestra.run.smithi152.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 3.5 MB/s | 747 kB 00:00 2024-03-18T14:58:17.891 INFO:teuthology.orchestra.run.smithi152.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.3 MB/s | 163 kB 00:00 2024-03-18T14:58:18.033 INFO:teuthology.orchestra.run.smithi152.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 896 kB/s | 127 kB 00:00 2024-03-18T14:58:18.167 INFO:teuthology.orchestra.run.smithi152.stdout:(17/174): libradosstriper1-19.0.0-2162.g3d78f5b 3.7 MB/s | 501 kB 00:00 2024-03-18T14:58:18.359 INFO:teuthology.orchestra.run.smithi152.stdout:(18/174): ceph-common-19.0.0-2162.g3d78f5ba.el9 4.4 MB/s | 21 MB 00:04 2024-03-18T14:58:18.459 INFO:teuthology.orchestra.run.smithi152.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 452 kB/s | 45 kB 00:00 2024-03-18T14:58:18.542 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 9.9 MB/s | 21 MB 00:02 2024-03-18T14:58:18.968 INFO:teuthology.orchestra.run.smithi152.stdout:(20/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 17 MB/s | 48 MB 00:02 2024-03-18T14:58:18.993 INFO:teuthology.orchestra.run.smithi152.stdout:(21/174): python3-ceph-common-19.0.0-2162.g3d78 246 kB/s | 131 kB 00:00 2024-03-18T14:58:19.018 INFO:teuthology.orchestra.run.smithi152.stdout:(22/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 3.2 MB/s | 162 kB 00:00 2024-03-18T14:58:19.102 INFO:teuthology.orchestra.run.smithi152.stdout:(23/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 5.5 MB/s | 5.1 MB 00:00 2024-03-18T14:58:19.135 INFO:teuthology.orchestra.run.smithi152.stdout:(24/174): python3-rados-19.0.0-2162.g3d78f5ba.e 2.2 MB/s | 320 kB 00:00 2024-03-18T14:58:19.161 INFO:teuthology.orchestra.run.smithi152.stdout:(25/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 2.0 MB/s | 298 kB 00:00 2024-03-18T14:58:19.186 INFO:teuthology.orchestra.run.smithi152.stdout:(26/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.2 MB/s | 99 kB 00:00 2024-03-18T14:58:19.211 INFO:teuthology.orchestra.run.smithi152.stdout:(27/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.1 MB/s | 85 kB 00:00 2024-03-18T14:58:19.270 INFO:teuthology.orchestra.run.smithi152.stdout:(28/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.0 MB/s | 170 kB 00:00 2024-03-18T14:58:19.296 INFO:teuthology.orchestra.run.smithi152.stdout:(29/174): ceph-grafana-dashboards-19.0.0-2162.g 406 kB/s | 34 kB 00:00 2024-03-18T14:58:19.346 INFO:teuthology.orchestra.run.smithi152.stdout:(30/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 17 MB/s | 3.1 MB 00:00 2024-03-18T14:58:19.371 INFO:teuthology.orchestra.run.smithi152.stdout:(31/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 1.3 MB/s | 139 kB 00:00 2024-03-18T14:58:19.463 INFO:teuthology.orchestra.run.smithi152.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 2.7 MB/s | 248 kB 00:00 2024-03-18T14:58:19.555 INFO:teuthology.orchestra.run.smithi152.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 539 kB/s | 49 kB 00:00 2024-03-18T14:58:19.630 INFO:teuthology.orchestra.run.smithi152.stdout:(34/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 5.4 MB/s | 1.8 MB 00:00 2024-03-18T14:58:19.647 INFO:teuthology.orchestra.run.smithi152.stdout:(35/174): ceph-prometheus-alerts-19.0.0-2162.g3 179 kB/s | 16 kB 00:00 2024-03-18T14:58:19.756 INFO:teuthology.orchestra.run.smithi152.stdout:(36/174): ceph-mgr-diskprediction-local-19.0.0- 18 MB/s | 7.4 MB 00:00 2024-03-18T14:58:19.781 INFO:teuthology.orchestra.run.smithi152.stdout:(37/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 1.7 MB/s | 264 kB 00:00 2024-03-18T14:58:19.798 INFO:teuthology.orchestra.run.smithi152.stdout:(38/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 438 kB/s | 18 kB 00:00 2024-03-18T14:58:19.840 INFO:teuthology.orchestra.run.smithi152.stdout:(39/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 3.8 MB/s | 748 kB 00:00 2024-03-18T14:58:19.998 INFO:teuthology.orchestra.run.smithi152.stdout:(40/174): boost-program-options-1.75.0-8.el9.x8 994 kB/s | 106 kB 00:00 2024-03-18T14:58:20.049 INFO:teuthology.orchestra.run.smithi152.stdout:(41/174): bison-3.7.4-5.el9.x86_64.rpm 3.6 MB/s | 920 kB 00:00 2024-03-18T14:58:20.141 INFO:teuthology.orchestra.run.smithi152.stdout:(42/174): automake-1.16.2-8.el9.noarch.rpm 1.8 MB/s | 662 kB 00:00 2024-03-18T14:58:20.166 INFO:teuthology.orchestra.run.smithi152.stdout:(43/174): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 307 kB 00:00 2024-03-18T14:58:20.183 INFO:teuthology.orchestra.run.smithi152.stdout:(44/174): flexiblas-3.0.4-8.el9.x86_64.rpm 237 kB/s | 32 kB 00:00 2024-03-18T14:58:20.266 INFO:teuthology.orchestra.run.smithi152.stdout:(45/174): flexiblas-openblas-openmp-3.0.4-8.el9 171 kB/s | 17 kB 00:00 2024-03-18T14:58:20.292 INFO:teuthology.orchestra.run.smithi152.stdout:(46/174): libaio-devel-0.3.111-13.el9.x86_64.rp 93 kB/s | 10 kB 00:00 2024-03-18T14:58:20.384 INFO:teuthology.orchestra.run.smithi152.stdout:(47/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 12 MB/s | 3.0 MB 00:00 2024-03-18T14:58:20.409 INFO:teuthology.orchestra.run.smithi152.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 159 kB 00:00 2024-03-18T14:58:20.426 INFO:teuthology.orchestra.run.smithi152.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 332 kB/s | 44 kB 00:00 2024-03-18T14:58:20.451 INFO:teuthology.orchestra.run.smithi152.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 661 kB 00:00 2024-03-18T14:58:20.477 INFO:teuthology.orchestra.run.smithi152.stdout:(51/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 950 kB/s | 46 kB 00:00 2024-03-18T14:58:20.510 INFO:teuthology.orchestra.run.smithi152.stdout:(52/174): libtool-2.4.6-45.el9.x86_64.rpm 6.8 MB/s | 578 kB 00:00 2024-03-18T14:58:20.535 INFO:teuthology.orchestra.run.smithi152.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-18T14:58:20.561 INFO:teuthology.orchestra.run.smithi152.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-03-18T14:58:20.586 INFO:teuthology.orchestra.run.smithi152.stdout:(55/174): openblas-0.3.21-2.el9.x86_64.rpm 688 kB/s | 34 kB 00:00 2024-03-18T14:58:20.611 INFO:teuthology.orchestra.run.smithi152.stdout:(56/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.8 MB/s | 217 kB 00:00 2024-03-18T14:58:20.787 INFO:teuthology.orchestra.run.smithi152.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 21 MB/s | 4.7 MB 00:00 2024-03-18T14:58:20.829 INFO:teuthology.orchestra.run.smithi152.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 6.3 MB/s | 1.5 MB 00:00 2024-03-18T14:58:20.862 INFO:teuthology.orchestra.run.smithi152.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 3.2 MB/s | 811 kB 00:00 2024-03-18T14:58:20.887 INFO:teuthology.orchestra.run.smithi152.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-03-18T14:58:20.929 INFO:teuthology.orchestra.run.smithi152.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 15 MB/s | 1.0 MB 00:00 2024-03-18T14:58:21.005 INFO:teuthology.orchestra.run.smithi152.stdout:(62/174): python3-attrs-20.3.0-7.el9.noarch.rpm 671 kB/s | 78 kB 00:00 2024-03-18T14:58:21.088 INFO:teuthology.orchestra.run.smithi152.stdout:(63/174): postgresql-server-13.11-1.el9.x86_64. 25 MB/s | 5.7 MB 00:00 2024-03-18T14:58:21.222 INFO:teuthology.orchestra.run.smithi152.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2024-03-18T14:58:21.239 INFO:teuthology.orchestra.run.smithi152.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 105 kB/s | 24 kB 00:00 2024-03-18T14:58:21.256 INFO:teuthology.orchestra.run.smithi152.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 110 kB/s | 18 kB 00:00 2024-03-18T14:58:21.281 INFO:teuthology.orchestra.run.smithi152.stdout:(67/174): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2024-03-18T14:58:21.298 INFO:teuthology.orchestra.run.smithi152.stdout:(68/174): python3-markupsafe-1.1.1-12.el9.x86_6 758 kB/s | 32 kB 00:00 2024-03-18T14:58:21.432 INFO:teuthology.orchestra.run.smithi152.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 27 MB/s | 4.8 MB 00:00 2024-03-18T14:58:21.457 INFO:teuthology.orchestra.run.smithi152.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.2 MB/s | 217 kB 00:00 2024-03-18T14:58:21.482 INFO:teuthology.orchestra.run.smithi152.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 957 kB/s | 174 kB 00:00 2024-03-18T14:58:21.508 INFO:teuthology.orchestra.run.smithi152.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 918 kB/s | 69 kB 00:00 2024-03-18T14:58:21.524 INFO:teuthology.orchestra.run.smithi152.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 986 kB/s | 41 kB 00:00 2024-03-18T14:58:21.549 INFO:teuthology.orchestra.run.smithi152.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 3.5 MB/s | 238 kB 00:00 2024-03-18T14:58:21.575 INFO:teuthology.orchestra.run.smithi152.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-18T14:58:21.592 INFO:teuthology.orchestra.run.smithi152.stdout:(76/174): python3-pytz-2021.1-5.el9.noarch.rpm 1.1 MB/s | 47 kB 00:00 2024-03-18T14:58:21.626 INFO:teuthology.orchestra.run.smithi152.stdout:(77/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2024-03-18T14:58:21.642 INFO:teuthology.orchestra.run.smithi152.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 638 kB/s | 43 kB 00:00 2024-03-18T14:58:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:(79/174): python3-toml-0.10.2-6.el9.noarch.rpm 151 kB/s | 39 kB 00:00 2024-03-18T14:58:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:(80/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 150 kB/s | 41 kB 00:00 2024-03-18T14:58:22.135 INFO:teuthology.orchestra.run.smithi152.stdout:(81/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-03-18T14:58:22.160 INFO:teuthology.orchestra.run.smithi152.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 1.1 MB/s | 300 kB 00:00 2024-03-18T14:58:22.177 INFO:teuthology.orchestra.run.smithi152.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 219 kB/s | 56 kB 00:00 2024-03-18T14:58:22.194 INFO:teuthology.orchestra.run.smithi152.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2024-03-18T14:58:22.219 INFO:teuthology.orchestra.run.smithi152.stdout:(85/174): fuse-2.9.9-15.el9.x86_64.rpm 1.8 MB/s | 79 kB 00:00 2024-03-18T14:58:22.236 INFO:teuthology.orchestra.run.smithi152.stdout:(86/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 749 kB/s | 44 kB 00:00 2024-03-18T14:58:22.261 INFO:teuthology.orchestra.run.smithi152.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.5 MB/s | 241 kB 00:00 2024-03-18T14:58:22.295 INFO:teuthology.orchestra.run.smithi152.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 15 MB/s | 1.1 MB 00:00 2024-03-18T14:58:22.320 INFO:teuthology.orchestra.run.smithi152.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 103 kB 00:00 2024-03-18T14:58:22.337 INFO:teuthology.orchestra.run.smithi152.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-18T14:58:22.362 INFO:teuthology.orchestra.run.smithi152.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-18T14:58:23.229 INFO:teuthology.orchestra.run.smithi152.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 210 kB/s | 187 kB 00:00 2024-03-18T14:58:23.279 INFO:teuthology.orchestra.run.smithi152.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 213 kB/s | 195 kB 00:00 2024-03-18T14:58:23.380 INFO:teuthology.orchestra.run.smithi152.stdout:(94/174): elfutils-libelf-devel-0.190-2.el9.x86 215 kB/s | 21 kB 00:00 2024-03-18T14:58:23.430 INFO:teuthology.orchestra.run.smithi152.stdout:(95/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-03-18T14:58:23.559 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-03-18T14:58:23.755 INFO:teuthology.orchestra.run.smithi152.stdout:(96/174): openssl-devel-3.0.7-27.el9.x86_64.rpm 13 MB/s | 4.1 MB 00:00 2024-03-18T14:58:23.806 INFO:teuthology.orchestra.run.smithi152.stdout:(97/174): python3-devel-3.9.17-2.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-03-18T14:58:23.864 INFO:teuthology.orchestra.run.smithi152.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-03-18T14:58:23.956 INFO:teuthology.orchestra.run.smithi152.stdout:(99/174): qatlib-23.11.0-1.el9.x86_64.rpm 2.3 MB/s | 216 kB 00:00 2024-03-18T14:58:24.007 INFO:teuthology.orchestra.run.smithi152.stdout:(100/174): qatlib-service-23.11.0-1.el9.x86_64. 698 kB/s | 35 kB 00:00 2024-03-18T14:58:24.040 INFO:teuthology.orchestra.run.smithi152.stdout:(101/174): libgfortran-11.4.1-3.el9.x86_64.rpm 472 kB/s | 803 kB 00:01 2024-03-18T14:58:24.066 INFO:teuthology.orchestra.run.smithi152.stdout:(102/174): python3-requests-2.25.1-8.el9.noarch 149 kB/s | 125 kB 00:00 2024-03-18T14:58:24.091 INFO:teuthology.orchestra.run.smithi152.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 531 kB/s | 44 kB 00:00 2024-03-18T14:58:24.158 INFO:teuthology.orchestra.run.smithi152.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 810 kB/s | 94 kB 00:00 2024-03-18T14:58:24.175 INFO:teuthology.orchestra.run.smithi152.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 205 kB/s | 22 kB 00:00 2024-03-18T14:58:24.383 INFO:teuthology.orchestra.run.smithi152.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 2.9 MB/s | 863 kB 00:00 2024-03-18T14:58:24.609 INFO:teuthology.orchestra.run.smithi152.stdout:(107/174): gperftools-libs-2.9.1-2.el9.x86_64.r 712 kB/s | 309 kB 00:00 2024-03-18T14:58:24.626 INFO:teuthology.orchestra.run.smithi152.stdout:(108/174): grpc-data-1.46.7-10.el9.noarch.rpm 80 kB/s | 19 kB 00:00 2024-03-18T14:58:24.676 INFO:teuthology.orchestra.run.smithi152.stdout:(109/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.0 MB/s | 548 kB 00:00 2024-03-18T14:58:24.710 INFO:teuthology.orchestra.run.smithi152.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 311 kB/s | 26 kB 00:00 2024-03-18T14:58:24.760 INFO:teuthology.orchestra.run.smithi152.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 581 kB/s | 49 kB 00:00 2024-03-18T14:58:24.869 INFO:teuthology.orchestra.run.smithi152.stdout:(112/174): luarocks-3.9.2-1.el9.noarch.rpm 1.4 MB/s | 151 kB 00:00 2024-03-18T14:58:24.894 INFO:teuthology.orchestra.run.smithi152.stdout:(113/174): libunwind-1.6.2-1.el9.x86_64.rpm 366 kB/s | 67 kB 00:00 2024-03-18T14:58:25.044 INFO:teuthology.orchestra.run.smithi152.stdout:(114/174): libarrow-9.0.0-10.el9.x86_64.rpm 10 MB/s | 4.4 MB 00:00 2024-03-18T14:58:25.078 INFO:teuthology.orchestra.run.smithi152.stdout:(115/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.9 MB/s | 838 kB 00:00 2024-03-18T14:58:25.145 INFO:teuthology.orchestra.run.smithi152.stdout:(116/174): python3-asyncssh-2.13.2-4.el9.noarch 2.1 MB/s | 548 kB 00:00 2024-03-18T14:58:25.162 INFO:teuthology.orchestra.run.smithi152.stdout:(117/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 371 kB/s | 43 kB 00:00 2024-03-18T14:58:25.179 INFO:teuthology.orchestra.run.smithi152.stdout:(118/174): python3-cachetools-4.2.4-1.el9.noarc 321 kB/s | 32 kB 00:00 2024-03-18T14:58:25.296 INFO:teuthology.orchestra.run.smithi152.stdout:(119/174): python3-certifi-2021.10.8-2.el9.noar 99 kB/s | 15 kB 00:00 2024-03-18T14:58:25.354 INFO:teuthology.orchestra.run.smithi152.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 893 kB/s | 172 kB 00:00 2024-03-18T14:58:25.380 INFO:teuthology.orchestra.run.smithi152.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 1.7 MB/s | 358 kB 00:00 2024-03-18T14:58:25.405 INFO:teuthology.orchestra.run.smithi152.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2024-03-18T14:58:25.447 INFO:teuthology.orchestra.run.smithi152.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 383 kB/s | 35 kB 00:00 2024-03-18T14:58:25.472 INFO:teuthology.orchestra.run.smithi152.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 2.1 MB/s | 203 kB 00:00 2024-03-18T14:58:25.539 INFO:teuthology.orchestra.run.smithi152.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.5 MB/s | 144 kB 00:00 2024-03-18T14:58:25.565 INFO:teuthology.orchestra.run.smithi152.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 116 kB/s | 11 kB 00:00 2024-03-18T14:58:25.631 INFO:teuthology.orchestra.run.smithi152.stdout:(127/174): python3-jaraco-classes-3.2.1-5.el9.n 192 kB/s | 18 kB 00:00 2024-03-18T14:58:25.657 INFO:teuthology.orchestra.run.smithi152.stdout:(128/174): python3-jaraco-collections-3.0.0-8.e 252 kB/s | 23 kB 00:00 2024-03-18T14:58:25.699 INFO:teuthology.orchestra.run.smithi152.stdout:(129/174): python3-grpcio-1.46.7-10.el9.x86_64. 6.9 MB/s | 2.0 MB 00:00 2024-03-18T14:58:25.724 INFO:teuthology.orchestra.run.smithi152.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 210 kB/s | 19 kB 00:00 2024-03-18T14:58:25.749 INFO:teuthology.orchestra.run.smithi152.stdout:(131/174): python3-jaraco-text-3.2.0-6.el9.noar 213 kB/s | 20 kB 00:00 2024-03-18T14:58:25.839 INFO:teuthology.orchestra.run.smithi152.stdout:(132/174): python3-kubernetes-26.1.0-2.el9.noar 7.3 MB/s | 1.0 MB 00:00 2024-03-18T14:58:25.866 INFO:teuthology.orchestra.run.smithi152.stdout:(133/174): python3-logutils-0.3.5-21.el9.noarch 326 kB/s | 46 kB 00:00 2024-03-18T14:58:25.892 INFO:teuthology.orchestra.run.smithi152.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 554 kB/s | 79 kB 00:00 2024-03-18T14:58:25.942 INFO:teuthology.orchestra.run.smithi152.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 563 kB/s | 58 kB 00:00 2024-03-18T14:58:25.968 INFO:teuthology.orchestra.run.smithi152.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 2.6 MB/s | 272 kB 00:00 2024-03-18T14:58:25.993 INFO:teuthology.orchestra.run.smithi152.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 163 kB/s | 16 kB 00:00 2024-03-18T14:58:26.035 INFO:teuthology.orchestra.run.smithi152.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 975 kB/s | 90 kB 00:00 2024-03-18T14:58:26.053 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T14:58:26.053 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-03-18T14:58:26.060 INFO:teuthology.orchestra.run.smithi152.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 307 kB/s | 28 kB 00:00 2024-03-18T14:58:26.065 INFO:teuthology.orchestra.run.smithi186.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2024-03-18T14:58:26.066 INFO:teuthology.orchestra.run.smithi186.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-03-18T14:58:26.067 INFO:teuthology.orchestra.run.smithi186.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2024-03-18T14:58:26.068 INFO:teuthology.orchestra.run.smithi186.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2024-03-18T14:58:26.070 INFO:teuthology.orchestra.run.smithi186.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T14:58:26.072 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2024-03-18T14:58:26.073 INFO:teuthology.orchestra.run.smithi186.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2024-03-18T14:58:26.085 INFO:teuthology.orchestra.run.smithi152.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 333 kB/s | 31 kB 00:00 2024-03-18T14:58:26.127 INFO:teuthology.orchestra.run.smithi152.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2024-03-18T14:58:26.152 INFO:teuthology.orchestra.run.smithi152.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 640 kB/s | 59 kB 00:00 2024-03-18T14:58:26.153 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-03-18T14:58:26.178 INFO:teuthology.orchestra.run.smithi152.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 387 kB/s | 36 kB 00:00 2024-03-18T14:58:26.184 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 6.6 k 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.4 M 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 890 k 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 145 k 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 1.5 M 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 139 k 2024-03-18T14:58:26.185 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 1.8 M 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 7.4 M 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 49 k 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 9.8 M 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 48 M 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 264 k 2024-03-18T14:58:26.186 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 748 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 221 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 27 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 18 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel x86_64 0.190-2.el9 appstream 21 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 32 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 747 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 127 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2024-03-18T14:58:26.187 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel x86_64 1:3.0.7-27.el9 appstream 4.1 M 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 162 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 320 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 298 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 99 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 85 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 170 k 2024-03-18T14:58:26.188 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel x86_64 6.3.0-1.el9 appstream 94 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager x86_64 1:1.46.0-1.el9 baseos 2.3 M 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm x86_64 1:1.46.0-1.el9 baseos 1.8 M 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team x86_64 1:1.46.0-1.el9 baseos 42 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui x86_64 1:1.46.0-1.el9 baseos 248 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: acl x86_64 2.3.1-4.el9 baseos 71 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client x86_64 0.190-2.el9 baseos 36 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf x86_64 0.190-2.el9 baseos 192 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs x86_64 0.190-2.el9 baseos 256 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: libacl x86_64 2.3.1-4.el9 baseos 23 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel x86_64 2.3.1-4.el9 appstream 74 k 2024-03-18T14:58:26.189 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid x86_64 2.37.4-18.el9 baseos 108 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk x86_64 2.37.4-18.el9 baseos 155 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: libmount x86_64 2.37.4-18.el9 baseos 136 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.4 M 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 3.1 M 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols x86_64 2.37.4-18.el9 baseos 64 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid x86_64 2.37.4-18.el9 baseos 29 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: openssl x86_64 1:3.0.7-27.el9 baseos 1.2 M 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs x86_64 1:3.0.7-27.el9 baseos 2.2 M 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux x86_64 2.37.4-18.el9 baseos 2.3 M 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-core x86_64 2.37.4-18.el9 baseos 465 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user x86_64 2.37.4-18.el9 baseos 31 k 2024-03-18T14:58:26.190 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs x86_64 6.3.0-1.el9 baseos 1.1 M 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 21 M 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 34 k 2024-03-18T14:58:26.191 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 2.4 M 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 248 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 4.7 M 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 17 M 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts noarch 2:19.0.0-2162.g3d78f5ba.el9 ceph-noarch 16 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 25 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-03-18T14:58:26.192 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-16.el9 baseos 187 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 163 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2024-03-18T14:58:26.193 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 501 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 5.1 M 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2024-03-18T14:58:26.194 INFO:teuthology.orchestra.run.smithi186.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf x86_64 3.14.0-13.el9 CentOS-AppStream 1.0 M 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh noarch 2.13.2-4.el9 epel 548 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2024-03-18T14:58:26.195 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 45 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:19.0.0-2162.g3d78f5ba.el9 ceph 131 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth noarch 1:2.28.0-1.el9 epel 203 k 2024-03-18T14:58:26.196 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2 noarch 2.11.3-5.el9 appstream 248 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2024-03-18T14:58:26.197 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging noarch 20.9-5.el9 CentOS-AppStream 69 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf noarch 3.14.0-13.el9 CentOS-AppStream 238 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2024-03-18T14:58:26.198 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3 noarch 1.26.5-5.el9 CentOS-BaseOS 187 k 2024-03-18T14:58:26.199 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib x86_64 23.11.0-1.el9 appstream 216 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs x86_64 1.1.2-2.el9 appstream 44 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout:Installing weak dependencies: 2024-03-18T14:58:26.200 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service x86_64 23.11.0-1.el9 appstream 35 k 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:============================================================================================ 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:Install 150 Packages 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 24 Packages 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 224 M 2024-03-18T14:58:26.201 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-03-18T14:58:26.220 INFO:teuthology.orchestra.run.smithi152.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 553 kB/s | 51 kB 00:00 2024-03-18T14:58:26.245 INFO:teuthology.orchestra.run.smithi152.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-03-18T14:58:26.270 INFO:teuthology.orchestra.run.smithi152.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 972 kB/s | 90 kB 00:00 2024-03-18T14:58:26.321 INFO:teuthology.orchestra.run.smithi152.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 4.2 MB/s | 427 kB 00:00 2024-03-18T14:58:26.346 INFO:teuthology.orchestra.run.smithi152.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 199 kB/s | 20 kB 00:00 2024-03-18T14:58:26.371 INFO:teuthology.orchestra.run.smithi152.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 1.9 MB/s | 192 kB 00:00 2024-03-18T14:58:26.638 INFO:teuthology.orchestra.run.smithi152.stdout:(150/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 12 MB/s | 3.1 MB 00:00 2024-03-18T14:58:26.680 INFO:teuthology.orchestra.run.smithi152.stdout:(151/174): thrift-0.15.0-2.el9.x86_64.rpm 4.4 MB/s | 1.6 MB 00:00 2024-03-18T14:58:26.714 INFO:teuthology.orchestra.run.smithi152.stdout:(152/174): xfsdump-3.1.12-4.el9.x86_64.rpm 4.2 MB/s | 321 kB 00:00 2024-03-18T14:58:27.039 INFO:teuthology.orchestra.run.smithi152.stdout:(153/174): librados2-19.0.0-2162.g3d78f5ba.el9. 4.9 MB/s | 3.4 MB 00:00 2024-03-18T14:58:27.235 INFO:teuthology.orchestra.run.smithi186.stdout:(1/174): ceph-19.0.0-2162.g3d78f5ba.el9.x86_64. 39 kB/s | 6.6 kB 00:00 2024-03-18T14:58:27.410 INFO:teuthology.orchestra.run.smithi186.stdout:(2/174): ceph-fuse-19.0.0-2162.g3d78f5ba.el9.x8 5.0 MB/s | 890 kB 00:00 2024-03-18T14:58:27.460 INFO:teuthology.orchestra.run.smithi186.stdout:(3/174): ceph-immutable-object-cache-19.0.0-216 2.8 MB/s | 145 kB 00:00 2024-03-18T14:58:27.661 INFO:teuthology.orchestra.run.smithi186.stdout:(4/174): ceph-mds-19.0.0-2162.g3d78f5ba.el9.x86 12 MB/s | 2.4 MB 00:00 2024-03-18T14:58:27.731 INFO:teuthology.orchestra.run.smithi152.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 61 kB/s | 42 kB 00:00 2024-03-18T14:58:27.802 INFO:teuthology.orchestra.run.smithi186.stdout:(5/174): ceph-mgr-19.0.0-2162.g3d78f5ba.el9.x86 11 MB/s | 1.5 MB 00:00 2024-03-18T14:58:28.186 INFO:teuthology.orchestra.run.smithi186.stdout:(6/174): ceph-mon-19.0.0-2162.g3d78f5ba.el9.x86 12 MB/s | 4.7 MB 00:00 2024-03-18T14:58:28.370 INFO:teuthology.orchestra.run.smithi186.stdout:(7/174): ceph-base-19.0.0-2162.g3d78f5ba.el9.x8 4.1 MB/s | 5.4 MB 00:01 2024-03-18T14:58:28.948 INFO:teuthology.orchestra.run.smithi152.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 204 kB/s | 248 kB 00:01 2024-03-18T14:58:29.170 INFO:teuthology.orchestra.run.smithi186.stdout:(8/174): ceph-osd-19.0.0-2162.g3d78f5ba.el9.x86 17 MB/s | 17 MB 00:00 2024-03-18T14:58:29.203 INFO:teuthology.orchestra.run.smithi186.stdout:(9/174): ceph-selinux-19.0.0-2162.g3d78f5ba.el9 765 kB/s | 25 kB 00:00 2024-03-18T14:58:29.839 INFO:teuthology.orchestra.run.smithi152.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 80 kB/s | 71 kB 00:00 2024-03-18T14:58:30.254 INFO:teuthology.orchestra.run.smithi186.stdout:(10/174): ceph-radosgw-19.0.0-2162.g3d78f5ba.el 5.2 MB/s | 9.8 MB 00:01 2024-03-18T14:58:30.395 INFO:teuthology.orchestra.run.smithi186.stdout:(11/174): cephfs-mirror-19.0.0-2162.g3d78f5ba.e 1.5 MB/s | 221 kB 00:00 2024-03-18T14:58:30.481 INFO:teuthology.orchestra.run.smithi152.stdout:(157/174): NetworkManager-libnm-1.46.0-1.el9.x8 494 kB/s | 1.8 MB 00:03 2024-03-18T14:58:30.504 INFO:teuthology.orchestra.run.smithi186.stdout:(12/174): cephfs-shell-19.0.0-2162.g3d78f5ba.el 250 kB/s | 27 kB 00:00 2024-03-18T14:58:30.629 INFO:teuthology.orchestra.run.smithi186.stdout:(13/174): libcephfs-devel-19.0.0-2162.g3d78f5ba 253 kB/s | 32 kB 00:00 2024-03-18T14:58:30.665 INFO:teuthology.orchestra.run.smithi152.stdout:(158/174): elfutils-debuginfod-client-0.190-2.e 44 kB/s | 36 kB 00:00 2024-03-18T14:58:30.955 INFO:teuthology.orchestra.run.smithi186.stdout:(14/174): libcephfs2-19.0.0-2162.g3d78f5ba.el9. 2.2 MB/s | 747 kB 00:00 2024-03-18T14:58:31.080 INFO:teuthology.orchestra.run.smithi186.stdout:(15/174): libcephsqlite-19.0.0-2162.g3d78f5ba.e 1.3 MB/s | 163 kB 00:00 2024-03-18T14:58:31.132 INFO:teuthology.orchestra.run.smithi152.stdout:(159/174): NetworkManager-1.46.0-1.el9.x86_64.r 527 kB/s | 2.3 MB 00:04 2024-03-18T14:58:31.197 INFO:teuthology.orchestra.run.smithi186.stdout:(16/174): librados-devel-19.0.0-2162.g3d78f5ba. 1.1 MB/s | 127 kB 00:00 2024-03-18T14:58:31.574 INFO:teuthology.orchestra.run.smithi152.stdout:(160/174): elfutils-libelf-0.190-2.el9.x86_64.r 176 kB/s | 192 kB 00:01 2024-03-18T14:58:31.631 INFO:teuthology.orchestra.run.smithi186.stdout:(17/174): ceph-test-19.0.0-2162.g3d78f5ba.el9.x 20 MB/s | 48 MB 00:02 2024-03-18T14:58:31.664 INFO:teuthology.orchestra.run.smithi186.stdout:(18/174): libradosstriper1-19.0.0-2162.g3d78f5b 1.0 MB/s | 501 kB 00:00 2024-03-18T14:58:31.790 INFO:teuthology.orchestra.run.smithi186.stdout:(19/174): python3-ceph-argparse-19.0.0-2162.g3d 361 kB/s | 45 kB 00:00 2024-03-18T14:58:31.832 INFO:teuthology.orchestra.run.smithi152.stdout:(161/174): libacl-2.3.1-4.el9.x86_64.rpm 33 kB/s | 23 kB 00:00 2024-03-18T14:58:31.907 INFO:teuthology.orchestra.run.smithi186.stdout:(20/174): librgw2-19.0.0-2162.g3d78f5ba.el9.x86 19 MB/s | 5.1 MB 00:00 2024-03-18T14:58:31.916 INFO:teuthology.orchestra.run.smithi152.stdout:(162/174): elfutils-libs-0.190-2.el9.x86_64.rpm 204 kB/s | 256 kB 00:01 2024-03-18T14:58:31.932 INFO:teuthology.orchestra.run.smithi186.stdout:(21/174): python3-ceph-common-19.0.0-2162.g3d78 925 kB/s | 131 kB 00:00 2024-03-18T14:58:31.957 INFO:teuthology.orchestra.run.smithi186.stdout:(22/174): python3-cephfs-19.0.0-2162.g3d78f5ba. 3.2 MB/s | 162 kB 00:00 2024-03-18T14:58:32.007 INFO:teuthology.orchestra.run.smithi186.stdout:(23/174): python3-rbd-19.0.0-2162.g3d78f5ba.el9 5.8 MB/s | 298 kB 00:00 2024-03-18T14:58:32.066 INFO:teuthology.orchestra.run.smithi186.stdout:(24/174): python3-rgw-19.0.0-2162.g3d78f5ba.el9 1.7 MB/s | 99 kB 00:00 2024-03-18T14:58:32.108 INFO:teuthology.orchestra.run.smithi186.stdout:(25/174): python3-rados-19.0.0-2162.g3d78f5ba.e 1.8 MB/s | 320 kB 00:00 2024-03-18T14:58:32.133 INFO:teuthology.orchestra.run.smithi186.stdout:(26/174): rbd-fuse-19.0.0-2162.g3d78f5ba.el9.x8 1.2 MB/s | 85 kB 00:00 2024-03-18T14:58:32.200 INFO:teuthology.orchestra.run.smithi186.stdout:(27/174): rbd-nbd-19.0.0-2162.g3d78f5ba.el9.x86 2.5 MB/s | 170 kB 00:00 2024-03-18T14:58:32.250 INFO:teuthology.orchestra.run.smithi186.stdout:(28/174): ceph-grafana-dashboards-19.0.0-2162.g 681 kB/s | 34 kB 00:00 2024-03-18T14:58:32.301 INFO:teuthology.orchestra.run.smithi186.stdout:(29/174): ceph-mgr-cephadm-19.0.0-2162.g3d78f5b 2.7 MB/s | 139 kB 00:00 2024-03-18T14:58:32.426 INFO:teuthology.orchestra.run.smithi186.stdout:(30/174): ceph-mgr-dashboard-19.0.0-2162.g3d78f 14 MB/s | 1.8 MB 00:00 2024-03-18T14:58:32.616 INFO:teuthology.orchestra.run.smithi152.stdout:(163/174): libblkid-2.37.4-18.el9.x86_64.rpm 104 kB/s | 108 kB 00:01 2024-03-18T14:58:32.826 INFO:teuthology.orchestra.run.smithi186.stdout:(31/174): ceph-mgr-diskprediction-local-19.0.0- 19 MB/s | 7.4 MB 00:00 2024-03-18T14:58:32.876 INFO:teuthology.orchestra.run.smithi186.stdout:(32/174): ceph-mgr-modules-core-19.0.0-2162.g3d 4.9 MB/s | 248 kB 00:00 2024-03-18T14:58:32.900 INFO:teuthology.orchestra.run.smithi152.stdout:(164/174): libfdisk-2.37.4-18.el9.x86_64.rpm 145 kB/s | 155 kB 00:01 2024-03-18T14:58:32.910 INFO:teuthology.orchestra.run.smithi186.stdout:(33/174): ceph-mgr-rook-19.0.0-2162.g3d78f5ba.e 1.4 MB/s | 49 kB 00:00 2024-03-18T14:58:32.944 INFO:teuthology.orchestra.run.smithi186.stdout:(34/174): ceph-prometheus-alerts-19.0.0-2162.g3 497 kB/s | 16 kB 00:00 2024-03-18T14:58:32.975 INFO:teuthology.orchestra.run.smithi152.stdout:(165/174): libmount-2.37.4-18.el9.x86_64.rpm 128 kB/s | 136 kB 00:01 2024-03-18T14:58:32.994 INFO:teuthology.orchestra.run.smithi186.stdout:(35/174): ceph-volume-19.0.0-2162.g3d78f5ba.el9 5.1 MB/s | 264 kB 00:00 2024-03-18T14:58:33.061 INFO:teuthology.orchestra.run.smithi186.stdout:(36/174): cephadm-19.0.0-2162.g3d78f5ba.el9.noa 11 MB/s | 748 kB 00:00 2024-03-18T14:58:33.095 INFO:teuthology.orchestra.run.smithi186.stdout:(37/174): cephfs-top-19.0.0-2162.g3d78f5ba.el9. 549 kB/s | 18 kB 00:00 2024-03-18T14:58:33.246 INFO:teuthology.orchestra.run.smithi186.stdout:(38/174): rbd-mirror-19.0.0-2162.g3d78f5ba.el9. 2.7 MB/s | 3.1 MB 00:01 2024-03-18T14:58:33.478 INFO:teuthology.orchestra.run.smithi186.stdout:(39/174): automake-1.16.2-8.el9.noarch.rpm 1.7 MB/s | 662 kB 00:00 2024-03-18T14:58:33.500 INFO:teuthology.orchestra.run.smithi152.stdout:(166/174): libsmartcols-2.37.4-18.el9.x86_64.rp 72 kB/s | 64 kB 00:00 2024-03-18T14:58:33.512 INFO:teuthology.orchestra.run.smithi186.stdout:(40/174): bison-3.7.4-5.el9.x86_64.rpm 3.4 MB/s | 920 kB 00:00 2024-03-18T14:58:33.562 INFO:teuthology.orchestra.run.smithi186.stdout:(41/174): boost-program-options-1.75.0-8.el9.x8 2.1 MB/s | 106 kB 00:00 2024-03-18T14:58:33.587 INFO:teuthology.orchestra.run.smithi186.stdout:(42/174): flex-2.6.4-9.el9.x86_64.rpm 4.0 MB/s | 307 kB 00:00 2024-03-18T14:58:33.621 INFO:teuthology.orchestra.run.smithi186.stdout:(43/174): flexiblas-3.0.4-8.el9.x86_64.rpm 545 kB/s | 32 kB 00:00 2024-03-18T14:58:33.676 INFO:teuthology.orchestra.run.smithi152.stdout:(167/174): libuuid-2.37.4-18.el9.x86_64.rpm 37 kB/s | 29 kB 00:00 2024-03-18T14:58:33.888 INFO:teuthology.orchestra.run.smithi186.stdout:(44/174): ceph-common-19.0.0-2162.g3d78f5ba.el9 3.0 MB/s | 21 MB 00:06 2024-03-18T14:58:33.939 INFO:teuthology.orchestra.run.smithi186.stdout:(45/174): flexiblas-netlib-3.0.4-8.el9.x86_64.r 8.5 MB/s | 3.0 MB 00:00 2024-03-18T14:58:33.964 INFO:teuthology.orchestra.run.smithi186.stdout:(46/174): flexiblas-openblas-openmp-3.0.4-8.el9 50 kB/s | 17 kB 00:00 2024-03-18T14:58:33.989 INFO:teuthology.orchestra.run.smithi186.stdout:(47/174): libaio-devel-0.3.111-13.el9.x86_64.rp 103 kB/s | 10 kB 00:00 2024-03-18T14:58:34.041 INFO:teuthology.orchestra.run.smithi186.stdout:(48/174): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 159 kB 00:00 2024-03-18T14:58:34.065 INFO:teuthology.orchestra.run.smithi186.stdout:(49/174): librabbitmq-0.11.0-7.el9.x86_64.rpm 441 kB/s | 44 kB 00:00 2024-03-18T14:58:34.090 INFO:teuthology.orchestra.run.smithi186.stdout:(50/174): librdkafka-1.6.1-102.el9.x86_64.rpm 6.4 MB/s | 661 kB 00:00 2024-03-18T14:58:34.115 INFO:teuthology.orchestra.run.smithi186.stdout:(51/174): libtool-2.4.6-45.el9.x86_64.rpm 7.6 MB/s | 578 kB 00:00 2024-03-18T14:58:34.149 INFO:teuthology.orchestra.run.smithi186.stdout:(52/174): libzstd-devel-1.5.1-2.el9.x86_64.rpm 809 kB/s | 46 kB 00:00 2024-03-18T14:58:34.174 INFO:teuthology.orchestra.run.smithi186.stdout:(53/174): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.3 MB/s | 282 kB 00:00 2024-03-18T14:58:34.199 INFO:teuthology.orchestra.run.smithi186.stdout:(54/174): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 187 kB 00:00 2024-03-18T14:58:34.233 INFO:teuthology.orchestra.run.smithi186.stdout:(55/174): oniguruma-6.9.6-1.el9.5.x86_64.rpm 2.6 MB/s | 217 kB 00:00 2024-03-18T14:58:34.258 INFO:teuthology.orchestra.run.smithi186.stdout:(56/174): openblas-0.3.21-2.el9.x86_64.rpm 588 kB/s | 34 kB 00:00 2024-03-18T14:58:34.433 INFO:teuthology.orchestra.run.smithi186.stdout:(57/174): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-03-18T14:58:34.475 INFO:teuthology.orchestra.run.smithi186.stdout:(58/174): postgresql-13.11-1.el9.x86_64.rpm 6.3 MB/s | 1.5 MB 00:00 2024-03-18T14:58:34.509 INFO:teuthology.orchestra.run.smithi186.stdout:(59/174): postgresql-contrib-13.11-1.el9.x86_64 3.2 MB/s | 811 kB 00:00 2024-03-18T14:58:34.534 INFO:teuthology.orchestra.run.smithi186.stdout:(60/174): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2024-03-18T14:58:34.617 INFO:teuthology.orchestra.run.smithi186.stdout:(61/174): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-03-18T14:58:34.743 INFO:teuthology.orchestra.run.smithi186.stdout:(62/174): postgresql-server-13.11-1.el9.x86_64. 24 MB/s | 5.7 MB 00:00 2024-03-18T14:58:34.768 INFO:teuthology.orchestra.run.smithi186.stdout:(63/174): python3-attrs-20.3.0-7.el9.noarch.rpm 334 kB/s | 78 kB 00:00 2024-03-18T14:58:34.860 INFO:teuthology.orchestra.run.smithi186.stdout:(64/174): python3-babel-2.9.1-2.el9.noarch.rpm 24 MB/s | 5.8 MB 00:00 2024-03-18T14:58:34.885 INFO:teuthology.orchestra.run.smithi186.stdout:(65/174): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2024-03-18T14:58:34.911 INFO:teuthology.orchestra.run.smithi186.stdout:(66/174): python3-jsonpointer-2.0-4.el9.noarch. 130 kB/s | 18 kB 00:00 2024-03-18T14:58:34.936 INFO:teuthology.orchestra.run.smithi186.stdout:(67/174): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2024-03-18T14:58:34.961 INFO:teuthology.orchestra.run.smithi186.stdout:(68/174): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2024-03-18T14:58:35.078 INFO:teuthology.orchestra.run.smithi186.stdout:(69/174): python3-numpy-1.20.1-5.el9.x86_64.rpm 29 MB/s | 4.8 MB 00:00 2024-03-18T14:58:35.103 INFO:teuthology.orchestra.run.smithi186.stdout:(70/174): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.3 MB/s | 217 kB 00:00 2024-03-18T14:58:35.120 INFO:teuthology.orchestra.run.smithi186.stdout:(71/174): python3-oauthlib-3.1.1-5.el9.noarch.r 1.1 MB/s | 174 kB 00:00 2024-03-18T14:58:35.137 INFO:teuthology.orchestra.run.smithi186.stdout:(72/174): python3-packaging-20.9-5.el9.noarch.r 1.2 MB/s | 69 kB 00:00 2024-03-18T14:58:35.154 INFO:teuthology.orchestra.run.smithi186.stdout:(73/174): python3-prettytable-0.7.2-27.el9.noar 1.2 MB/s | 41 kB 00:00 2024-03-18T14:58:35.179 INFO:teuthology.orchestra.run.smithi186.stdout:(74/174): python3-protobuf-3.14.0-13.el9.noarch 4.0 MB/s | 238 kB 00:00 2024-03-18T14:58:35.204 INFO:teuthology.orchestra.run.smithi186.stdout:(75/174): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 132 kB 00:00 2024-03-18T14:58:35.230 INFO:teuthology.orchestra.run.smithi186.stdout:(76/174): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2024-03-18T14:58:35.265 INFO:teuthology.orchestra.run.smithi186.stdout:(77/174): python3-pytz-2021.1-5.el9.noarch.rpm 815 kB/s | 47 kB 00:00 2024-03-18T14:58:35.288 INFO:teuthology.orchestra.run.smithi186.stdout:(78/174): python3-requests-oauthlib-1.3.0-12.el 515 kB/s | 43 kB 00:00 2024-03-18T14:58:35.664 INFO:teuthology.orchestra.run.smithi186.stdout:(79/174): python3-scipy-1.6.2-8.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-03-18T14:58:35.689 INFO:teuthology.orchestra.run.smithi186.stdout:(80/174): python3-toml-0.10.2-6.el9.noarch.rpm 97 kB/s | 39 kB 00:00 2024-03-18T14:58:35.714 INFO:teuthology.orchestra.run.smithi186.stdout:(81/174): python3-wcwidth-0.2.5-8.el9.noarch.rp 97 kB/s | 41 kB 00:00 2024-03-18T14:58:35.740 INFO:teuthology.orchestra.run.smithi186.stdout:(82/174): socat-1.7.4.1-5.el9.x86_64.rpm 3.9 MB/s | 300 kB 00:00 2024-03-18T14:58:35.765 INFO:teuthology.orchestra.run.smithi186.stdout:(83/174): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 56 kB 00:00 2024-03-18T14:58:35.790 INFO:teuthology.orchestra.run.smithi186.stdout:(84/174): xmlstarlet-1.6.1-20.el9.x86_64.rpm 841 kB/s | 63 kB 00:00 2024-03-18T14:58:35.815 INFO:teuthology.orchestra.run.smithi186.stdout:(85/174): zlib-devel-1.2.11-40.el9.x86_64.rpm 587 kB/s | 44 kB 00:00 2024-03-18T14:58:35.840 INFO:teuthology.orchestra.run.smithi186.stdout:(86/174): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2024-03-18T14:58:35.866 INFO:teuthology.orchestra.run.smithi186.stdout:(87/174): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2024-03-18T14:58:35.899 INFO:teuthology.orchestra.run.smithi186.stdout:(88/174): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2024-03-18T14:58:35.924 INFO:teuthology.orchestra.run.smithi186.stdout:(89/174): python3-ply-3.11-14.el9.noarch.rpm 1.2 MB/s | 103 kB 00:00 2024-03-18T14:58:35.941 INFO:teuthology.orchestra.run.smithi186.stdout:(90/174): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 124 kB 00:00 2024-03-18T14:58:35.967 INFO:teuthology.orchestra.run.smithi186.stdout:(91/174): python3-urllib3-1.26.5-5.el9.noarch.r 2.7 MB/s | 187 kB 00:00 2024-03-18T14:58:36.125 INFO:teuthology.orchestra.run.smithi186.stdout:(92/174): jq-1.6-16.el9.x86_64.rpm 1.0 MB/s | 187 kB 00:00 2024-03-18T14:58:36.150 INFO:teuthology.orchestra.run.smithi186.stdout:(93/174): libquadmath-11.4.1-3.el9.x86_64.rpm 1.0 MB/s | 195 kB 00:00 2024-03-18T14:58:36.176 INFO:teuthology.orchestra.run.smithi186.stdout:(94/174): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-03-18T14:58:36.218 INFO:teuthology.orchestra.run.smithi186.stdout:(95/174): elfutils-libelf-devel-0.190-2.el9.x86 321 kB/s | 21 kB 00:00 2024-03-18T14:58:36.243 INFO:teuthology.orchestra.run.smithi186.stdout:(96/174): libuuid-devel-2.37.4-18.el9.x86_64.rp 379 kB/s | 25 kB 00:00 2024-03-18T14:58:36.268 INFO:teuthology.orchestra.run.smithi186.stdout:(97/174): libgfortran-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 803 kB 00:00 2024-03-18T14:58:36.352 INFO:teuthology.orchestra.run.smithi186.stdout:(98/174): python3-jinja2-2.11.3-5.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-03-18T14:58:36.377 INFO:teuthology.orchestra.run.smithi186.stdout:(99/174): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2024-03-18T14:58:36.468 INFO:teuthology.orchestra.run.smithi152.stdout:(168/174): openssl-3.0.7-27.el9.x86_64.rpm 355 kB/s | 1.2 MB 00:03 2024-03-18T14:58:36.477 INFO:teuthology.orchestra.run.smithi186.stdout:(100/174): openssl-devel-3.0.7-27.el9.x86_64.rp 16 MB/s | 4.1 MB 00:00 2024-03-18T14:58:36.502 INFO:teuthology.orchestra.run.smithi186.stdout:(101/174): qatlib-service-23.11.0-1.el9.x86_64. 279 kB/s | 35 kB 00:00 2024-03-18T14:58:36.528 INFO:teuthology.orchestra.run.smithi186.stdout:(102/174): qatlib-23.11.0-1.el9.x86_64.rpm 1.2 MB/s | 216 kB 00:00 2024-03-18T14:58:36.570 INFO:teuthology.orchestra.run.smithi186.stdout:(103/174): qatzip-libs-1.1.2-2.el9.x86_64.rpm 484 kB/s | 44 kB 00:00 2024-03-18T14:58:36.595 INFO:teuthology.orchestra.run.smithi186.stdout:(104/174): xfsprogs-devel-6.3.0-1.el9.x86_64.rp 1.0 MB/s | 94 kB 00:00 2024-03-18T14:58:36.662 INFO:teuthology.orchestra.run.smithi186.stdout:(105/174): lua-devel-5.4.4-4.el9.x86_64.rpm 167 kB/s | 22 kB 00:00 2024-03-18T14:58:36.812 INFO:teuthology.orchestra.run.smithi186.stdout:(106/174): protobuf-compiler-3.14.0-13.el9.x86_ 3.5 MB/s | 863 kB 00:00 2024-03-18T14:58:37.013 INFO:teuthology.orchestra.run.smithi186.stdout:(107/174): grpc-data-1.46.7-10.el9.noarch.rpm 97 kB/s | 19 kB 00:00 2024-03-18T14:58:37.038 INFO:teuthology.orchestra.run.smithi186.stdout:(108/174): abseil-cpp-20211102.0-3.el9.x86_64.r 1.2 MB/s | 548 kB 00:00 2024-03-18T14:58:37.080 INFO:teuthology.orchestra.run.smithi186.stdout:(109/174): gperftools-libs-2.9.1-2.el9.x86_64.r 739 kB/s | 309 kB 00:00 2024-03-18T14:58:37.122 INFO:teuthology.orchestra.run.smithi186.stdout:(110/174): libarrow-doc-9.0.0-10.el9.noarch.rpm 310 kB/s | 26 kB 00:00 2024-03-18T14:58:37.164 INFO:teuthology.orchestra.run.smithi186.stdout:(111/174): liboath-2.6.7-2.el9.x86_64.rpm 580 kB/s | 49 kB 00:00 2024-03-18T14:58:37.189 INFO:teuthology.orchestra.run.smithi186.stdout:(112/174): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-03-18T14:58:37.256 INFO:teuthology.orchestra.run.smithi186.stdout:(113/174): luarocks-3.9.2-1.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-03-18T14:58:37.323 INFO:teuthology.orchestra.run.smithi186.stdout:(114/174): parquet-libs-9.0.0-10.el9.x86_64.rpm 6.1 MB/s | 838 kB 00:00 2024-03-18T14:58:37.393 INFO:teuthology.orchestra.run.smithi152.stdout:(169/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 567 kB/s | 2.2 MB 00:03 2024-03-18T14:58:37.398 INFO:teuthology.orchestra.run.smithi186.stdout:(115/174): python3-asyncssh-2.13.2-4.el9.noarch 3.8 MB/s | 548 kB 00:00 2024-03-18T14:58:37.415 INFO:teuthology.orchestra.run.smithi186.stdout:(116/174): python3-bcrypt-3.2.2-1.el9.x86_64.rp 474 kB/s | 43 kB 00:00 2024-03-18T14:58:37.474 INFO:teuthology.orchestra.run.smithi186.stdout:(117/174): python3-cachetools-4.2.4-1.el9.noarc 428 kB/s | 32 kB 00:00 2024-03-18T14:58:37.491 INFO:teuthology.orchestra.run.smithi186.stdout:(118/174): python3-certifi-2021.10.8-2.el9.noar 199 kB/s | 15 kB 00:00 2024-03-18T14:58:37.558 INFO:teuthology.orchestra.run.smithi186.stdout:(119/174): libarrow-9.0.0-10.el9.x86_64.rpm 8.1 MB/s | 4.4 MB 00:00 2024-03-18T14:58:37.583 INFO:teuthology.orchestra.run.smithi186.stdout:(120/174): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2024-03-18T14:58:37.608 INFO:teuthology.orchestra.run.smithi186.stdout:(121/174): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2024-03-18T14:58:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:(170/174): util-linux-2.37.4-18.el9.x86_64.rpm 588 kB/s | 2.3 MB 00:03 2024-03-18T14:58:37.675 INFO:teuthology.orchestra.run.smithi186.stdout:(122/174): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.5 MB/s | 303 kB 00:00 2024-03-18T14:58:37.701 INFO:teuthology.orchestra.run.smithi186.stdout:(123/174): python3-colorama-0.4.4-12.el9.noarch 301 kB/s | 35 kB 00:00 2024-03-18T14:58:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:(171/174): util-linux-core-2.37.4-18.el9.x86_64 377 kB/s | 465 kB 00:01 2024-03-18T14:58:37.726 INFO:teuthology.orchestra.run.smithi186.stdout:(124/174): python3-google-auth-2.28.0-1.el9.noa 1.7 MB/s | 203 kB 00:00 2024-03-18T14:58:37.784 INFO:teuthology.orchestra.run.smithi186.stdout:(125/174): python3-grpcio-tools-1.46.7-10.el9.x 1.7 MB/s | 144 kB 00:00 2024-03-18T14:58:37.793 INFO:teuthology.orchestra.run.smithi152.stdout:(172/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 811 kB/s | 74 kB 00:00 2024-03-18T14:58:37.810 INFO:teuthology.orchestra.run.smithi186.stdout:(126/174): python3-jaraco-8.2.1-3.el9.noarch.rp 128 kB/s | 11 kB 00:00 2024-03-18T14:58:37.860 INFO:teuthology.orchestra.run.smithi186.stdout:(127/174): python3-grpcio-1.46.7-10.el9.x86_64. 11 MB/s | 2.0 MB 00:00 2024-03-18T14:58:37.885 INFO:teuthology.orchestra.run.smithi186.stdout:(128/174): python3-jaraco-classes-3.2.1-5.el9.n 175 kB/s | 18 kB 00:00 2024-03-18T14:58:37.910 INFO:teuthology.orchestra.run.smithi186.stdout:(129/174): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2024-03-18T14:58:37.936 INFO:teuthology.orchestra.run.smithi186.stdout:(130/174): python3-jaraco-functools-3.5.0-2.el9 258 kB/s | 19 kB 00:00 2024-03-18T14:58:38.011 INFO:teuthology.orchestra.run.smithi186.stdout:(131/174): python3-logutils-0.3.5-21.el9.noarch 617 kB/s | 46 kB 00:00 2024-03-18T14:58:38.035 INFO:teuthology.orchestra.run.smithi152.stdout:(173/174): util-linux-user-2.37.4-18.el9.x86_64 48 kB/s | 31 kB 00:00 2024-03-18T14:58:38.036 INFO:teuthology.orchestra.run.smithi186.stdout:(132/174): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2024-03-18T14:58:38.070 INFO:teuthology.orchestra.run.smithi186.stdout:(133/174): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2024-03-18T14:58:38.095 INFO:teuthology.orchestra.run.smithi186.stdout:(134/174): python3-more-itertools-8.12.0-2.el9. 942 kB/s | 79 kB 00:00 2024-03-18T14:58:38.121 INFO:teuthology.orchestra.run.smithi186.stdout:(135/174): python3-natsort-7.1.1-5.el9.noarch.r 688 kB/s | 58 kB 00:00 2024-03-18T14:58:38.146 INFO:teuthology.orchestra.run.smithi186.stdout:(136/174): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-03-18T14:58:38.163 INFO:teuthology.orchestra.run.smithi186.stdout:(137/174): python3-portend-3.1.0-2.el9.noarch.r 244 kB/s | 16 kB 00:00 2024-03-18T14:58:38.196 INFO:teuthology.orchestra.run.smithi186.stdout:(138/174): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.2 MB/s | 90 kB 00:00 2024-03-18T14:58:38.222 INFO:teuthology.orchestra.run.smithi186.stdout:(139/174): python3-pyperclip-1.8.2-2.el9.noarch 372 kB/s | 28 kB 00:00 2024-03-18T14:58:38.238 INFO:teuthology.orchestra.run.smithi186.stdout:(140/174): python3-repoze-lru-0.7-16.el9.noarch 406 kB/s | 31 kB 00:00 2024-03-18T14:58:38.272 INFO:teuthology.orchestra.run.smithi186.stdout:(141/174): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-03-18T14:58:38.289 INFO:teuthology.orchestra.run.smithi186.stdout:(142/174): python3-rsa-4.9-2.el9.noarch.rpm 882 kB/s | 59 kB 00:00 2024-03-18T14:58:38.306 INFO:teuthology.orchestra.run.smithi186.stdout:(143/174): python3-tempora-5.0.0-2.el9.noarch.r 532 kB/s | 36 kB 00:00 2024-03-18T14:58:38.348 INFO:teuthology.orchestra.run.smithi186.stdout:(144/174): python3-typing-extensions-4.4.0-2.el 675 kB/s | 51 kB 00:00 2024-03-18T14:58:38.373 INFO:teuthology.orchestra.run.smithi186.stdout:(145/174): python3-webob-1.8.7-6.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-03-18T14:58:38.407 INFO:teuthology.orchestra.run.smithi186.stdout:(146/174): python3-websocket-client-1.2.3-2.el9 892 kB/s | 90 kB 00:00 2024-03-18T14:58:38.433 INFO:teuthology.orchestra.run.smithi186.stdout:(147/174): python3-werkzeug-2.0.3-3.el9.1.noarc 5.0 MB/s | 427 kB 00:00 2024-03-18T14:58:38.457 INFO:teuthology.orchestra.run.smithi186.stdout:(148/174): python3-zc-lockfile-2.0-10.el9.noarc 238 kB/s | 20 kB 00:00 2024-03-18T14:58:38.491 INFO:teuthology.orchestra.run.smithi186.stdout:(149/174): re2-20211101-3.el9.x86_64.rpm 2.2 MB/s | 192 kB 00:00 2024-03-18T14:58:38.591 INFO:teuthology.orchestra.run.smithi186.stdout:(150/174): thrift-0.15.0-2.el9.x86_64.rpm 10 MB/s | 1.6 MB 00:00 2024-03-18T14:58:38.642 INFO:teuthology.orchestra.run.smithi186.stdout:(151/174): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2024-03-18T14:58:38.775 INFO:teuthology.orchestra.run.smithi186.stdout:(152/174): librados2-19.0.0-2162.g3d78f5ba.el9. 11 MB/s | 3.4 MB 00:00 2024-03-18T14:58:38.909 INFO:teuthology.orchestra.run.smithi186.stdout:(153/174): NetworkManager-1.46.0-1.el9.x86_64.r 8.6 MB/s | 2.3 MB 00:00 2024-03-18T14:58:38.959 INFO:teuthology.orchestra.run.smithi186.stdout:(154/174): NetworkManager-team-1.46.0-1.el9.x86 849 kB/s | 42 kB 00:00 2024-03-18T14:58:39.018 INFO:teuthology.orchestra.run.smithi186.stdout:(155/174): NetworkManager-tui-1.46.0-1.el9.x86_ 4.2 MB/s | 248 kB 00:00 2024-03-18T14:58:39.068 INFO:teuthology.orchestra.run.smithi186.stdout:(156/174): acl-2.3.1-4.el9.x86_64.rpm 1.4 MB/s | 71 kB 00:00 2024-03-18T14:58:39.118 INFO:teuthology.orchestra.run.smithi186.stdout:(157/174): elfutils-debuginfod-client-0.190-2.e 732 kB/s | 36 kB 00:00 2024-03-18T14:58:39.202 INFO:teuthology.orchestra.run.smithi186.stdout:(158/174): elfutils-libelf-0.190-2.el9.x86_64.r 2.3 MB/s | 192 kB 00:00 2024-03-18T14:58:39.252 INFO:teuthology.orchestra.run.smithi186.stdout:(159/174): elfutils-libs-0.190-2.el9.x86_64.rpm 5.0 MB/s | 256 kB 00:00 2024-03-18T14:58:39.302 INFO:teuthology.orchestra.run.smithi186.stdout:(160/174): libacl-2.3.1-4.el9.x86_64.rpm 462 kB/s | 23 kB 00:00 2024-03-18T14:58:39.353 INFO:teuthology.orchestra.run.smithi186.stdout:(161/174): libblkid-2.37.4-18.el9.x86_64.rpm 2.1 MB/s | 108 kB 00:00 2024-03-18T14:58:39.403 INFO:teuthology.orchestra.run.smithi186.stdout:(162/174): libfdisk-2.37.4-18.el9.x86_64.rpm 3.0 MB/s | 155 kB 00:00 2024-03-18T14:58:39.453 INFO:teuthology.orchestra.run.smithi186.stdout:(163/174): libmount-2.37.4-18.el9.x86_64.rpm 2.6 MB/s | 136 kB 00:00 2024-03-18T14:58:39.503 INFO:teuthology.orchestra.run.smithi186.stdout:(164/174): libsmartcols-2.37.4-18.el9.x86_64.rp 1.2 MB/s | 64 kB 00:00 2024-03-18T14:58:39.554 INFO:teuthology.orchestra.run.smithi186.stdout:(165/174): NetworkManager-libnm-1.46.0-1.el9.x8 2.3 MB/s | 1.8 MB 00:00 2024-03-18T14:58:39.579 INFO:teuthology.orchestra.run.smithi186.stdout:(166/174): libuuid-2.37.4-18.el9.x86_64.rpm 382 kB/s | 29 kB 00:00 2024-03-18T14:58:39.679 INFO:teuthology.orchestra.run.smithi186.stdout:(167/174): librbd1-19.0.0-2162.g3d78f5ba.el9.x8 2.6 MB/s | 3.1 MB 00:01 2024-03-18T14:58:39.730 INFO:teuthology.orchestra.run.smithi186.stdout:(168/174): openssl-libs-3.0.7-27.el9.x86_64.rpm 14 MB/s | 2.2 MB 00:00 2024-03-18T14:58:39.760 INFO:teuthology.orchestra.run.smithi152.stdout:(174/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 528 kB/s | 1.1 MB 00:02 2024-03-18T14:58:39.764 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:58:39.764 INFO:teuthology.orchestra.run.smithi152.stdout:Total 8.5 MB/s | 224 MB 00:26 2024-03-18T14:58:39.789 INFO:teuthology.orchestra.run.smithi186.stdout:(169/174): util-linux-core-2.37.4-18.el9.x86_64 7.8 MB/s | 465 kB 00:00 2024-03-18T14:58:39.856 INFO:teuthology.orchestra.run.smithi186.stdout:(170/174): openssl-3.0.7-27.el9.x86_64.rpm 4.0 MB/s | 1.2 MB 00:00 2024-03-18T14:58:39.881 INFO:teuthology.orchestra.run.smithi186.stdout:(171/174): util-linux-user-2.37.4-18.el9.x86_64 339 kB/s | 31 kB 00:00 2024-03-18T14:58:39.947 INFO:teuthology.orchestra.run.smithi186.stdout:(172/174): xfsprogs-6.3.0-1.el9.x86_64.rpm 16 MB/s | 1.1 MB 00:00 2024-03-18T14:58:39.972 INFO:teuthology.orchestra.run.smithi186.stdout:(173/174): libacl-devel-2.3.1-4.el9.x86_64.rpm 814 kB/s | 74 kB 00:00 2024-03-18T14:58:40.225 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-03-18T14:58:40.290 INFO:teuthology.orchestra.run.smithi186.stdout:(174/174): util-linux-2.37.4-18.el9.x86_64.rpm 3.7 MB/s | 2.3 MB 00:00 2024-03-18T14:58:40.294 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-03-18T14:58:40.294 INFO:teuthology.orchestra.run.smithi186.stdout:Total 16 MB/s | 224 MB 00:14 2024-03-18T14:58:40.541 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-03-18T14:58:40.541 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-03-18T14:58:40.754 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-03-18T14:58:41.065 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-03-18T14:58:41.065 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-03-18T14:58:42.601 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-03-18T14:58:42.601 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-03-18T14:58:43.088 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-03-18T14:58:43.088 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-03-18T14:58:49.885 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-03-18T14:58:49.981 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-18T14:58:50.007 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-18T14:58:50.054 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T14:58:50.064 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T14:58:50.109 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-18T14:58:50.167 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-18T14:58:50.174 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-03-18T14:58:50.200 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-18T14:58:50.225 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-18T14:58:50.270 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-libs-1:3.0.7-27.el9.x86_64 1/198 2024-03-18T14:58:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-18T14:58:50.304 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libuuid-2.37.4-18.el9.x86_64 2/198 2024-03-18T14:58:50.340 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T14:58:50.350 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libblkid-2.37.4-18.el9.x86_64 3/198 2024-03-18T14:58:50.390 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 4/198 2024-03-18T14:58:50.451 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 5/198 2024-03-18T14:58:50.513 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/198 2024-03-18T14:58:50.545 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 7/198 2024-03-18T14:58:50.601 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 8/198 2024-03-18T14:58:50.604 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-18T14:58:50.666 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:58:50.771 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:58:50.800 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:58:50.880 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:58:50.916 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T14:58:50.923 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 9/198 2024-03-18T14:58:50.964 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-18T14:58:50.979 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:58:51.100 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:58:51.138 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:58:51.152 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-18T14:58:51.211 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-18T14:58:51.233 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:58:51.239 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:58:51.267 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T14:58:51.319 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 13/198 2024-03-18T14:58:51.333 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:58:51.357 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T14:58:51.405 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T14:58:51.452 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-18T14:58:51.475 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T14:58:51.491 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T14:58:51.516 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libelf-0.190-2.el9.x86_64 14/198 2024-03-18T14:58:51.557 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-13.11-1.el9.x86_64 15/198 2024-03-18T14:58:51.585 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:58:51.684 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T14:58:51.689 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:58:51.711 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T14:58:51.715 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T14:58:51.755 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-18T14:58:51.777 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 17/198 2024-03-18T14:58:51.816 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libmount-2.37.4-18.el9.x86_64 18/198 2024-03-18T14:58:51.829 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T14:58:51.845 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-service-23.11.0-1.el9.x86_64 19/198 2024-03-18T14:58:51.932 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-18T14:58:52.023 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T14:58:52.055 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatlib-23.11.0-1.el9.x86_64 20/198 2024-03-18T14:58:52.060 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T14:58:52.095 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libsmartcols-2.37.4-18.el9.x86_64 21/198 2024-03-18T14:58:52.112 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T14:58:52.212 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.263 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.293 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 22/198 2024-03-18T14:58:52.438 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T14:58:52.485 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.498 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 23/198 2024-03-18T14:58:52.593 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-18T14:58:52.598 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.650 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.688 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-18T14:58:52.718 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-18T14:58:52.745 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-18T14:58:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-18T14:58:52.859 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.46.0-1.el9.x86_64 24/198 2024-03-18T14:58:52.862 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-18T14:58:52.935 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-18T14:58:52.971 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-18T14:58:52.980 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : re2-1:20211101-3.el9.x86_64 25/198 2024-03-18T14:58:53.035 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-18T14:58:53.070 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-18T14:58:53.075 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 26/198 2024-03-18T14:58:53.113 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 27/198 2024-03-18T14:58:53.114 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-18T14:58:53.140 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.7-2.el9.x86_64 28/198 2024-03-18T14:58:53.146 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-18T14:58:53.174 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-18T14:58:53.175 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 29/198 2024-03-18T14:58:53.242 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 30/198 2024-03-18T14:58:53.252 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-18T14:58:53.287 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-18T14:58:53.294 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-urllib3-1.26.5-5.el9.noarch 31/198 2024-03-18T14:58:53.333 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 32/198 2024-03-18T14:58:53.334 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-18T14:58:53.384 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-18T14:58:53.397 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 33/198 2024-03-18T14:58:53.433 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 34/198 2024-03-18T14:58:53.452 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-18T14:58:53.476 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 35/198 2024-03-18T14:58:53.499 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-18T14:58:53.509 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 36/198 2024-03-18T14:58:53.536 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-5.4.4-4.el9.x86_64 37/198 2024-03-18T14:58:53.572 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-18T14:58:53.606 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 38/198 2024-03-18T14:58:53.642 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 39/198 2024-03-18T14:58:53.683 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 40/198 2024-03-18T14:58:53.714 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 41/198 2024-03-18T14:58:53.714 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-18T14:58:53.776 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-18T14:58:53.782 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 42/198 2024-03-18T14:58:53.828 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : luarocks-3.9.2-1.el9.noarch 43/198 2024-03-18T14:58:53.903 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 44/198 2024-03-18T14:58:54.047 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 45/198 2024-03-18T14:58:54.097 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 46/198 2024-03-18T14:58:54.298 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-18T14:58:54.371 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-18T14:58:54.466 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-18T14:58:54.507 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T14:58:54.515 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T14:58:54.549 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-18T14:58:54.596 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-18T14:58:54.616 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rsa-4.9-2.el9.noarch 47/198 2024-03-18T14:58:54.634 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-18T14:58:54.664 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-18T14:58:54.694 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 48/198 2024-03-18T14:58:54.777 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jinja2-2.11.3-5.el9.noarch 49/198 2024-03-18T14:58:54.831 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T14:58:54.839 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: util-linux-core-2.37.4-18.el9.x86_64 50/198 2024-03-18T14:58:54.876 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : qatzip-libs-1.1.2-2.el9.x86_64 51/198 2024-03-18T14:58:54.920 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-libs-0.190-2.el9.x86_64 52/198 2024-03-18T14:58:54.948 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-18T14:58:54.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 53/198 2024-03-18T14:58:54.989 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 54/198 2024-03-18T14:58:55.137 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-18T14:58:55.232 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-18T14:58:55.258 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libfdisk-2.37.4-18.el9.x86_64 55/198 2024-03-18T14:58:55.308 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-18T14:58:55.455 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-18T14:58:55.504 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-18T14:58:55.558 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-18T14:58:55.631 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-18T14:58:55.662 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-18T14:58:55.699 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-18T14:58:55.709 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-2.37.4-18.el9.x86_64 56/198 2024-03-18T14:58:55.745 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-18T14:58:55.782 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-18T14:58:55.809 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsprogs-6.3.0-1.el9.x86_64 57/198 2024-03-18T14:58:55.825 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-18T14:58:55.853 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 58/198 2024-03-18T14:58:55.875 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-18T14:58:56.005 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 59/198 2024-03-18T14:58:56.009 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-18T14:58:56.047 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : openssl-1:3.0.7-27.el9.x86_64 60/198 2024-03-18T14:58:56.055 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-18T14:58:56.085 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-18T14:58:56.102 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 61/198 2024-03-18T14:58:56.126 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-18T14:58:56.175 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 62/198 2024-03-18T14:58:56.205 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 63/198 2024-03-18T14:58:56.221 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-18T14:58:56.242 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 64/198 2024-03-18T14:58:56.260 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-18T14:58:56.289 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 65/198 2024-03-18T14:58:56.301 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-18T14:58:56.324 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 66/198 2024-03-18T14:58:56.326 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-18T14:58:56.350 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-18T14:58:56.368 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 67/198 2024-03-18T14:58:56.410 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 68/198 2024-03-18T14:58:56.423 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-18T14:58:56.543 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 69/198 2024-03-18T14:58:56.559 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-18T14:58:56.599 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 70/198 2024-03-18T14:58:56.629 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 71/198 2024-03-18T14:58:56.667 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-18T14:58:56.670 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 72/198 2024-03-18T14:58:56.708 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-18T14:58:56.757 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-18T14:58:56.765 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 73/198 2024-03-18T14:58:56.804 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-google-auth-1:2.28.0-1.el9.noarch 74/198 2024-03-18T14:58:56.821 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-18T14:58:56.845 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 75/198 2024-03-18T14:58:56.870 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 76/198 2024-03-18T14:58:56.894 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 77/198 2024-03-18T14:58:56.988 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 78/198 2024-03-18T14:58:57.005 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-18T14:58:57.053 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-18T14:58:57.114 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 79/198 2024-03-18T14:58:57.182 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-18T14:58:57.218 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 80/198 2024-03-18T14:58:57.219 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-18T14:58:57.250 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-18T14:58:57.261 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 81/198 2024-03-18T14:58:57.281 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-18T14:58:57.309 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-18T14:58:57.310 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ply-3.11-14.el9.noarch 82/198 2024-03-18T14:58:57.343 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-18T14:58:57.366 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 83/198 2024-03-18T14:58:57.382 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-18T14:58:57.414 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-18T14:58:57.443 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-18T14:58:57.522 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-18T14:58:57.548 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 84/198 2024-03-18T14:58:57.554 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-18T14:58:57.587 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-18T14:58:57.599 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 85/198 2024-03-18T14:58:57.628 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-18T14:58:57.663 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-18T14:58:57.738 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 86/198 2024-03-18T14:58:57.752 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-18T14:58:57.773 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-asyncssh-2.13.2-4.el9.noarch 87/198 2024-03-18T14:58:57.804 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 88/198 2024-03-18T14:58:57.835 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.9-15.el9.x86_64 89/198 2024-03-18T14:58:57.842 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-18T14:58:57.863 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 90/198 2024-03-18T14:58:57.894 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-18T14:58:57.897 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 91/198 2024-03-18T14:58:57.925 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-18T14:58:57.936 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : uuid-1.6.2-55.el9.x86_64 92/198 2024-03-18T14:58:57.972 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-18T14:58:57.972 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 93/198 2024-03-18T14:58:57.998 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 94/198 2024-03-18T14:58:58.069 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-18T14:58:58.091 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 95/198 2024-03-18T14:58:58.118 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-18T14:58:58.125 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 96/198 2024-03-18T14:58:58.159 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 97/198 2024-03-18T14:58:58.200 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 98/198 2024-03-18T14:58:58.235 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 99/198 2024-03-18T14:58:58.323 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 100/198 2024-03-18T14:58:58.408 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 101/198 2024-03-18T14:58:58.449 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 102/198 2024-03-18T14:58:58.480 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 103/198 2024-03-18T14:58:58.519 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 104/198 2024-03-18T14:58:58.615 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-packaging-20.9-5.el9.noarch 105/198 2024-03-18T14:58:58.665 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 106/198 2024-03-18T14:58:58.847 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-18T14:58:58.890 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-18T14:58:58.924 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-18T14:58:58.972 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-18T14:58:59.059 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-18T14:58:59.099 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-18T14:58:59.277 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-18T14:58:59.305 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-18T14:58:59.388 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-18T14:58:59.389 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 107/198 2024-03-18T14:58:59.441 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 108/198 2024-03-18T14:58:59.475 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 109/198 2024-03-18T14:58:59.523 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 110/198 2024-03-18T14:58:59.612 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 111/198 2024-03-18T14:58:59.651 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 112/198 2024-03-18T14:58:59.822 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-0.3.21-2.el9.x86_64 113/198 2024-03-18T14:58:59.848 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 114/198 2024-03-18T14:58:59.927 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 115/198 2024-03-18T14:59:00.037 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-18T14:59:00.157 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-18T14:59:00.565 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 116/198 2024-03-18T14:59:00.678 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 117/198 2024-03-18T14:59:01.397 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-18T14:59:01.485 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-18T14:59:01.516 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-18T14:59:01.546 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-18T14:59:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-18T14:59:01.881 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 118/198 2024-03-18T14:59:01.887 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-18T14:59:01.913 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T14:59:01.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 119/198 2024-03-18T14:59:01.990 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 120/198 2024-03-18T14:59:02.003 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T14:59:02.021 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-16.el9.x86_64 121/198 2024-03-18T14:59:02.034 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-18T14:59:02.048 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 122/198 2024-03-18T14:59:02.070 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-18T14:59:02.359 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 123/198 2024-03-18T14:59:02.395 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T14:59:02.468 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 124/198 2024-03-18T14:59:02.500 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 125/198 2024-03-18T14:59:02.531 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-18T14:59:02.536 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 126/198 2024-03-18T14:59:02.557 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T14:59:02.648 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T14:59:02.822 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-18T14:59:02.994 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 127/198 2024-03-18T14:59:03.031 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T14:59:03.085 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 128/198 2024-03-18T14:59:03.108 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 129/198 2024-03-18T14:59:05.282 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.321 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.335 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.371 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.862 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.899 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T14:59:05.921 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 130/198 2024-03-18T14:59:05.958 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T14:59:05.992 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T14:59:05.992 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-18T14:59:05.992 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-18T14:59:05.992 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:06.025 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T14:59:06.049 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 131/198 2024-03-18T14:59:06.049 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-03-18T14:59:06.049 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-03-18T14:59:06.049 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:06.084 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /sys 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /proc 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /mnt 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /var/tmp 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /home 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /root 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout:skipping the directory /tmp 2024-03-18T14:59:17.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:17.886 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T14:59:17.902 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T14:59:17.902 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:17.902 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-18T14:59:17.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 132/198 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-03-18T14:59:18.069 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-03-18T14:59:18.070 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /root 2024-03-18T14:59:18.070 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-03-18T14:59:18.070 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:18.243 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T14:59:18.258 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 133/198 2024-03-18T14:59:18.258 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:18.259 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-03-18T14:59:18.259 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:19.372 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T14:59:19.397 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T14:59:19.398 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:19.398 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-18T14:59:19.398 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T14:59:19.398 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T14:59:19.398 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:19.623 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T14:59:19.645 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T14:59:19.645 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:19.645 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-18T14:59:19.645 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T14:59:19.646 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T14:59:19.646 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:19.736 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T14:59:19.761 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 134/198 2024-03-18T14:59:19.761 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:19.762 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-03-18T14:59:19.762 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T14:59:19.762 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-03-18T14:59:19.762 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:19.987 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T14:59:20.008 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 135/198 2024-03-18T14:59:20.009 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:20.009 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-03-18T14:59:20.009 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T14:59:20.009 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-03-18T14:59:20.009 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:20.090 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T14:59:20.113 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T14:59:20.113 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:20.113 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-18T14:59:20.114 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T14:59:20.114 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T14:59:20.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:20.209 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-18T14:59:20.446 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 136/198 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-03-18T14:59:20.469 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:20.556 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : automake-1.16.2-8.el9.noarch 137/198 2024-03-18T14:59:20.635 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T14:59:20.665 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T14:59:20.697 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-18T14:59:20.757 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-18T14:59:20.779 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T14:59:20.957 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T14:59:20.988 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 138/198 2024-03-18T14:59:21.017 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T14:59:21.020 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 139/198 2024-03-18T14:59:21.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T14:59:21.079 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 140/198 2024-03-18T14:59:21.103 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T14:59:21.335 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 141/198 2024-03-18T14:59:21.362 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T14:59:22.018 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T14:59:22.047 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T14:59:22.149 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T14:59:22.311 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-18T14:59:22.322 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 142/198 2024-03-18T14:59:22.341 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T14:59:22.345 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T14:59:22.363 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T14:59:22.363 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:22.364 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-18T14:59:22.364 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T14:59:22.364 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T14:59:22.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:22.408 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T14:59:22.419 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T14:59:22.446 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 143/198 2024-03-18T14:59:22.471 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-18T14:59:22.608 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 144/198 2024-03-18T14:59:22.640 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T14:59:22.662 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 145/198 2024-03-18T14:59:22.663 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:22.663 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-03-18T14:59:22.663 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T14:59:22.663 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-03-18T14:59:22.663 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:22.710 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T14:59:22.718 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 146/198 2024-03-18T14:59:22.770 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 147/198 2024-03-18T14:59:23.345 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-18T14:59:23.377 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T14:59:23.399 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T14:59:23.399 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.399 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-18T14:59:23.400 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T14:59:23.400 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T14:59:23.400 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:23.444 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T14:59:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T14:59:23.466 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.466 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-18T14:59:23.466 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:23.511 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:23.533 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:23.534 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.534 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-18T14:59:23.534 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T14:59:23.534 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T14:59:23.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:23.640 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libtool-2.4.6-45.el9.x86_64 148/198 2024-03-18T14:59:23.667 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T14:59:23.689 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 149/198 2024-03-18T14:59:23.690 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.690 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-03-18T14:59:23.690 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T14:59:23.690 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-03-18T14:59:23.690 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:23.735 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T14:59:23.757 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 150/198 2024-03-18T14:59:23.757 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.757 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-03-18T14:59:23.757 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:23.802 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:23.824 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:23.824 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.824 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-03-18T14:59:23.825 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T14:59:23.825 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-03-18T14:59:23.825 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:23.837 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T14:59:23.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:24.128 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T14:59:24.150 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 152/198 2024-03-18T14:59:24.150 INFO:teuthology.orchestra.run.smithi186.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-03-18T14:59:24.150 INFO:teuthology.orchestra.run.smithi186.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-03-18T14:59:24.151 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T14:59:24.151 INFO:teuthology.orchestra.run.smithi186.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-03-18T14:59:24.151 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:28.326 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T14:59:28.386 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-18T14:59:28.414 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-18T14:59:28.441 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-18T14:59:28.616 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T14:59:28.624 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-18T14:59:28.658 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 154/198 2024-03-18T14:59:28.688 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 155/198 2024-03-18T14:59:28.715 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : elfutils-libelf-devel-0.190-2.el9.x86_64 156/198 2024-03-18T14:59:28.750 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-18T14:59:28.798 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-18T14:59:28.856 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-18T14:59:28.912 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 157/198 2024-03-18T14:59:28.923 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-18T14:59:28.966 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-18T14:59:28.998 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-18T14:59:29.030 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-18T14:59:29.041 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 158/198 2024-03-18T14:59:29.060 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-18T14:59:29.080 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 159/198 2024-03-18T14:59:29.130 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-18T14:59:29.137 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xfsprogs-devel-6.3.0-1.el9.x86_64 160/198 2024-03-18T14:59:29.180 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 161/198 2024-03-18T14:59:29.198 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-18T14:59:29.226 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : util-linux-user-2.37.4-18.el9.x86_64 162/198 2024-03-18T14:59:29.233 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-18T14:59:29.256 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 163/198 2024-03-18T14:59:29.304 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : elfutils-debuginfod-client-0.190-2.el9.x86_64 164/198 2024-03-18T14:59:29.334 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-team-1:1.46.0-1.el9.x86_64 165/198 2024-03-18T14:59:29.391 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : NetworkManager-tui-1:1.46.0-1.el9.x86_64 166/198 2024-03-18T14:59:29.455 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 167/198 2024-03-18T14:59:29.482 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 168/198 2024-03-18T14:59:29.800 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:29.831 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:29.850 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:30.110 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:30.147 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:30.167 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 169/198 2024-03-18T14:59:30.694 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-18T14:59:30.783 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-18T14:59:30.825 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-18T14:59:30.931 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-18T14:59:30.970 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-18T14:59:30.995 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 170/198 2024-03-18T14:59:30.995 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-18T14:59:31.021 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-18T14:59:31.047 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-18T14:59:31.047 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T14:59:31.078 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : openssl-devel-1:3.0.7-27.el9.x86_64 171/198 2024-03-18T14:59:31.119 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 172/198 2024-03-18T14:59:31.135 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T14:59:31.173 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-18T14:59:31.173 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T14:59:31.201 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : flex-2.6.4-9.el9.x86_64 173/198 2024-03-18T14:59:31.232 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : bison-3.7.4-5.el9.x86_64 174/198 2024-03-18T14:59:31.257 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 175/198 2024-03-18T14:59:31.257 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T14:59:31.282 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 176/198 2024-03-18T14:59:31.283 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-18T14:59:31.309 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 177/198 2024-03-18T14:59:31.309 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T14:59:31.316 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-18T14:59:31.342 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-18T14:59:31.367 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-18T14:59:31.380 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 178/198 2024-03-18T14:59:31.402 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-18T14:59:31.410 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 179/198 2024-03-18T14:59:31.410 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T14:59:31.440 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-18T14:59:31.471 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-18T14:59:31.478 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 180/198 2024-03-18T14:59:31.497 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-18T14:59:31.504 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 181/198 2024-03-18T14:59:31.522 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-18T14:59:31.537 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : xfsprogs-5.19.0-4.el9.x86_64 182/198 2024-03-18T14:59:31.547 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-18T14:59:31.563 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 183/198 2024-03-18T14:59:31.573 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-18T14:59:31.579 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.579 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.588 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 184/198 2024-03-18T14:59:31.623 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-user-2.37.4-15.el9.x86_64 185/198 2024-03-18T14:59:31.660 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-2.37.4-15.el9.x86_64 186/198 2024-03-18T14:59:31.692 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : util-linux-core-2.37.4-15.el9.x86_64 187/198 2024-03-18T14:59:31.718 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libfdisk-2.37.4-15.el9.x86_64 188/198 2024-03-18T14:59:31.743 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libmount-2.37.4-15.el9.x86_64 189/198 2024-03-18T14:59:31.759 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.759 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T14:59:31.768 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libblkid-2.37.4-15.el9.x86_64 190/198 2024-03-18T14:59:31.794 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 191/198 2024-03-18T14:59:31.800 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.800 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.842 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T14:59:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-18T14:59:31.892 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-18T14:59:31.925 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-18T14:59:31.951 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-18T14:59:31.980 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 192/198 2024-03-18T14:59:31.980 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T14:59:32.017 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T14:59:32.063 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 193/198 2024-03-18T14:59:32.088 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libuuid-2.37.4-15.el9.x86_64 194/198 2024-03-18T14:59:32.113 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libsmartcols-2.37.4-15.el9.x86_64 195/198 2024-03-18T14:59:32.146 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 196/198 2024-03-18T14:59:32.172 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 197/198 2024-03-18T14:59:32.238 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-18T14:59:36.929 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:59:36.930 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-18T14:59:36.931 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-18T14:59:36.949 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-18T14:59:36.950 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-18T14:59:36.951 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-18T14:59:36.952 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-18T14:59:36.953 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-18T14:59:36.954 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-18T14:59:36.955 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-18T14:59:36.956 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-18T14:59:36.957 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-18T14:59:36.958 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-18T14:59:36.959 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-18T14:59:36.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-18T14:59:36.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-18T14:59:36.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: elfutils-libelf-0.189-3.el9.x86_64 198/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 1/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 3/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 4/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-2162.g3d78f 5/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 6/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 7/198 2024-03-18T14:59:36.981 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 8/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 9/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 10/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 11/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 12/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 13/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 14/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_ 15/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 16/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 17/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_6 18/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86 19/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 20/198 2024-03-18T14:59:36.982 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el 21/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9. 22/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_6 23/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 24/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 25/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 26/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 27/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 28/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 29/198 2024-03-18T14:59:36.983 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba. 30/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noa 31/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.n 32/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d7 33/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el 34/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 35/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.e 36/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 37/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 38/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 39/198 2024-03-18T14:59:37.000 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 47/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 48/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 49/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 50/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 51/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 52/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 53/198 2024-03-18T14:59:37.001 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-5.4.4-4.el9.x86_64 54/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 55/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 56/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 57/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-13.11-1.el9.x86_64 58/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 59/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 60/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 61/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 62/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 63/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 65/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 66/198 2024-03-18T14:59:37.002 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 67/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 68/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 69/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 70/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 71/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 72/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 74/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/198 2024-03-18T14:59:37.003 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 84/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 85/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 86/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 87/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 88/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-ply-3.11-14.el9.noarch 89/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 90/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-urllib3-1.26.5-5.el9.noarch 91/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : jq-1.6-16.el9.x86_64 92/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 93/198 2024-03-18T14:59:37.004 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 94/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 95/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-devel-0.190-2.el9.x86_64 96/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 97/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-devel-1:3.0.7-27.el9.x86_64 98/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 99/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jinja2-2.11.3-5.el9.noarch 100/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-23.11.0-1.el9.x86_64 101/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatlib-service-23.11.0-1.el9.x86_64 102/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : qatzip-libs-1.1.2-2.el9.x86_64 103/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-devel-6.3.0-1.el9.x86_64 104/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/198 2024-03-18T14:59:37.005 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 108/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 110/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 111/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 114/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 115/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-asyncssh-2.13.2-4.el9.noarch 116/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/198 2024-03-18T14:59:37.006 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 119/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 123/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-google-auth-1:2.28.0-1.el9.noarch 124/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 125/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 126/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 127/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 128/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 129/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 130/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 131/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 132/198 2024-03-18T14:59:37.007 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 133/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 134/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 135/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 136/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 137/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 138/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 139/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 140/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 141/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 142/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 143/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 144/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 145/198 2024-03-18T14:59:37.008 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 146/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 147/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 148/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : re2-1:20211101-3.el9.x86_64 149/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 150/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 151/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 152/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 153/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 154/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 155/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 156/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.46.0-1.el9.x86_64 157/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 158/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.46.0-1.el9.x86_64 159/198 2024-03-18T14:59:37.009 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.46.0-1.el9.x86_64 161/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 162/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.46.0-1.el9.x86_64 163/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 164/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.3.1-4.el9.x86_64 165/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : acl-2.3.1-3.el9.x86_64 166/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 167/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 168/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 169/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 170/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 171/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 172/198 2024-03-18T14:59:37.010 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 173/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 174/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libblkid-2.37.4-18.el9.x86_64 175/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libblkid-2.37.4-15.el9.x86_64 176/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfdisk-2.37.4-18.el9.x86_64 177/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libfdisk-2.37.4-15.el9.x86_64 178/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libmount-2.37.4-18.el9.x86_64 179/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libmount-2.37.4-15.el9.x86_64 180/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsmartcols-2.37.4-18.el9.x86_64 181/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libsmartcols-2.37.4-15.el9.x86_64 182/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-2.37.4-18.el9.x86_64 183/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libuuid-2.37.4-15.el9.x86_64 184/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 185/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 186/198 2024-03-18T14:59:37.011 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 187/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 188/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-2.37.4-18.el9.x86_64 189/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-2.37.4-15.el9.x86_64 190/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-core-2.37.4-18.el9.x86_64 191/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-core-2.37.4-15.el9.x86_64 192/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-user-2.37.4-18.el9.x86_64 193/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : util-linux-user-2.37.4-15.el9.x86_64 194/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 195/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : xfsprogs-5.19.0-4.el9.x86_64 196/198 2024-03-18T14:59:37.012 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 197/198 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:39.825 INFO:teuthology.orchestra.run.smithi186.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: acl-2.3.1-4.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.826 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: automake-1.16.2-8.el9.noarch 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: bison-3.7.4-5.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.827 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.828 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: flex-2.6.4-9.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-18T14:59:39.829 INFO:teuthology.orchestra.run.smithi186.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: jq-1.6-16.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-18T14:59:39.830 INFO:teuthology.orchestra.run.smithi186.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: lua-5.4.4-4.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-18T14:59:39.831 INFO:teuthology.orchestra.run.smithi186.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-13.11-1.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-18T14:59:39.832 INFO:teuthology.orchestra.run.smithi186.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-18T14:59:39.833 INFO:teuthology.orchestra.run.smithi186.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-18T14:59:39.834 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ply-3.11-14.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-18T14:59:39.835 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-18T14:59:39.836 INFO:teuthology.orchestra.run.smithi186.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:39.837 INFO:teuthology.orchestra.run.smithi186.stdout: re2-1:20211101-3.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:39.838 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 198/198 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-libnm-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-team-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:40.148 INFO:teuthology.orchestra.run.smithi152.stdout: NetworkManager-tui-1:1.46.0-1.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: acl-2.3.1-4.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-debuginfod-client-0.190-2.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-0.190-2.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libs-0.190-2.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-2.3.1-4.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libacl-devel-2.3.1-4.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libblkid-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libfdisk-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libmount-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: librados2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: librbd1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libsmartcols-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.149 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-libs-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-core-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: util-linux-user-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: xfsdump-3.1.12-4.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-6.3.0-1.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: automake-1.16.2-8.el9.noarch 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: bison-3.7.4-5.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-03-18T14:59:40.150 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-base-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-grafana-dashboards-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-immutable-object-cache-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mds-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-dashboard-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-diskprediction-local-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-modules-core-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mgr-rook-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.151 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-mon-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-osd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-prometheus-alerts-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-radosgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-selinux-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-test-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: ceph-volume-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: cephadm-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-shell-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: cephfs-top-2:19.0.0-2162.g3d78f5ba.el9.noarch 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: elfutils-libelf-devel-0.190-2.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: flex-2.6.4-9.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-03-18T14:59:40.152 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: fuse-2.9.9-15.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: grpc-data-1.46.7-10.el9.noarch 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: jq-1.6-16.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-9.0.0-10.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libarrow-doc-9.0.0-10.el9.noarch 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libcephfs2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libcephsqlite-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-03-18T14:59:40.153 INFO:teuthology.orchestra.run.smithi152.stdout: liboath-2.6.7-2.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: librados-devel-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libradosstriper1-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: librgw2-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libtool-2.4.6-45.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libunwind-1.6.2-1.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-03-18T14:59:40.154 INFO:teuthology.orchestra.run.smithi152.stdout: lua-5.4.4-4.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: luarocks-3.9.2-1.el9.noarch 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-0.3.21-2.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: openssl-devel-1:3.0.7-27.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: parquet-libs-9.0.0-10.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-13.11-1.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-contrib-13.11-1.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: postgresql-server-13.11-1.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-3.14.0-13.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-03-18T14:59:40.155 INFO:teuthology.orchestra.run.smithi152.stdout: python3-asyncssh-2.13.2-4.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-babel-2.9.1-2.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-argparse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ceph-common-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cephfs-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-certifi-2021.10.8-2.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-03-18T14:59:40.156 INFO:teuthology.orchestra.run.smithi152.stdout: python3-colorama-0.4.4-12.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.17-2.el9.x86_64 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-google-auth-1:2.28.0-1.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jinja2-2.11.3-5.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-03-18T14:59:40.157 INFO:teuthology.orchestra.run.smithi152.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-mako-1.1.4-6.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-packaging-20.9-5.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-ply-3.11-14.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-portend-3.1.0-2.el9.noarch 2024-03-18T14:59:40.158 INFO:teuthology.orchestra.run.smithi152.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pycparser-2.20-6.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-pytz-2021.1-5.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rados-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-2.25.1-8.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-03-18T14:59:40.159 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rgw-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-routes-2.5.1-5.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-rsa-4.9-2.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-toml-0.10.2-6.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-urllib3-1.26.5-5.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-webob-1.8.7-6.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-03-18T14:59:40.160 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-23.11.0-1.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: qatlib-service-23.11.0-1.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: qatzip-libs-1.1.2-2.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-fuse-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-mirror-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: rbd-nbd-2:19.0.0-2162.g3d78f5ba.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: re2-1:20211101-3.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: socat-1.7.4.1-5.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: thrift-0.15.0-2.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: uuid-1.6.2-55.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: xfsprogs-devel-6.3.0-1.el9.x86_64 2024-03-18T14:59:40.161 INFO:teuthology.orchestra.run.smithi152.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-03-18T14:59:40.162 INFO:teuthology.orchestra.run.smithi152.stdout: zlib-devel-1.2.11-40.el9.x86_64 2024-03-18T14:59:40.162 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:40.162 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-03-18T14:59:40.289 DEBUG:teuthology.parallel:result is None 2024-03-18T14:59:40.601 DEBUG:teuthology.parallel:result is None 2024-03-18T14:59:40.602 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:59:40.743 DEBUG:teuthology.orchestra.run.smithi152:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:59:40.764 INFO:teuthology.orchestra.run.smithi152.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-18T14:59:40.765 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-18T14:59:40.765 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-18T14:59:40.768 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=3d78f5ba07bf18880172c07d4d7b4ac00c9d30af 2024-03-18T14:59:40.987 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-18T14:59:41.010 INFO:teuthology.orchestra.run.smithi186.stdout:19.0.0-2162.g3d78f5ba.el9 2024-03-18T14:59:41.010 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-2162.g3d78f5ba.el9 2024-03-18T14:59:41.010 INFO:teuthology.task.install:The correct ceph version 19.0.0-2162.g3d78f5ba is installed. 2024-03-18T14:59:41.012 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-18T14:59:41.012 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:41.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T14:59:41.042 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:41.042 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-18T14:59:41.081 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-18T14:59:41.081 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:41.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T14:59:41.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T14:59:41.176 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:41.176 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-03-18T14:59:41.205 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-18T14:59:41.274 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-18T14:59:41.274 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:41.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T14:59:41.301 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T14:59:41.369 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:41.369 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-18T14:59:41.396 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-18T14:59:41.465 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-18T14:59:41.465 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:41.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T14:59:41.492 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T14:59:41.558 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:41.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-03-18T14:59:41.586 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-18T14:59:41.653 INFO:teuthology.run_tasks:Running task ceph... 2024-03-18T14:59:41.745 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-03-18T14:59:41.746 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 777 /var/log/ceph 2024-03-18T14:59:41.748 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2024-03-18T14:59:41.774 INFO:tasks.ceph:Disabling ceph logrotate... 2024-03-18T14:59:41.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T14:59:41.815 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2024-03-18T14:59:41.842 INFO:tasks.ceph:Creating extra log directories... 2024-03-18T14:59:41.843 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T14:59:41.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-03-18T14:59:41.917 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-03-18T14:59:41.917 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-03-18T14:59:41.918 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-03-18T14:59:41.918 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:41.918 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T14:59:41.964 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T14:59:42.082 DEBUG:teuthology.orchestra.run.smithi152:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-18T14:59:42.110 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:42.110 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-03-18T14:59:42.125 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-03-18T14:59:42.242 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-03-18T14:59:42.274 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-03-18T14:59:42.274 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-03-18T14:59:42.275 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860', 'branch': 'wip-batrick-testing-20240314.183243', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev}', 'email': 'pdonnell@redhat.com', 'first_in_suite': False, 'job_id': '7608860', 'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-batrick-testing-20240314.183243'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, 'kclient': {'syntax': 'v2'}, 'selinux': {'allowlist': ['scontext=system_u:system_r:getty_t:s0']}, 'subvolume_version': 2, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-batrick-testing-20240314.183243', 'sha1': '4e19f704afd9957ea657ab858f9ecf76401fef6f'}}, 'owner': 'scheduled_pdonnell@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 4770, 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'sleep_before_teardown': 0, 'subset': '498/512', 'suite': 'fs', 'suite_branch': 'wip-batrick-testing-20240314.183243', 'suite_path': '/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/batrick/ceph', 'suite_sha1': '4e19f704afd9957ea657ab858f9ecf76401fef6f', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi152.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCksRV3cHBxdsEvyK7DHWX2QmJoaxL64VcPYmHZTV4Hk8Z2+s6w0V1cQ6ZA5f2XoOoQl+qrrcBVzhDQJBoLU8Y=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0MtjsXhFMj20MQvMw9MSYPKt3X6PTmgCv/fUJI4FtPLbbbKUHKsliA28MPvH0MTXnH55596gpRK8awdgwjF2o='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'mons down, quorum', 'out of quorum', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN'], 'sha1': '3d78f5ba07bf18880172c07d4d7b4ac00c9d30af', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': 'e691533f9cbb33d85b2187bba20d7102f098636d', 'timestamp': '2024-03-18_14:19:46', 'tube': 'smithi', 'user': 'pdonnell', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-03-18T14:59:42.275 DEBUG:teuthology.orchestra.run.smithi152:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T14:59:42.278 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-03-18T14:59:42.324 DEBUG:teuthology.orchestra.run.smithi152:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T14:59:42.332 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2024-03-18T14:59:42.391 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:42.392 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T14:59:42.412 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T14:59:42.413 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_1 2024-03-18T14:59:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-03-18 14:59:32.385288048 +0000 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-03-18 14:57:25.120884121 +0000 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-03-18 14:57:25.120884121 +0000 2024-03-18T14:59:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-03-18 14:57:25.120884121 +0000 2024-03-18T14:59:42.469 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T14:59:42.533 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-03-18T14:59:42.533 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-03-18T14:59:42.533 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000202426 s, 2.5 MB/s 2024-03-18T14:59:42.535 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T14:59:42.591 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_2 2024-03-18T14:59:42.646 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T14:59:42.646 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-03-18T14:59:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:42.646 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-03-18 14:59:32.385288048 +0000 2024-03-18T14:59:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-03-18 14:57:25.472879973 +0000 2024-03-18T14:59:42.647 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-03-18 14:57:25.472879973 +0000 2024-03-18T14:59:42.647 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-03-18 14:57:25.472879973 +0000 2024-03-18T14:59:42.647 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T14:59:42.711 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-03-18T14:59:42.711 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-03-18T14:59:42.711 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000184795 s, 2.8 MB/s 2024-03-18T14:59:42.712 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T14:59:42.769 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_3 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-03-18 14:59:32.386288036 +0000 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-03-18 14:57:25.807876026 +0000 2024-03-18T14:59:42.825 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-03-18 14:57:25.807876026 +0000 2024-03-18T14:59:42.826 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-03-18 14:57:25.807876026 +0000 2024-03-18T14:59:42.826 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T14:59:42.890 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-03-18T14:59:42.890 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-03-18T14:59:42.890 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.000158219 s, 3.2 MB/s 2024-03-18T14:59:42.891 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T14:59:42.946 DEBUG:teuthology.orchestra.run.smithi152:> stat /dev/vg_nvme/lv_4 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-03-18 14:59:32.386288036 +0000 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-03-18 14:57:26.145872043 +0000 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-03-18 14:57:26.145872043 +0000 2024-03-18T14:59:43.002 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-03-18 14:57:26.145872043 +0000 2024-03-18T14:59:43.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T14:59:43.067 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records in 2024-03-18T14:59:43.067 INFO:teuthology.orchestra.run.smithi152.stderr:1+0 records out 2024-03-18T14:59:43.068 INFO:teuthology.orchestra.run.smithi152.stderr:512 bytes copied, 0.00024212 s, 2.1 MB/s 2024-03-18T14:59:43.069 DEBUG:teuthology.orchestra.run.smithi152:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T14:59:43.124 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:43.124 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:43.124 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/scratch_devs of=/dev/stdout 2024-03-18T14:59:43.141 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-18T14:59:43.141 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_1 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:43.198 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-18 14:59:32.605277414 +0000 2024-03-18T14:59:43.199 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-18 14:57:25.192602349 +0000 2024-03-18T14:59:43.199 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-18 14:57:25.192602349 +0000 2024-03-18T14:59:43.199 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-18 14:57:25.192602349 +0000 2024-03-18T14:59:43.199 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-18T14:59:43.265 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-18T14:59:43.266 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-18T14:59:43.266 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000268311 s, 1.9 MB/s 2024-03-18T14:59:43.267 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-18T14:59:43.324 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_2 2024-03-18T14:59:43.379 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-18 14:59:32.606277395 +0000 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-18 14:57:25.522596305 +0000 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-18 14:57:25.522596305 +0000 2024-03-18T14:59:43.380 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-18 14:57:25.522596305 +0000 2024-03-18T14:59:43.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-18T14:59:43.446 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-18T14:59:43.447 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-18T14:59:43.447 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000184592 s, 2.8 MB/s 2024-03-18T14:59:43.448 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-18T14:59:43.504 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_3 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-18 14:59:32.606277395 +0000 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-18 14:57:25.862590078 +0000 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-18 14:57:25.862590078 +0000 2024-03-18T14:59:43.559 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-18 14:57:25.862590078 +0000 2024-03-18T14:59:43.559 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-18T14:59:43.625 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-18T14:59:43.625 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-18T14:59:43.625 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000180938 s, 2.8 MB/s 2024-03-18T14:59:43.626 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-18T14:59:43.682 DEBUG:teuthology.orchestra.run.smithi186:> stat /dev/vg_nvme/lv_4 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout:Context: system_u:object_r:device_t:s0 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout:Access: 2024-03-18 14:59:32.606277395 +0000 2024-03-18T14:59:43.737 INFO:teuthology.orchestra.run.smithi186.stdout:Modify: 2024-03-18 14:57:26.200583888 +0000 2024-03-18T14:59:43.738 INFO:teuthology.orchestra.run.smithi186.stdout:Change: 2024-03-18 14:57:26.200583888 +0000 2024-03-18T14:59:43.738 INFO:teuthology.orchestra.run.smithi186.stdout: Birth: 2024-03-18 14:57:26.200583888 +0000 2024-03-18T14:59:43.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-18T14:59:43.802 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records in 2024-03-18T14:59:43.802 INFO:teuthology.orchestra.run.smithi186.stderr:1+0 records out 2024-03-18T14:59:43.803 INFO:teuthology.orchestra.run.smithi186.stderr:512 bytes copied, 0.000188041 s, 2.7 MB/s 2024-03-18T14:59:43.804 DEBUG:teuthology.orchestra.run.smithi186:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-18T14:59:43.858 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:43.859 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T14:59:43.859 INFO:tasks.ceph:Generating config... 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] client mount timeout = 600 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] debug client = 20 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] debug ms = 1 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] pid file = 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-03-18T14:59:43.860 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-03-18T14:59:43.860 INFO:tasks.ceph:[global] ms die on skipped message = False 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] debug mds = 20 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] debug ms = 1 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] mds debug frag = True 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-03-18T14:59:43.861 INFO:tasks.ceph:[mgr] debug ms = 1 2024-03-18T14:59:43.862 INFO:tasks.ceph:[mon] debug mon = 20 2024-03-18T14:59:43.862 INFO:tasks.ceph:[mon] debug ms = 1 2024-03-18T14:59:43.862 INFO:tasks.ceph:[mon] debug paxos = 20 2024-03-18T14:59:43.862 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] bdev async discard = True 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-03-18T14:59:43.862 INFO:tasks.ceph:[osd] debug ms = 1 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] debug osd = 20 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-03-18T14:59:43.863 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-03-18T14:59:43.863 INFO:tasks.ceph:Setting up mon.a... 2024-03-18T14:59:43.863 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-03-18T14:59:43.923 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.keyring 2024-03-18T14:59:43.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-03-18T14:59:43.970 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:59:43.997 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.152'), ('mon.b', '172.21.15.186'), ('mon.c', '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]')] 2024-03-18T14:59:43.997 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.152,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-03-18T14:59:43.998 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:43.998 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T14:59:44.052 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.152 --add b 172.21.15.186 --addv c '[v2:172.21.15.186:3301,v1:172.21.15.186:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: generated fsid ee22e391-802c-4342-9093-15071cbd8b50 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:setting min_mon_release = quincy 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:epoch 0 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:fsid ee22e391-802c-4342-9093-15071cbd8b50 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:last_changed 2024-03-18T14:59:44.136648+0000 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:created 2024-03-18T14:59:44.136648+0000 2024-03-18T14:59:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:min_mon_release 17 (quincy) 2024-03-18T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stdout:election_strategy: 1 2024-03-18T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stdout:0: [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] mon.a 2024-03-18T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stdout:1: [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] mon.b 2024-03-18T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stdout:2: [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] mon.c 2024-03-18T14:59:44.137 INFO:teuthology.orchestra.run.smithi152.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-03-18T14:59:44.138 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-03-18T14:59:44.193 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ee22e391-802c-4342-9093-15071cbd8b50... 2024-03-18T14:59:44.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T14:59:44.235 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-03-18T14:59:44.283 INFO:teuthology.orchestra.run.smithi152.stdout:[global] 2024-03-18T14:59:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: chdir = "" 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: auth supported = cephx 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: filestore xattr use omap = true 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: mon clock drift allowed = 1.000 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: osd crush chooseleaf type = 0 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: auth debug = true 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on old message = true 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on bug = true 2024-03-18T14:59:44.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon pg warn max object skew = 0 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default size = 2 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow primary affinity = true 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd allow pg remap = true 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on legacy crush tunables = false 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on crush straw calc version zero = false 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on no sortbitwise = false 2024-03-18T14:59:44.285 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on osd down out interval zero = false 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: mon warn on too few osds = false 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: mon_allow_pool_size_one = true 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: osd default data pool replay window = 5 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: mon allow pool delete = true 2024-03-18T14:59:44.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: mon cluster log file level = debug 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: debug asserts on shutdown = true 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: mon health detail to clog = false 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: mon host = "172.21.15.152,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: ms die on skipped message = False 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: fsid = ee22e391-802c-4342-9093-15071cbd8b50 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout:[osd] 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: osd journal size = 100 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub load threshold = 5.0 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: osd scrub max interval = 600 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: osd mclock profile = high_recovery_ops 2024-03-18T14:59:44.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd recover clone overlap = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd recovery max chunk = 1048576 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug shutdown = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug op order = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug verify stray on activate = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug trim objects = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd open classes on start = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug pg log writeout = true 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd deep scrub update digest min age = 30 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.288 INFO:teuthology.orchestra.run.smithi152.stdout: osd map max advance = 10 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: journal zero on create = true 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: filestore ondisk finisher threads = 3 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: filestore apply finisher threads = 3 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bdev debug aio = true 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: osd debug misdirected ops = true 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bdev async discard = True 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bdev enable discard = True 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore allocator = bitmap 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore block size = 96636764160 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: bluestore fsck on mount = True 2024-03-18T14:59:44.289 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluefs = 1/20 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: debug bluestore = 1/20 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: debug osd = 20 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: debug rocksdb = 4/10 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd full ratio = 0.9 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd nearfull ratio = 0.8 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: osd failsafe full ratio = 0.95 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: osd objectstore = bluestore 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr] 2024-03-18T14:59:44.290 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug mgr = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: mgr/telemetry/nag = false 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout:[mon] 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug mon = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug paxos = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: debug auth = 20 2024-03-18T14:59:44.291 INFO:teuthology.orchestra.run.smithi152.stdout: mon data avail warn = 5 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon mgr mkfs grace = 240 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd reporter subtree level = osd 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon osd prime pg temp = true 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T14:59:44.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: # 1m isn't quite enough 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: mon_down_mkfs_grace = 2m 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: mon_warn_on_filestore_osds = false 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: mon op complaint time = 120 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout:[client] 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: rgw cache enabled = true 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable ops log = true 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: rgw enable usage log = true 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T14:59:44.293 INFO:teuthology.orchestra.run.smithi152.stdout: client mount timeout = 600 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: debug client = 20 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: pid file = "" 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.a] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.b] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mon.c] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-03-18T14:59:44.294 INFO:teuthology.orchestra.run.smithi152.stdout:[mds] 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds = 20 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: debug mds balancer = 20 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: debug ms = 1 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug frag = True 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: mds debug scatterstat = True 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: mds op complaint time = 180 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: mds verify scatter = True 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: osd op complaint time = 180 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: rados mon op timeout = 900 2024-03-18T14:59:44.295 INFO:teuthology.orchestra.run.smithi152.stdout: rados osd op timeout = 900 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2024-03-18T14:59:44.296 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2024-03-18T14:59:44.297 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2024-03-18T14:59:44.298 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.152,172.21.15.186,[v2:172.21.15.186:3301,v1:172.21.15.186:6790]" 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on skipped message = False 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = ee22e391-802c-4342-9093-15071cbd8b50 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2024-03-18T14:59:44.299 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug trim objects = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.300 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: bdev async discard = True 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: bdev enable discard = True 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore allocator = bitmap 2024-03-18T14:59:44.301 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 1/20 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 1/20 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 4/10 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.302 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2024-03-18T14:59:44.303 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.304 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-03-18T14:59:44.305 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = "" 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds balancer = 20 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-03-18T14:59:44.306 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-03-18T14:59:44.307 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-03-18T14:59:44.309 INFO:tasks.ceph:Creating admin key on mon.a... 2024-03-18T14:59:44.309 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-03-18T14:59:44.405 INFO:tasks.ceph:Copying monmap to all nodes... 2024-03-18T14:59:44.405 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:44.405 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-03-18T14:59:44.420 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:44.420 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-03-18T14:59:44.475 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:59:44.475 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:44.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T14:59:44.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:59:44.554 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T14:59:44.554 DEBUG:teuthology.orchestra.run.smithi152:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:44.609 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T14:59:44.609 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:44.610 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2024-03-18T14:59:44.610 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-03-18T14:59:44.649 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T14:59:44.649 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:44.704 INFO:tasks.ceph:Setting up mon nodes... 2024-03-18T14:59:44.704 INFO:tasks.ceph:Setting up mgr nodes... 2024-03-18T14:59:44.704 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T14:59:44.759 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-03-18T14:59:44.761 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T14:59:44.824 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-03-18T14:59:44.826 INFO:tasks.ceph:Setting up mds nodes... 2024-03-18T14:59:44.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T14:59:44.884 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-03-18T14:59:44.886 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-03-18T14:59:44.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T14:59:45.008 INFO:teuthology.orchestra.run.smithi152.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-03-18T14:59:45.011 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-03-18T14:59:45.037 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T14:59:45.093 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-03-18T14:59:45.095 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-03-18T14:59:45.122 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-03-18T14:59:45.216 INFO:teuthology.orchestra.run.smithi186.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-03-18T14:59:45.219 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-03-18T14:59:45.246 INFO:tasks.ceph_client:Setting up client nodes... 2024-03-18T14:59:45.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-18T14:59:45.288 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-03-18T14:59:45.304 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-03-18T14:59:45.386 INFO:teuthology.orchestra.run.smithi152.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-03-18T14:59:45.402 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-18T14:59:45.445 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-03-18T14:59:45.460 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-03-18T14:59:45.543 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-03-18T14:59:45.558 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-03-18T14:59:45.559 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi152.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi186.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-03-18T14:59:45.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-03-18T14:59:45.586 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:45.586 INFO:tasks.ceph:role: osd.0 2024-03-18T14:59:45.586 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:59:45.586 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T14:59:45.660 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:59:45.660 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:59:45.660 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:59:45.660 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:59:45.661 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:59:46.145 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-03-18T14:59:46.147 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-03-18T14:59:46.148 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-03-18T14:59:46.261 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-03-18T14:59:46.295 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-03-18T14:59:46.363 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:46.363 INFO:tasks.ceph:role: osd.1 2024-03-18T14:59:46.363 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:59:46.363 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:59:46.437 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:59:46.898 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-03-18T14:59:46.900 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-03-18T14:59:46.900 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-03-18T14:59:46.975 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-03-18T14:59:47.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-03-18T14:59:47.114 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:47.114 INFO:tasks.ceph:role: osd.2 2024-03-18T14:59:47.114 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:59:47.115 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T14:59:47.197 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:59:47.198 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:59:47.680 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-03-18T14:59:47.682 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-03-18T14:59:47.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-03-18T14:59:47.786 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-03-18T14:59:47.817 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-03-18T14:59:47.885 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-03-18T14:59:47.885 INFO:tasks.ceph:role: osd.3 2024-03-18T14:59:47.885 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T14:59:47.885 DEBUG:teuthology.orchestra.run.smithi152:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout: = sunit=0 swidth=0 blks 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T14:59:47.960 INFO:teuthology.orchestra.run.smithi152.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T14:59:48.473 INFO:teuthology.orchestra.run.smithi152.stdout:Discarding blocks...Done. 2024-03-18T14:59:48.475 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi152.front.sepia.ceph.com -o noatime 2024-03-18T14:59:48.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-03-18T14:59:48.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-03-18T14:59:48.655 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:48.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.753+0000 7f61b8d9a640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-03-18T14:59:48.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.759+0000 7f61b8d9a640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-03-18T14:59:48.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.759+0000 7f61b8d9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:59:48.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.759+0000 7f61b8d9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:59:48.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.759+0000 7f61b8d9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-03-18T14:59:48.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:48.761+0000 7f61b8d9a640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-03-18T14:59:51.611 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-18T14:59:51.643 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.734+0000 7f6ff3017640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-03-18T14:59:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.735+0000 7f6ff3017640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-03-18T14:59:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.735+0000 7f6ff3017640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:59:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.735+0000 7f6ff3017640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:59:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.735+0000 7f6ff3017640 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-03-18T14:59:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:51.735+0000 7f6ff3017640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-03-18T14:59:54.577 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-18T14:59:54.608 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:54.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.700+0000 7efdf2221640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-03-18T14:59:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.700+0000 7efdf2221640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-03-18T14:59:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.700+0000 7efdf2221640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:59:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.700+0000 7efdf2221640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:59:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.700+0000 7efdf2221640 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-03-18T14:59:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:54.701+0000 7efdf2221640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-03-18T14:59:57.556 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-18T14:59:57.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T14:59:57.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.674+0000 7fe52a128640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-03-18T14:59:57.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.675+0000 7fe52a128640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-03-18T14:59:57.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.675+0000 7fe52a128640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:59:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.675+0000 7fe52a128640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:59:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.675+0000 7fe52a128640 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-03-18T14:59:57.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T14:59:57.675+0000 7fe52a128640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-03-18T15:00:00.526 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-18T15:00:00.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-03-18T15:00:00.592 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T15:00:00.592 INFO:tasks.ceph:role: osd.4 2024-03-18T15:00:00.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:00:00.592 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-03-18T15:00:00.670 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T15:00:00.670 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T15:00:00.670 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T15:00:00.671 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T15:00:01.175 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-03-18T15:00:01.177 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-03-18T15:00:01.178 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-03-18T15:00:01.283 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-03-18T15:00:01.319 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-03-18T15:00:01.387 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T15:00:01.387 INFO:tasks.ceph:role: osd.5 2024-03-18T15:00:01.387 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:00:01.387 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-03-18T15:00:01.462 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T15:00:01.463 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T15:00:01.924 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-03-18T15:00:01.926 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-03-18T15:00:01.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-03-18T15:00:02.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-03-18T15:00:02.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-03-18T15:00:02.115 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T15:00:02.115 INFO:tasks.ceph:role: osd.6 2024-03-18T15:00:02.115 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:00:02.115 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-03-18T15:00:02.190 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T15:00:02.191 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T15:00:02.685 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-03-18T15:00:02.687 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-03-18T15:00:02.687 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-03-18T15:00:02.824 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-03-18T15:00:02.858 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-03-18T15:00:02.927 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-03-18T15:00:02.927 INFO:tasks.ceph:role: osd.7 2024-03-18T15:00:02.927 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:00:02.927 DEBUG:teuthology.orchestra.run.smithi186:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 attr=2, projid32bit=1 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout: = sunit=0 swidth=0 blks 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-03-18T15:00:03.006 INFO:teuthology.orchestra.run.smithi186.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-03-18T15:00:03.007 INFO:teuthology.orchestra.run.smithi186.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-03-18T15:00:03.495 INFO:teuthology.orchestra.run.smithi186.stdout:Discarding blocks...Done. 2024-03-18T15:00:03.497 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi186.front.sepia.ceph.com -o noatime 2024-03-18T15:00:03.498 DEBUG:teuthology.orchestra.run.smithi186:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-03-18T15:00:03.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-03-18T15:00:03.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:03.760 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.759+0000 7f19a5de1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-03-18T15:00:03.760 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.759+0000 7f19a5de1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-03-18T15:00:03.760 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.759+0000 7f19a5de1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T15:00:03.760 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.759+0000 7f19a5de1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T15:00:03.760 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.759+0000 7f19a5de1640 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-03-18T15:00:03.761 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:03.760+0000 7f19a5de1640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-03-18T15:00:06.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-18T15:00:06.639 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:06.731 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.730+0000 7ff6d0be1640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-03-18T15:00:06.731 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.730+0000 7ff6d0be1640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-03-18T15:00:06.731 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.730+0000 7ff6d0be1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T15:00:06.731 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.730+0000 7ff6d0be1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T15:00:06.731 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.730+0000 7ff6d0be1640 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-03-18T15:00:06.732 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:06.731+0000 7ff6d0be1640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-03-18T15:00:09.590 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-18T15:00:09.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:09.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.713+0000 7f0c5eb73640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-03-18T15:00:09.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.713+0000 7f0c5eb73640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-03-18T15:00:09.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.713+0000 7f0c5eb73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T15:00:09.714 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.713+0000 7f0c5eb73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T15:00:09.715 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.713+0000 7f0c5eb73640 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-03-18T15:00:09.715 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:09.714+0000 7f0c5eb73640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-03-18T15:00:12.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:00:12.279 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:00:12.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-03-18T15:00:12.589 DEBUG:teuthology.orchestra.run.smithi186:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:12.676 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.675+0000 7f2d1468b640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-03-18T15:00:12.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.676+0000 7f2d1468b640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-03-18T15:00:12.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.676+0000 7f2d1468b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T15:00:12.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.676+0000 7f2d1468b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T15:00:12.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.676+0000 7f2d1468b640 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-03-18T15:00:12.677 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:12.676+0000 7f2d1468b640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-03-18T15:00:15.538 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-03-18T15:00:15.570 INFO:tasks.ceph:Reading keys from all nodes... 2024-03-18T15:00:15.570 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.570 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-03-18T15:00:15.603 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.603 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-03-18T15:00:15.673 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-03-18T15:00:15.743 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.744 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-03-18T15:00:15.812 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.812 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-03-18T15:00:15.880 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-03-18T15:00:15.948 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:15.948 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-03-18T15:00:16.016 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-03-18T15:00:16.048 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.048 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-03-18T15:00:16.118 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.119 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-03-18T15:00:16.187 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.188 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-03-18T15:00:16.256 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.257 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-03-18T15:00:16.325 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.325 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-03-18T15:00:16.394 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.395 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-03-18T15:00:16.462 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:16.462 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-03-18T15:00:16.478 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:16.478 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-03-18T15:00:16.533 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.533 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-03-18T15:00:16.548 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:16.549 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-03-18T15:00:16.603 INFO:tasks.ceph:Adding keys to all mons... 2024-03-18T15:00:16.604 DEBUG:teuthology.orchestra.run.smithi152:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T15:00:16.606 DEBUG:teuthology.orchestra.run.smithi186:> sudo tee -a /etc/ceph/ceph.keyring 2024-03-18T15:00:16.647 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.y] 2024-03-18T15:00:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDgVvhlw9dILRAAdahzLC2rEtUcp9Pq3jzZ1A== 2024-03-18T15:00:16.647 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.a] 2024-03-18T15:00:16.647 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDgVvhlxHu5NBAAQDO0+YDYTZYubWtt961hSw== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.c] 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhlDtGOABAA8W43KXoCrFJo/lD0+CZtUw== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.0] 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDkVvhlgy77LBAAOT3tS/nz1OPp3dlANETZLg== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.1] 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDnVvhl9hnXKxAA51YEpjT3ypiIqzAOdg7uXg== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.2] 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDqVvhloQPHKRAAEy+1Cxfay5nca0EU5mW8qA== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.3] 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDtVvhlpiRTKBAAU7Iqk1iMXltq9LXiLnfBVQ== 2024-03-18T15:00:16.648 INFO:teuthology.orchestra.run.smithi152.stdout:[mgr.x] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDgVvhljg0mMRAAjDsLwj8NGVcUYGkkr/0Nvw== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.b] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhls6mbBRAAZ4Nr5NlgZ70Bngn1k9T5KA== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[mds.d] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhlNf31DBAASIaC2y/PkxRUP4XUpHbwqA== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.4] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDzVvhlWlFSLRAAejetEweZdqWyxHFjEtd6zQ== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.5] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQD2VvhlMNSZKxAAybVmPznwJi6hKt1IMagBrg== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.6] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQD5VvhlRDSWKhAAKYsPNsMATuaopldHyqfNUQ== 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout:[osd.7] 2024-03-18T15:00:16.649 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQD8VvhlyA1aKBAAVGITniwrnRbePLMbzx134w== 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhl0cU9ERAACsAQRXNU45kokSZDXpm31Q== 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout:[client.2] 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhlvBsRFxAAVmtuUSmUl0vVMmHwjphDrw== 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout:[client.1] 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhlRtKVGhAANXjy4hzPgXOyNds0iIS1cA== 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout:[client.3] 2024-03-18T15:00:16.650 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhl3FR2IBAADZYu6kqnB3gxDxbVoACV6w== 2024-03-18T15:00:16.669 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.y] 2024-03-18T15:00:16.669 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDgVvhlw9dILRAAdahzLC2rEtUcp9Pq3jzZ1A== 2024-03-18T15:00:16.669 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-03-18T15:00:16.669 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDgVvhlxHu5NBAAQDO0+YDYTZYubWtt961hSw== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhlDtGOABAA8W43KXoCrFJo/lD0+CZtUw== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.0] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDkVvhlgy77LBAAOT3tS/nz1OPp3dlANETZLg== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.1] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDnVvhl9hnXKxAA51YEpjT3ypiIqzAOdg7uXg== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.2] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDqVvhloQPHKRAAEy+1Cxfay5nca0EU5mW8qA== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.3] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDtVvhlpiRTKBAAU7Iqk1iMXltq9LXiLnfBVQ== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr.x] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDgVvhljg0mMRAAjDsLwj8NGVcUYGkkr/0Nvw== 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-03-18T15:00:16.670 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhls6mbBRAAZ4Nr5NlgZ70Bngn1k9T5KA== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.d] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhlNf31DBAASIaC2y/PkxRUP4XUpHbwqA== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.4] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDzVvhlWlFSLRAAejetEweZdqWyxHFjEtd6zQ== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.5] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQD2VvhlMNSZKxAAybVmPznwJi6hKt1IMagBrg== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.6] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQD5VvhlRDSWKhAAKYsPNsMATuaopldHyqfNUQ== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[osd.7] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQD8VvhlyA1aKBAAVGITniwrnRbePLMbzx134w== 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout:[client.0] 2024-03-18T15:00:16.671 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhl0cU9ERAACsAQRXNU45kokSZDXpm31Q== 2024-03-18T15:00:16.672 INFO:teuthology.orchestra.run.smithi186.stdout:[client.2] 2024-03-18T15:00:16.672 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhlvBsRFxAAVmtuUSmUl0vVMmHwjphDrw== 2024-03-18T15:00:16.672 INFO:teuthology.orchestra.run.smithi186.stdout:[client.1] 2024-03-18T15:00:16.672 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhlRtKVGhAANXjy4hzPgXOyNds0iIS1cA== 2024-03-18T15:00:16.673 INFO:teuthology.orchestra.run.smithi186.stdout:[client.3] 2024-03-18T15:00:16.673 INFO:teuthology.orchestra.run.smithi186.stdout: key = AQDhVvhl3FR2IBAADZYu6kqnB3gxDxbVoACV6w== 2024-03-18T15:00:16.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T15:00:16.694 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T15:00:16.768 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:16.770 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:16.825 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:16.827 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:16.882 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:16.884 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:16.935 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:16.938 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:16.989 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:16.993 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.045 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.047 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.099 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T15:00:17.102 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-03-18T15:00:17.154 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:17.156 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:17.211 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:17.213 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-03-18T15:00:17.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.271 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.323 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.325 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.379 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.433 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-03-18T15:00:17.485 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.487 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.545 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.602 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.657 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-03-18T15:00:17.715 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-03-18T15:00:17.715 DEBUG:teuthology.orchestra.run.smithi152:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-03-18T15:00:17.742 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T15:00:17.839 DEBUG:teuthology.orchestra.run.smithi152:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-03-18T15:00:17.866 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-03-18T15:00:17.894 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T15:00:17.992 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-03-18T15:00:18.018 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-03-18T15:00:18.085 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-03-18T15:00:18.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-03-18T15:00:18.210 DEBUG:teuthology.orchestra.run.smithi152:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:18.212 DEBUG:teuthology.orchestra.run.smithi186:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-03-18T15:00:18.266 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-03-18T15:00:18.267 INFO:tasks.ceph.mon.a:Restarting daemon 2024-03-18T15:00:18.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-03-18T15:00:18.269 INFO:tasks.ceph.mon.a:Started 2024-03-18T15:00:18.270 INFO:tasks.ceph.mon.b:Restarting daemon 2024-03-18T15:00:18.270 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-03-18T15:00:18.309 INFO:tasks.ceph.mon.b:Started 2024-03-18T15:00:18.309 INFO:tasks.ceph.mon.c:Restarting daemon 2024-03-18T15:00:18.310 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-03-18T15:00:18.311 INFO:tasks.ceph.mon.c:Started 2024-03-18T15:00:18.311 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-03-18T15:00:18.312 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-03-18T15:00:18.312 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-03-18T15:00:18.314 INFO:tasks.ceph.mgr.y:Started 2024-03-18T15:00:18.314 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-03-18T15:00:18.314 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-03-18T15:00:18.316 INFO:tasks.ceph.mgr.x:Started 2024-03-18T15:00:18.316 INFO:tasks.ceph:Setting crush tunables to default 2024-03-18T15:00:18.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph osd crush tunables default 2024-03-18T15:00:18.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.426+0000 7f6eb8b0c640 1 Processor -- start 2024-03-18T15:00:18.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.426+0000 7f6eb8b0c640 1 -- start start 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb8b0c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb8b0c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb40d2e10 con 0x7f6eb40b4d80 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb8b0c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb40d02f0 con 0x7f6eb415eaa0 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb8b0c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb40d4c10 con 0x7f6eb415e6c0 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb2d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6eb40b4d80 0x7f6eb40d2700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:48286/0 (socket says 172.21.15.152:48286) 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb2d9d640 1 -- 172.21.15.152:0/1975929080 learned_addr learned my addr 172.21.15.152:0/1975929080 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:18.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.427+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T15:00:18.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.628+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:18.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.628+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:18.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.628+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:18.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.628+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:18.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:18.628+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T15:00:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.029+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.029+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.029+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.029+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:19.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.029+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T15:00:19.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.831+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:19.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.831+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:19.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.831+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:19.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.831+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:19.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:19.831+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T15:00:21.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 msgr2=0x7f6eb40d09c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:21.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6eb415e6c0 0x7f6eb40d09c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:21.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 >> v1:172.21.15.186:6789/0 conn(0x7f6eb415eaa0 legacy=0x7f6eb40d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 >> v1:172.21.15.152:6789/0 conn(0x7f6eb40b4d80 legacy=0x7f6eb40d2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb40d4c10 con 0x7f6e940036e0 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6e94008d70 con 0x7f6e94006180 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T15:00:21.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T15:00:21.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:21.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:21.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.428+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-03-18T15:00:21.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:21.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:21.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:21.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:21.629+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-03-18T15:00:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:22.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.030+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-03-18T15:00:22.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:22.832+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-03-18T15:00:24.105 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.102+0000 7fe8a0445040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T15:00:24.123 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.123+0000 7f2ef0a45040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-03-18T15:00:24.156 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.156+0000 7fe8a0445040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T15:00:24.177 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.176+0000 7f2ef0a45040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-03-18T15:00:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 msgr2=0x7f6e94008640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e94006180 0x7f6e94008640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 msgr2=0x7f6e94005b60 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e940036e0 0x7f6e94005b60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eb2d9d640 1 -- 172.21.15.152:0/1975929080 reap_dead start 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e94003b50 0x7f6e94006630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.428+0000 7f6eabfff640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6e940086d0 0x7f6e9400d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6eb40d4ef0 con 0x7f6e94006b70 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6eb40d4c10 con 0x7f6e94003b50 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eabfff640 1 -- 172.21.15.152:0/1975929080 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6e94008d70 con 0x7f6e940086d0 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.152:3300/0 conn(0x7f6e94003b50 0x7f6e94006630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb2d9d640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6e940086d0 0x7f6e9400d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6e940086d0 msgr2=0x7f6e9400d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6e940086d0 0x7f6e9400d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 >> v1:172.21.15.186:6789/0 conn(0x7f6e94006b70 legacy=0x7f6e94006f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.429+0000 7f6eb259c640 1 -- 172.21.15.152:0/1975929080 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e9400e9b0 con 0x7f6e94003b50 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.430+0000 7f6eb259c640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94003b50 0x7f6e94006630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e940086a0 tx=0x7f6ea402df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac59f7cb5bd1814e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:24.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.430+0000 7f6eb159a640 1 -- 172.21.15.152:0/1975929080 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4034070 con 0x7f6e94003b50 2024-03-18T15:00:24.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.430+0000 7f6eb159a640 1 -- 172.21.15.152:0/1975929080 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6ea402ecf0 con 0x7f6e94003b50 2024-03-18T15:00:24.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.430+0000 7f6eb159a640 1 -- 172.21.15.152:0/1975929080 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea4038640 con 0x7f6e94003b50 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/1975929080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94003b50 msgr2=0x7f6e94006630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94003b50 0x7f6e94006630 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f6e940086a0 tx=0x7f6ea402df40 comp rx=0 tx=0).stop 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/1975929080 shutdown_connections 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/1975929080 >> v2:172.21.15.186:3300/0 conn(0x7f6e940086d0 0x7f6e9400d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/1975929080 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94003b50 0x7f6e94006630 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/1975929080 >> 172.21.15.152:0/1975929080 conn(0x7f6eb40d40f0 msgr2=0x7f6eb40d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/1975929080 shutdown_connections 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.431+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/1975929080 wait complete. 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.432+0000 7f6eb8b0c640 1 Processor -- start 2024-03-18T15:00:24.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.432+0000 7f6eb8b0c640 1 -- start start 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e94003b50 0x7f6eb40b6d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e940086d0 0x7f6eb4157c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb40cf7c0 con 0x7f6e94006b70 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb40cfdd0 con 0x7f6e94003b50 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb8b0c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6eb40d18b0 con 0x7f6e940086d0 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58120/0 (socket says 172.21.15.152:58120) 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/2754063069 learned_addr learned my addr 172.21.15.152:0/2754063069 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb2d9d640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e940086d0 0x7f6eb4157c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb259c640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e94003b50 0x7f6eb40b6d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e940086d0 msgr2=0x7f6eb4157c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e940086d0 0x7f6eb4157c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e94003b50 msgr2=0x7f6eb40b6d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e94003b50 0x7f6eb40b6d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.433+0000 7f6eb1d9b640 1 -- 172.21.15.152:0/2754063069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb4158980 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eb1d9b640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003f80 tx=0x7f6e9c0055e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c01b030 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e9c007030 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb4158c60 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e9c007260 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb40b8d30 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6e9c01e070 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.434+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6e9c016bf0 con 0x7f6e94006b70 2024-03-18T15:00:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.435+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb404f540 con 0x7f6e94006b70 2024-03-18T15:00:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.439+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f6e9c0074a0 con 0x7f6e94006b70 2024-03-18T15:00:24.503 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.503+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f6eb40d14d0 con 0x7f6e94006b70 2024-03-18T15:00:24.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.505+0000 7f6eaaffd640 1 -- 172.21.15.152:0/2754063069 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f6e9c0067d0 con 0x7f6e94006b70 2024-03-18T15:00:24.505 INFO:teuthology.orchestra.run.smithi152.stderr:adjusted tunables profile to default 2024-03-18T15:00:24.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 msgr2=0x7f6eb40b5e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:24.506 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c003f80 tx=0x7f6e9c0055e0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 shutdown_connections 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e940086d0 0x7f6eb4157c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e94006b70 0x7f6eb40b5e50 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 --2- 172.21.15.152:0/2754063069 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e94003b50 0x7f6eb40b6d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 >> 172.21.15.152:0/2754063069 conn(0x7f6eb40d40f0 msgr2=0x7f6eb40d3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 shutdown_connections 2024-03-18T15:00:24.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:24.506+0000 7f6eb8b0c640 1 -- 172.21.15.152:0/2754063069 wait complete. 2024-03-18T15:00:24.517 INFO:tasks.ceph:check_enable_crimson: False 2024-03-18T15:00:24.517 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-03-18T15:00:24.518 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:24.518 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-03-18T15:00:24.545 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:24.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-03-18T15:00:24.612 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:24.612 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-03-18T15:00:24.679 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:00:24.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-03-18T15:00:24.684 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.683+0000 7fe8a0445040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T15:00:24.733 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.733+0000 7f2ef0a45040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-03-18T15:00:24.737 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.736+0000 7fe8a0445040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T15:00:24.748 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:24.748 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-03-18T15:00:24.776 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:24.776 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-03-18T15:00:24.784 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.783+0000 7fe8a0445040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T15:00:24.788 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.788+0000 7f2ef0a45040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-03-18T15:00:24.810 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:24.810 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-03-18T15:00:24.833 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.832+0000 7f2ef0a45040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-03-18T15:00:24.840 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.840+0000 7fe8a0445040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T15:00:24.867 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:00:24.867 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-03-18T15:00:24.885 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.885+0000 7f2ef0a45040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-03-18T15:00:24.885 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:24.885+0000 7fe8a0445040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T15:00:24.911 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 93c5306e-a039-4e02-bb7d-cf282b2ef568 0 2024-03-18T15:00:24.928 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:24.926+0000 7f2ef0a45040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-03-18T15:00:25.007 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.007+0000 7fe8a0445040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T15:00:25.040 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.040+0000 7f2ef0a45040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-03-18T15:00:25.053 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.053+0000 7f067b73b640 1 Processor -- start 2024-03-18T15:00:25.053 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.053+0000 7f067b73b640 1 -- start start 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f067b73b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f06740cfca0 0x7f06740cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f067b73b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740cc370 con 0x7f067415b120 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f067b73b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06740cc650 con 0x7f06740cd410 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f067b73b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f06740cc930 con 0x7f06740cfca0 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0679cd8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f06740cfca0 0x7f06740cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0678cd6640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f06740cd410 0x7f067406ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:38024/0 (socket says 172.21.15.186:38024) 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0678cd6640 1 -- 172.21.15.186:0/1990769629 learned_addr learned my addr 172.21.15.186:0/1990769629 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 370846155 0 0) 0x7f06740cc650 con 0x7f06740cd410 2024-03-18T15:00:25.055 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0660003520 con 0x7f06740cd410 2024-03-18T15:00:25.056 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0679cd8640 1 -- 172.21.15.186:0/1990769629 >> v1:172.21.15.186:6789/0 conn(0x7f06740cd410 legacy=0x7f067406ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.056 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0679cd8640 1 -- 172.21.15.186:0/1990769629 >> v1:172.21.15.152:6789/0 conn(0x7f067415b120 legacy=0x7f06740cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.056 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f0679cd8640 1 -- 172.21.15.186:0/1990769629 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740ccc10 con 0x7f06740cfca0 2024-03-18T15:00:25.056 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.054+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2145137501 0 0) 0x7f06740cc370 con 0x7f067415b120 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.055+0000 7f0679cd8640 1 --2- 172.21.15.186:0/1990769629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06740cfca0 0x7f06740cbd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c02beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef39512afb1e3ef3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.055+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c039070 con 0x7f06740cfca0 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.055+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c02cc60 con 0x7f06740cfca0 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.055+0000 7f066bfff640 1 -- 172.21.15.186:0/1990769629 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c034660 con 0x7f06740cfca0 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 -- 172.21.15.186:0/1990769629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06740cfca0 msgr2=0x7f06740cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.057 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 --2- 172.21.15.186:0/1990769629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06740cfca0 0x7f06740cbd00 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c02beb0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 -- 172.21.15.186:0/1990769629 shutdown_connections 2024-03-18T15:00:25.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 --2- 172.21.15.186:0/1990769629 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06740cfca0 0x7f06740cbd00 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 -- 172.21.15.186:0/1990769629 >> 172.21.15.186:0/1990769629 conn(0x7f06740d0da0 msgr2=0x7f06740d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 -- 172.21.15.186:0/1990769629 shutdown_connections 2024-03-18T15:00:25.058 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.056+0000 7f067b73b640 1 -- 172.21.15.186:0/1990769629 wait complete. 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.057+0000 7f067b73b640 1 Processor -- start 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 -- start start 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 0x7f06740c5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06740cfca0 0x7f06741f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06740cf1e0 con 0x7f06740cfca0 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06740cf060 con 0x7f067415b120 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f067b73b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0674071d60 con 0x7f06740cd410 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f0679cd8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.061 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f0679cd8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50382/0 (socket says 172.21.15.186:50382) 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f0679cd8640 1 -- 172.21.15.186:0/3663477036 learned_addr learned my addr 172.21.15.186:0/3663477036 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f06794d7640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 0x7f06740c5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.058+0000 7f0678cd6640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06740cfca0 0x7f06741f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 -- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 msgr2=0x7f06740c5cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 0x7f06740c5cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 -- 172.21.15.186:0/3663477036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06740cfca0 msgr2=0x7f06741f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06740cfca0 0x7f06741f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 -- 172.21.15.186:0/3663477036 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06740c6460 con 0x7f067415b120 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f06794d7640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 0x7f06740c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0679cd8640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.062 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c039050 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f066c03a040 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06740c6740 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f066c009450 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06740c6d00 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f066c047020 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.059+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f066c004540 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.060+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06740701f0 con 0x7f067415b120 2024-03-18T15:00:25.063 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.062+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f06740701f0 con 0x7f067415b120 2024-03-18T15:00:25.083 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.082+0000 7fe8a0445040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T15:00:25.109 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.109+0000 7f2ef0a45040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-03-18T15:00:25.130 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.130+0000 7fe8a0445040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T15:00:25.135 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.134+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "93c5306e-a039-4e02-bb7d-cf282b2ef568", "id": 0} v 0) -- 0x7f067404f540 con 0x7f067415b120 2024-03-18T15:00:25.140 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.140+0000 7f0669ffb640 1 -- 172.21.15.186:0/3663477036 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93c5306e-a039-4e02-bb7d-cf282b2ef568", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f066c04e020 con 0x7f067415b120 2024-03-18T15:00:25.140 INFO:teuthology.orchestra.run.smithi186.stdout:0 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 msgr2=0x7f067414f870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f066c009d90 tx=0x7f066c004a40 comp rx=0 tx=0).stop 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 shutdown_connections 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f067415b120 0x7f067414f870 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06740cfca0 0x7f06741f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 --2- 172.21.15.186:0/3663477036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06740cd410 0x7f06740c5cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 >> 172.21.15.186:0/3663477036 conn(0x7f06740d0da0 msgr2=0x7f067406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 shutdown_connections 2024-03-18T15:00:25.142 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.141+0000 7f067b73b640 1 -- 172.21.15.186:0/3663477036 wait complete. 2024-03-18T15:00:25.153 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 8b4a44e2-07c8-402c-ab60-c8a51c2cbae6 1 2024-03-18T15:00:25.155 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.155+0000 7f2ef0a45040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-03-18T15:00:25.186 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.186+0000 7fe8a0445040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T15:00:25.206 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.206+0000 7f2ef0a45040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-03-18T15:00:25.235 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.235+0000 7fe8a0445040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T15:00:25.252 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.251+0000 7f7537812640 1 Processor -- start 2024-03-18T15:00:25.252 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.251+0000 7f7537812640 1 -- start start 2024-03-18T15:00:25.253 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.252+0000 7f2ef0a45040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7537812640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7537812640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 0x7f753006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7537812640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f75300cc370 con 0x7f753015b120 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7537812640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f75300cc650 con 0x7f75300cfca0 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7537812640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f75300cc930 con 0x7f75300cd410 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7534dad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7535daf640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 0x7f753006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7534dad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58150/0 (socket says 172.21.15.186:58150) 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7535daf640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 0x7f753006ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50388/0 (socket says 172.21.15.186:50388) 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.252+0000 7f7534dad640 1 -- 172.21.15.186:0/3682420940 learned_addr learned my addr 172.21.15.186:0/3682420940 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.253+0000 7f7534dad640 1 -- 172.21.15.186:0/3682420940 >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 msgr2=0x7f753006ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.253+0000 7f7534dad640 1 --2- 172.21.15.186:0/3682420940 >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 0x7f753006ddc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.253+0000 7f7534dad640 1 -- 172.21.15.186:0/3682420940 >> v1:172.21.15.152:6789/0 conn(0x7f753015b120 legacy=0x7f75300cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.253+0000 7f7534dad640 1 -- 172.21.15.186:0/3682420940 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300ccc10 con 0x7f75300cd410 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.253+0000 7f7534dad640 1 --2- 172.21.15.186:0/3682420940 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f752c009870 tx=0x7f752c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6e488a02ffc16a1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7527fff640 1 -- 172.21.15.186:0/3682420940 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c035020 con 0x7f75300cd410 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7527fff640 1 -- 172.21.15.186:0/3682420940 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c031640 con 0x7f75300cd410 2024-03-18T15:00:25.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7527fff640 1 -- 172.21.15.186:0/3682420940 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c02d040 con 0x7f75300cd410 2024-03-18T15:00:25.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 -- 172.21.15.186:0/3682420940 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 msgr2=0x7f75300cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 --2- 172.21.15.186:0/3682420940 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f752c009870 tx=0x7f752c02b8f0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 -- 172.21.15.186:0/3682420940 shutdown_connections 2024-03-18T15:00:25.256 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 --2- 172.21.15.186:0/3682420940 >> v2:172.21.15.186:3300/0 conn(0x7f75300cfca0 0x7f753006ddc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 --2- 172.21.15.186:0/3682420940 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cd410 0x7f75300cbd00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 -- 172.21.15.186:0/3682420940 >> 172.21.15.186:0/3682420940 conn(0x7f75300d0da0 msgr2=0x7f75300d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 -- 172.21.15.186:0/3682420940 shutdown_connections 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.254+0000 7f7537812640 1 -- 172.21.15.186:0/3682420940 wait complete. 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 Processor -- start 2024-03-18T15:00:25.257 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 -- start start 2024-03-18T15:00:25.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75300cd410 0x7f75301f3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.259 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f75300cf1e0 con 0x7f75300cd410 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f75300cf060 con 0x7f753015b120 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7537812640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7530071d60 con 0x7f75300cfca0 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7535daf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7534dad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7534dad640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58152/0 (socket says 172.21.15.186:58152) 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7535daf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50392/0 (socket says 172.21.15.186:50392) 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f7534dad640 1 -- 172.21.15.186:0/2860628049 learned_addr learned my addr 172.21.15.186:0/2860628049 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.256+0000 7f75355ae640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75300cd410 0x7f75301f3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 -- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 msgr2=0x7f75300d00c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 -- 172.21.15.186:0/2860628049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75300cd410 msgr2=0x7f75301f3590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75300cd410 0x7f75301f3590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.260 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 -- 172.21.15.186:0/2860628049 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75300b0180 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7535daf640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7534dad640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f752c02b930 tx=0x7f752c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c040070 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f752c03e070 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f752c035040 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75300b0460 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.257+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f75300c4c50 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.258+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f752c038020 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.258+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f752c03a420 con 0x7f75300cfca0 2024-03-18T15:00:25.261 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.258+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f753004f540 con 0x7f75300cfca0 2024-03-18T15:00:25.263 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.262+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f752c045460 con 0x7f75300cfca0 2024-03-18T15:00:25.333 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.333+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "8b4a44e2-07c8-402c-ab60-c8a51c2cbae6", "id": 1} v 0) -- 0x7f75300b2520 con 0x7f75300cfca0 2024-03-18T15:00:25.339 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.339+0000 7f7525ffb640 1 -- 172.21.15.186:0/2860628049 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8b4a44e2-07c8-402c-ab60-c8a51c2cbae6", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f752c039c10 con 0x7f75300cfca0 2024-03-18T15:00:25.339 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-03-18T15:00:25.341 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 msgr2=0x7f75300af950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.341 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f752c02b930 tx=0x7f752c0046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.341 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 shutdown_connections 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f753015b120 0x7f75300d00c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f75300cfca0 0x7f75300af950 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 --2- 172.21.15.186:0/2860628049 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f75300cd410 0x7f75301f3590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 >> 172.21.15.186:0/2860628049 conn(0x7f75300d0da0 msgr2=0x7f75300b1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 shutdown_connections 2024-03-18T15:00:25.342 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.340+0000 7f7537812640 1 -- 172.21.15.186:0/2860628049 wait complete. 2024-03-18T15:00:25.351 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new d88dd052-806c-4c46-bb7f-0bc31d9917f5 2 2024-03-18T15:00:25.493 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.492+0000 7fa732027640 1 Processor -- start 2024-03-18T15:00:25.493 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.492+0000 7fa732027640 1 -- start start 2024-03-18T15:00:25.494 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa732027640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 0x7fa72c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.494 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa732027640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72c0cc370 con 0x7fa72c0cd410 2024-03-18T15:00:25.494 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa732027640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa72c0cc650 con 0x7fa72c15b120 2024-03-18T15:00:25.494 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa732027640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c0cc930 con 0x7fa72c0cfca0 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa72bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 0x7fa72c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa72b7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fa72c15b120 0x7fa72c0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.186:38030/0 (socket says 172.21.15.186:38030) 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.493+0000 7fa72b7fe640 1 -- 172.21.15.186:0/3604655404 learned_addr learned my addr 172.21.15.186:0/3604655404 (peer_addr_for_me v1:172.21.15.186:0/0) 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.494+0000 7fa72bfff640 1 -- 172.21.15.186:0/3604655404 >> v1:172.21.15.186:6789/0 conn(0x7fa72c15b120 legacy=0x7fa72c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.494+0000 7fa72bfff640 1 -- 172.21.15.186:0/3604655404 >> v1:172.21.15.152:6789/0 conn(0x7fa72c0cd410 legacy=0x7fa72c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.494+0000 7fa72a7fc640 1 -- 172.21.15.186:0/3604655404 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2824228006 0 0) 0x7fa72c0cc650 con 0x7fa72c15b120 2024-03-18T15:00:25.495 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.494+0000 7fa72bfff640 1 -- 172.21.15.186:0/3604655404 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c0ccc10 con 0x7fa72c0cfca0 2024-03-18T15:00:25.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa72bfff640 1 --2- 172.21.15.186:0/3604655404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 0x7fa72c0cbd00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa724009dc0 tx=0x7fa72402be90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98df86d1929c9569 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa72a7fc640 1 -- 172.21.15.186:0/3604655404 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724039070 con 0x7fa72c0cfca0 2024-03-18T15:00:25.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa72a7fc640 1 -- 172.21.15.186:0/3604655404 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa72402cc40 con 0x7fa72c0cfca0 2024-03-18T15:00:25.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa72a7fc640 1 -- 172.21.15.186:0/3604655404 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa724034440 con 0x7fa72c0cfca0 2024-03-18T15:00:25.496 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa732027640 1 -- 172.21.15.186:0/3604655404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 msgr2=0x7fa72c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.495+0000 7fa732027640 1 --2- 172.21.15.186:0/3604655404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 0x7fa72c0cbd00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa724009dc0 tx=0x7fa72402be90 comp rx=0 tx=0).stop 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.496+0000 7fa732027640 1 -- 172.21.15.186:0/3604655404 shutdown_connections 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.496+0000 7fa732027640 1 --2- 172.21.15.186:0/3604655404 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cfca0 0x7fa72c0cbd00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.496+0000 7fa732027640 1 -- 172.21.15.186:0/3604655404 >> 172.21.15.186:0/3604655404 conn(0x7fa72c0d0da0 msgr2=0x7fa72c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.496+0000 7fa732027640 1 -- 172.21.15.186:0/3604655404 shutdown_connections 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.496+0000 7fa732027640 1 -- 172.21.15.186:0/3604655404 wait complete. 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.497+0000 7fa732027640 1 Processor -- start 2024-03-18T15:00:25.497 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.497+0000 7fa732027640 1 -- start start 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa72c15b120 0x7fa72c1f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c0cf1e0 con 0x7fa72c15b120 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa72c0cf060 con 0x7fa72c0cfca0 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa732027640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa72c071d60 con 0x7fa72c0cd410 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.500 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58172/0 (socket says 172.21.15.186:58172) 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50394/0 (socket says 172.21.15.186:50394) 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72b7fe640 1 -- 172.21.15.186:0/3451882034 learned_addr learned my addr 172.21.15.186:0/3451882034 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72bfff640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa72c15b120 0x7fa72c1f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 -- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 msgr2=0x7fa72c0ca8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 -- 172.21.15.186:0/3451882034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa72c15b120 msgr2=0x7fa72c1f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa72c15b120 0x7fa72c1f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 -- 172.21.15.186:0/3451882034 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa72c0cee70 con 0x7fa72c0cfca0 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72b7fe640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa72affd640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0cd7f0 tx=0x7fa71c00c820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.498+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c017070 con 0x7fa72c0cfca0 2024-03-18T15:00:25.501 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c0052d0 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa72c0c7720 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c003830 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa72c0b54e0 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa71c01a070 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.499+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fa71c012420 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.500+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa72c04f540 con 0x7fa72c0cfca0 2024-03-18T15:00:25.502 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.502+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fa71c021070 con 0x7fa72c0cfca0 2024-03-18T15:00:25.573 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.572+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d88dd052-806c-4c46-bb7f-0bc31d9917f5", "id": 2} v 0) -- 0x7fa72c0c4010 con 0x7fa72c0cfca0 2024-03-18T15:00:25.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.578+0000 7fa713fff640 1 -- 172.21.15.186:0/3451882034 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d88dd052-806c-4c46-bb7f-0bc31d9917f5", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fa71c0115d0 con 0x7fa72c0cfca0 2024-03-18T15:00:25.579 INFO:teuthology.orchestra.run.smithi186.stdout:2 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 msgr2=0x7fa72c14b2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fa72c0cd7f0 tx=0x7fa71c00c820 comp rx=0 tx=0).stop 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 shutdown_connections 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa72c15b120 0x7fa72c1f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa72c0cfca0 0x7fa72c14b2e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 --2- 172.21.15.186:0/3451882034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa72c0cd410 0x7fa72c0ca8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 >> 172.21.15.186:0/3451882034 conn(0x7fa72c0d0da0 msgr2=0x7fa72c0cf360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 shutdown_connections 2024-03-18T15:00:25.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.579+0000 7fa732027640 1 -- 172.21.15.186:0/3451882034 wait complete. 2024-03-18T15:00:25.590 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 462bf08e-cd41-4ad5-9df5-8a0ed49d2dce 3 2024-03-18T15:00:25.627 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.627+0000 7f2ef0a45040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-18T15:00:25.639 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.638+0000 7fe8a0445040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-03-18T15:00:25.690 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.690+0000 7fbff759e640 1 Processor -- start 2024-03-18T15:00:25.691 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.690+0000 7fbff759e640 1 -- start start 2024-03-18T15:00:25.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff759e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbff815fa70 0x7fbff806b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff759e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbff806fad0 con 0x7fbff806bc40 2024-03-18T15:00:25.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff759e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbff806dc90 con 0x7fbff815fa70 2024-03-18T15:00:25.692 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbff806df70 con 0x7fbff81459f0 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58176/0 (socket says 172.21.15.186:58176) 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 -- 172.21.15.186:0/1484858786 learned_addr learned my addr 172.21.15.186:0/1484858786 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff5d9b640 1 --2- 172.21.15.186:0/1484858786 >> v2:172.21.15.152:3300/0 conn(0x7fbff815fa70 0x7fbff806b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 -- 172.21.15.186:0/1484858786 >> v2:172.21.15.152:3300/0 conn(0x7fbff815fa70 msgr2=0x7fbff806b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 --2- 172.21.15.186:0/1484858786 >> v2:172.21.15.152:3300/0 conn(0x7fbff815fa70 0x7fbff806b700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.693 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 -- 172.21.15.186:0/1484858786 >> v1:172.21.15.152:6789/0 conn(0x7fbff806bc40 legacy=0x7fbff8071c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.694 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.691+0000 7fbff659c640 1 -- 172.21.15.186:0/1484858786 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff806e250 con 0x7fbff81459f0 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.692+0000 7fbff659c640 1 --2- 172.21.15.186:0/1484858786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009870 tx=0x7fbfe802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ced528a65d6e5847 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.692+0000 7fbff559a640 1 -- 172.21.15.186:0/1484858786 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8034070 con 0x7fbff81459f0 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.692+0000 7fbff559a640 1 -- 172.21.15.186:0/1484858786 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbfe8030840 con 0x7fbff81459f0 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.692+0000 7fbff559a640 1 -- 172.21.15.186:0/1484858786 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfe8030c10 con 0x7fbff81459f0 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 -- 172.21.15.186:0/1484858786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 msgr2=0x7fbff806b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.701 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 --2- 172.21.15.186:0/1484858786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fbfe8009870 tx=0x7fbfe802b980 comp rx=0 tx=0).stop 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 -- 172.21.15.186:0/1484858786 shutdown_connections 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 --2- 172.21.15.186:0/1484858786 >> v2:172.21.15.152:3300/0 conn(0x7fbff815fa70 0x7fbff806b700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 --2- 172.21.15.186:0/1484858786 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff81459f0 0x7fbff806b1c0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 -- 172.21.15.186:0/1484858786 >> 172.21.15.186:0/1484858786 conn(0x7fbff80b27a0 msgr2=0x7fbff80b2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 -- 172.21.15.186:0/1484858786 shutdown_connections 2024-03-18T15:00:25.702 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.693+0000 7fbff759e640 1 -- 172.21.15.186:0/1484858786 wait complete. 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.694+0000 7fbff759e640 1 Processor -- start 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.694+0000 7fbff759e640 1 -- start start 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 0x7fbff813da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbff81459f0 0x7fbff815ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 0x7fbff81e7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.703 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbff806eaf0 con 0x7fbff81459f0 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbff806e810 con 0x7fbff806bc40 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbff80d0240 con 0x7fbff815fa70 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 0x7fbff813da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 0x7fbff81e7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 0x7fbff813da50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50410/0 (socket says 172.21.15.186:50410) 2024-03-18T15:00:25.704 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff659c640 1 -- 172.21.15.186:0/3932432077 learned_addr learned my addr 172.21.15.186:0/3932432077 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff5d9b640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbff81459f0 0x7fbff815ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 -- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 msgr2=0x7fbff813da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 0x7fbff813da50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 -- 172.21.15.186:0/3932432077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbff81459f0 msgr2=0x7fbff815ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbff81459f0 0x7fbff815ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.705 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 -- 172.21.15.186:0/3932432077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff813e280 con 0x7fbff815fa70 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.695+0000 7fbff6d9d640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 0x7fbff81e7aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c6c0 tx=0x7fbff000cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0003b70 con 0x7fbff815fa70 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbff0003d10 con 0x7fbff815fa70 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff813e560 con 0x7fbff815fa70 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00052f0 con 0x7fbff815fa70 2024-03-18T15:00:25.706 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff813ee00 con 0x7fbff815fa70 2024-03-18T15:00:25.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbff0005490 con 0x7fbff815fa70 2024-03-18T15:00:25.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.696+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fbff0012940 con 0x7fbff815fa70 2024-03-18T15:00:25.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.697+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff813f000 con 0x7fbff815fa70 2024-03-18T15:00:25.707 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.699+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7fbff813f000 con 0x7fbff815fa70 2024-03-18T15:00:25.760 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.760+0000 7f2ef0a45040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T15:00:25.771 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.770+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "462bf08e-cd41-4ad5-9df5-8a0ed49d2dce", "id": 3} v 0) -- 0x7fbff80755f0 con 0x7fbff815fa70 2024-03-18T15:00:25.776 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.776+0000 7fbfe6ffd640 1 -- 172.21.15.186:0/3932432077 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "462bf08e-cd41-4ad5-9df5-8a0ed49d2dce", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fbff0012be0 con 0x7fbff815fa70 2024-03-18T15:00:25.777 INFO:teuthology.orchestra.run.smithi186.stdout:3 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 msgr2=0x7fbff81e7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 0x7fbff81e7aa0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c6c0 tx=0x7fbff000cb80 comp rx=0 tx=0).stop 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 shutdown_connections 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbff815fa70 0x7fbff81e7aa0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbff81459f0 0x7fbff815ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 --2- 172.21.15.186:0/3932432077 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbff806bc40 0x7fbff813da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 >> 172.21.15.186:0/3932432077 conn(0x7fbff80b27a0 msgr2=0x7fbff8071c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 shutdown_connections 2024-03-18T15:00:25.778 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.777+0000 7fbff759e640 1 -- 172.21.15.186:0/3932432077 wait complete. 2024-03-18T15:00:25.779 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.779+0000 7fe8a0445040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-03-18T15:00:25.788 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new d38e1761-b438-46fc-840f-626022d011c1 4 2024-03-18T15:00:25.887 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.887+0000 7f2ef0a45040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T15:00:25.888 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.888+0000 7f3bdd4a1640 1 Processor -- start 2024-03-18T15:00:25.888 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.888+0000 7f3bdd4a1640 1 -- start start 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bdd4a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bdd4a1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bd80ce840 0x7f3bd80ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bdd4a1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3bd80cce20 con 0x7f3bd80b7110 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bdd4a1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3bd80cf1e0 con 0x7f3bd80ce840 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bdd4a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd80cd100 con 0x7f3bd815c140 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58196/0 (socket says 172.21.15.186:58196) 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 -- 172.21.15.186:0/3986853318 learned_addr learned my addr 172.21.15.186:0/3986853318 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.890 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd67fc640 1 --2- 172.21.15.186:0/3986853318 >> v2:172.21.15.152:3300/0 conn(0x7f3bd80ce840 0x7f3bd80ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 -- 172.21.15.186:0/3986853318 >> v2:172.21.15.152:3300/0 conn(0x7f3bd80ce840 msgr2=0x7f3bd80ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:25.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 --2- 172.21.15.186:0/3986853318 >> v2:172.21.15.152:3300/0 conn(0x7f3bd80ce840 0x7f3bd80ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 -- 172.21.15.186:0/3986853318 >> v1:172.21.15.152:6789/0 conn(0x7f3bd80b7110 legacy=0x7f3bd80b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.891 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.889+0000 7f3bd6ffd640 1 -- 172.21.15.186:0/3986853318 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80cd3e0 con 0x7f3bd815c140 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.890+0000 7f3bd6ffd640 1 --2- 172.21.15.186:0/3986853318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009870 tx=0x7f3bcc02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e64d1c5907cf7b18 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.890+0000 7f3bd5ffb640 1 -- 172.21.15.186:0/3986853318 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc034070 con 0x7f3bd815c140 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.890+0000 7f3bd5ffb640 1 -- 172.21.15.186:0/3986853318 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bcc030840 con 0x7f3bd815c140 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.890+0000 7f3bd5ffb640 1 -- 172.21.15.186:0/3986853318 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bcc030c10 con 0x7f3bd815c140 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3986853318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 msgr2=0x7f3bd80d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3986853318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3bcc009870 tx=0x7f3bcc02b980 comp rx=0 tx=0).stop 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3986853318 shutdown_connections 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3986853318 >> v2:172.21.15.152:3300/0 conn(0x7f3bd80ce840 0x7f3bd80ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3986853318 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80d08c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3986853318 >> 172.21.15.186:0/3986853318 conn(0x7f3bd809b160 msgr2=0x7f3bd80d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3986853318 shutdown_connections 2024-03-18T15:00:25.893 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.891+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3986853318 wait complete. 2024-03-18T15:00:25.894 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.892+0000 7f3bdd4a1640 1 Processor -- start 2024-03-18T15:00:25.894 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.892+0000 7f3bdd4a1640 1 -- start start 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 0x7f3bd81f2160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 0x7f3bd80c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80b7cb0 con 0x7f3bd80ce840 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3bd80cd9a0 con 0x7f3bd80b7110 2024-03-18T15:00:25.896 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bdd4a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3bd80d0e00 con 0x7f3bd815c140 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 0x7f3bd81f2160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd6ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 0x7f3bd81f2160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50420/0 (socket says 172.21.15.186:50420) 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58208/0 (socket says 172.21.15.186:58208) 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd6ffd640 1 -- 172.21.15.186:0/3869855965 learned_addr learned my addr 172.21.15.186:0/3869855965 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd67fc640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 0x7f3bd80c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 -- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 msgr2=0x7f3bd81f2160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 0x7f3bd81f2160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 -- 172.21.15.186:0/3869855965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 msgr2=0x7f3bd80c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 0x7f3bd80c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd77fe640 1 -- 172.21.15.186:0/3869855965 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bd80c88d0 con 0x7f3bd815c140 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.893+0000 7f3bd67fc640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 0x7f3bd80c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bd77fe640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000c760 tx=0x7f3bd000cc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:25.897 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0016020 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3bd0006d50 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bd0003bb0 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bd80c85f0 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bd80c9b50 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3bd0005460 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.894+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f3bd0005750 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.895+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bd80ca040 con 0x7f3bd815c140 2024-03-18T15:00:25.898 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.897+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f3bd0020020 con 0x7f3bd815c140 2024-03-18T15:00:25.903 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.903+0000 7fe8a0445040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-03-18T15:00:25.932 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:25.932+0000 7f2ef0a45040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T15:00:25.949 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:25.949+0000 7fe8a0445040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-03-18T15:00:25.967 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.967+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "d38e1761-b438-46fc-840f-626022d011c1", "id": 4} v 0) -- 0x7f3bd80b78b0 con 0x7f3bd815c140 2024-03-18T15:00:25.976 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.975+0000 7f3bbf7fe640 1 -- 172.21.15.186:0/3869855965 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d38e1761-b438-46fc-840f-626022d011c1", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f3bd0003d50 con 0x7f3bd815c140 2024-03-18T15:00:25.976 INFO:teuthology.orchestra.run.smithi186.stdout:4 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 msgr2=0x7f3bd80c5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f3bd000c760 tx=0x7f3bd000cc20 comp rx=0 tx=0).stop 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 shutdown_connections 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bd815c140 0x7f3bd80c5af0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bd80ce840 0x7f3bd80c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 --2- 172.21.15.186:0/3869855965 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bd80b7110 0x7f3bd81f2160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.976+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 >> 172.21.15.186:0/3869855965 conn(0x7f3bd809b160 msgr2=0x7f3bd80b5350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.977+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 shutdown_connections 2024-03-18T15:00:25.978 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:25.977+0000 7f3bdd4a1640 1 -- 172.21.15.186:0/3869855965 wait complete. 2024-03-18T15:00:25.987 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new e6693b7d-6381-4d7c-9769-70e5ec2ff9cd 5 2024-03-18T15:00:26.043 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:26.043+0000 7f2ef0a45040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T15:00:26.067 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:26.066+0000 7fe8a0445040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-03-18T15:00:26.088 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.087+0000 7f5a9cb9f640 1 Processor -- start 2024-03-18T15:00:26.088 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.087+0000 7f5a9cb9f640 1 -- start start 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a9cb9f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5a9806c2e0 0x7f5a980b1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a9cb9f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a98073280 0x7f5a980b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a9cb9f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a980d0ca0 con 0x7f5a980d08c0 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a9cb9f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5a980b5970 con 0x7f5a9806c2e0 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a9cb9f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5a980b1c00 con 0x7f5a98073280 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a98073280 0x7f5a980b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a98073280 0x7f5a980b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50436/0 (socket says 172.21.15.186:50436) 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 -- 172.21.15.186:0/836613506 learned_addr learned my addr 172.21.15.186:0/836613506 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a8ffff640 1 --2- 172.21.15.186:0/836613506 >> v2:172.21.15.152:3300/0 conn(0x7f5a9806c2e0 0x7f5a980b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.090 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 -- 172.21.15.186:0/836613506 >> v2:172.21.15.152:3300/0 conn(0x7f5a9806c2e0 msgr2=0x7f5a980b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 --2- 172.21.15.186:0/836613506 >> v2:172.21.15.152:3300/0 conn(0x7f5a9806c2e0 0x7f5a980b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.088+0000 7f5a97fff640 1 -- 172.21.15.186:0/836613506 >> v1:172.21.15.152:6789/0 conn(0x7f5a980d08c0 legacy=0x7f5a9806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.089+0000 7f5a97fff640 1 -- 172.21.15.186:0/836613506 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a980b5040 con 0x7f5a98073280 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.089+0000 7f5a97fff640 1 --2- 172.21.15.186:0/836613506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a98073280 0x7f5a980b5e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a980cdd90 tx=0x7f5a9002bf80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c0404ab878e70a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.089+0000 7f5a96ffd640 1 -- 172.21.15.186:0/836613506 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a9002cb20 con 0x7f5a98073280 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.089+0000 7f5a96ffd640 1 -- 172.21.15.186:0/836613506 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a9002ccc0 con 0x7f5a98073280 2024-03-18T15:00:26.091 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.089+0000 7f5a96ffd640 1 -- 172.21.15.186:0/836613506 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a90034610 con 0x7f5a98073280 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/836613506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a98073280 msgr2=0x7f5a980b5e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/836613506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a98073280 0x7f5a980b5e00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a980cdd90 tx=0x7f5a9002bf80 comp rx=0 tx=0).stop 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/836613506 shutdown_connections 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/836613506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a98073280 0x7f5a980b5e00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/836613506 >> v2:172.21.15.152:3300/0 conn(0x7f5a9806c2e0 0x7f5a980b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/836613506 >> 172.21.15.186:0/836613506 conn(0x7f5a98072760 msgr2=0x7f5a98072b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/836613506 shutdown_connections 2024-03-18T15:00:26.094 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.090+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/836613506 wait complete. 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.091+0000 7f5a9cb9f640 1 Processor -- start 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.091+0000 7f5a9cb9f640 1 -- start start 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a98073280 0x7f5a980997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 0x7f5a980b1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a9806b8b0 con 0x7f5a98073280 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5a980b5600 con 0x7f5a980d08c0 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a9cb9f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a98066f10 con 0x7f5a9806c2e0 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a97fff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 0x7f5a980b1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.186:58216/0 (socket says 172.21.15.186:58216) 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 -- 172.21.15.186:0/2620390539 learned_addr learned my addr 172.21.15.186:0/2620390539 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a8ffff640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a98073280 0x7f5a980997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 -- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 msgr2=0x7f5a980b1d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.095 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 0x7f5a980b1d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 -- 172.21.15.186:0/2620390539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a98073280 msgr2=0x7f5a980997e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a98073280 0x7f5a980997e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.092+0000 7f5a977fe640 1 -- 172.21.15.186:0/2620390539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a980c61b0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a97fff640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 0x7f5a980b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a977fe640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c3c0 tx=0x7f5a8800c880 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a880052d0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a88005490 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a88007260 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a980c6490 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.093+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a981554d0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.094+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a88007400 con 0x7f5a9806c2e0 2024-03-18T15:00:26.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.094+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f5a88011590 con 0x7f5a9806c2e0 2024-03-18T15:00:26.097 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.094+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a980755f0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.097 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.096+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5a980d0ca0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.137 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:26.137+0000 7f2ef0a45040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T15:00:26.212 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:26.211+0000 7fe8a0445040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-03-18T15:00:26.247 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.246+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd new", "uuid": "e6693b7d-6381-4d7c-9769-70e5ec2ff9cd", "id": 5} v 0) -- 0x7f5a980c69b0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.253 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.252+0000 7f5a94ff9640 1 -- 172.21.15.186:0/2620390539 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e6693b7d-6381-4d7c-9769-70e5ec2ff9cd", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f5a880035f0 con 0x7f5a9806c2e0 2024-03-18T15:00:26.253 INFO:teuthology.orchestra.run.smithi186.stdout:5 2024-03-18T15:00:26.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 msgr2=0x7f5a98154f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f5a8800c3c0 tx=0x7f5a8800c880 comp rx=0 tx=0).stop 2024-03-18T15:00:26.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 shutdown_connections 2024-03-18T15:00:26.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a980d08c0 0x7f5a980b1d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.254 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a98073280 0x7f5a980997e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 --2- 172.21.15.186:0/2620390539 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a9806c2e0 0x7f5a98154f90 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 >> 172.21.15.186:0/2620390539 conn(0x7f5a98072760 msgr2=0x7f5a9815a000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 shutdown_connections 2024-03-18T15:00:26.255 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.253+0000 7f5a9cb9f640 1 -- 172.21.15.186:0/2620390539 wait complete. 2024-03-18T15:00:26.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 99946048-348e-47d6-b454-73a71f5803ce 6 2024-03-18T15:00:26.289 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:26.289+0000 7f2ef0a45040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T15:00:26.331 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:26.331+0000 7f2ef0a45040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T15:00:26.364 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.364+0000 7f76550d1640 1 Processor -- start 2024-03-18T15:00:26.364 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.364+0000 7f76550d1640 1 -- start start 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f76550d1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76500b0150 0x7f76500ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f76550d1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f765006b8d0 0x7f765015da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f76550d1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7650071ee0 con 0x7f76500ceeb0 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f76550d1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7650072af0 con 0x7f765006b8d0 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f76550d1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f76500721c0 con 0x7f76500b0150 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76500b0150 0x7f76500ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76500b0150 0x7f76500ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50458/0 (socket says 172.21.15.186:50458) 2024-03-18T15:00:26.366 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 -- 172.21.15.186:0/1845455352 learned_addr learned my addr 172.21.15.186:0/1845455352 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764f59e640 1 --2- 172.21.15.186:0/1845455352 >> v2:172.21.15.152:3300/0 conn(0x7f765006b8d0 0x7f765015da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 -- 172.21.15.186:0/1845455352 >> v2:172.21.15.152:3300/0 conn(0x7f765006b8d0 msgr2=0x7f765015da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 --2- 172.21.15.186:0/1845455352 >> v2:172.21.15.152:3300/0 conn(0x7f765006b8d0 0x7f765015da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 -- 172.21.15.186:0/1845455352 >> v1:172.21.15.186:6789/0 conn(0x7f76500ceeb0 legacy=0x7f765006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764ed9d640 1 -- 172.21.15.186:0/1845455352 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76500724a0 con 0x7f76500b0150 2024-03-18T15:00:26.367 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.365+0000 7f764dd9b640 1 -- 172.21.15.186:0/1845455352 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1871794482 0 0) 0x7f7650071ee0 con 0x7f76500ceeb0 2024-03-18T15:00:26.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.366+0000 7f764ed9d640 1 --2- 172.21.15.186:0/1845455352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76500ce970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76500c7e20 tx=0x7f764002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=95f80e8649256bc1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.368 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.366+0000 7f764dd9b640 1 -- 172.21.15.186:0/1845455352 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640035020 con 0x7f76500b0150 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.366+0000 7f764dd9b640 1 -- 172.21.15.186:0/1845455352 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7640031870 con 0x7f76500b0150 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.366+0000 7f764dd9b640 1 -- 172.21.15.186:0/1845455352 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7640031c40 con 0x7f76500b0150 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 -- 172.21.15.186:0/1845455352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 msgr2=0x7f76500ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 --2- 172.21.15.186:0/1845455352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76500ce970 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f76500c7e20 tx=0x7f764002b910 comp rx=0 tx=0).stop 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 -- 172.21.15.186:0/1845455352 shutdown_connections 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 --2- 172.21.15.186:0/1845455352 >> v2:172.21.15.152:3300/0 conn(0x7f765006b8d0 0x7f765015da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 --2- 172.21.15.186:0/1845455352 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76500ce970 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 -- 172.21.15.186:0/1845455352 >> 172.21.15.186:0/1845455352 conn(0x7f76500d0da0 msgr2=0x7f76500d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 -- 172.21.15.186:0/1845455352 shutdown_connections 2024-03-18T15:00:26.369 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.367+0000 7f76550d1640 1 -- 172.21.15.186:0/1845455352 wait complete. 2024-03-18T15:00:26.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.368+0000 7f76550d1640 1 Processor -- start 2024-03-18T15:00:26.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.368+0000 7f76550d1640 1 -- start start 2024-03-18T15:00:26.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 0x7f76500c9de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.372 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76500ceeb0 0x7f76501f4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76500b0530 con 0x7f76500ceeb0 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f76500d0900 con 0x7f76500b0150 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f76550d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76500b06b0 con 0x7f765006b8d0 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f764e59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f764ed9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 0x7f76500c9de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f764e59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50472/0 (socket says 172.21.15.186:50472) 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f764e59c640 1 -- 172.21.15.186:0/619452903 learned_addr learned my addr 172.21.15.186:0/619452903 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.369+0000 7f764f59e640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76500ceeb0 0x7f76501f4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 -- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 msgr2=0x7f76500c9de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 0x7f76500c9de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 -- 172.21.15.186:0/619452903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76500ceeb0 msgr2=0x7f76501f4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76500ceeb0 0x7f76501f4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.373 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 -- 172.21.15.186:0/619452903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76501f1510 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764ed9d640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 0x7f76500c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f764e59c640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f764400c410 tx=0x7f764400c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7644017070 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76440035f0 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76500cacf0 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76440039e0 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76500c5ab0 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f764401a070 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.370+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f76440129f0 con 0x7f76500b0150 2024-03-18T15:00:26.374 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.371+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f765004f540 con 0x7f76500b0150 2024-03-18T15:00:26.375 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.375+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f7644021020 con 0x7f76500b0150 2024-03-18T15:00:26.388 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:26.388+0000 7fe8a0445040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-03-18T15:00:26.431 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:26.430+0000 7fe8a0445040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-03-18T15:00:26.446 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.445+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "99946048-348e-47d6-b454-73a71f5803ce", "id": 6} v 0) -- 0x7f76500cc9b0 con 0x7f76500b0150 2024-03-18T15:00:26.455 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.454+0000 7f76377fe640 1 -- 172.21.15.186:0/619452903 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "99946048-348e-47d6-b454-73a71f5803ce", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f7644003d00 con 0x7f76500b0150 2024-03-18T15:00:26.455 INFO:teuthology.orchestra.run.smithi186.stdout:6 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 msgr2=0x7f76501f3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f764400c410 tx=0x7f764400c8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 shutdown_connections 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76500ceeb0 0x7f76501f4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76500b0150 0x7f76501f3b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 --2- 172.21.15.186:0/619452903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f765006b8d0 0x7f76500c9de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 >> 172.21.15.186:0/619452903 conn(0x7f76500d0da0 msgr2=0x7f76500b2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.456 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 shutdown_connections 2024-03-18T15:00:26.457 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.455+0000 7f76550d1640 1 -- 172.21.15.186:0/619452903 wait complete. 2024-03-18T15:00:26.466 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --cluster ceph osd new 0505d7d0-a9e4-4303-877d-0fb3289b1bbf 7 2024-03-18T15:00:26.484 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:26.484+0000 7f2ef0a45040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T15:00:26.566 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.566+0000 7f38eff9d640 1 Processor -- start 2024-03-18T15:00:26.567 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.566+0000 7f38eff9d640 1 -- start start 2024-03-18T15:00:26.575 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f38e815c3d0 0x7f38e8072770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.575 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e815c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.575 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38e815ccf0 0x7f38e815fb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f38e8072cb0 con 0x7f38e815ccf0 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f38e806f100 con 0x7f38e815c3d0 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38eff9d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f38e806f630 con 0x7f38e80cd410 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38edd39640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f38e815c3d0 0x7f38e8072770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38ed538640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e815c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.576 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38edd39640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f38e815c3d0 0x7f38e8072770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50486/0 (socket says 172.21.15.186:50486) 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.567+0000 7f38edd39640 1 -- 172.21.15.186:0/544011183 learned_addr learned my addr 172.21.15.186:0/544011183 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38ee53a640 1 --2- 172.21.15.186:0/544011183 >> v2:172.21.15.152:3300/0 conn(0x7f38e815ccf0 0x7f38e815fb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 -- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 msgr2=0x7f38e815c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e815c7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 -- 172.21.15.186:0/544011183 >> v2:172.21.15.152:3300/0 conn(0x7f38e815ccf0 msgr2=0x7f38e815fb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 --2- 172.21.15.186:0/544011183 >> v2:172.21.15.152:3300/0 conn(0x7f38e815ccf0 0x7f38e815fb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.577 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 -- 172.21.15.186:0/544011183 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e806f350 con 0x7f38e815c3d0 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38ed538640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.568+0000 7f38edd39640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e8072770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f38e80ce8c0 tx=0x7f38e402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ca526b63a8ca5548 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38ecd37640 1 -- 172.21.15.186:0/544011183 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e402e070 con 0x7f38e815c3d0 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38ecd37640 1 -- 172.21.15.186:0/544011183 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38e4037070 con 0x7f38e815c3d0 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38ecd37640 1 -- 172.21.15.186:0/544011183 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38e4031a00 con 0x7f38e815c3d0 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 -- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 msgr2=0x7f38e8072770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e8072770 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f38e80ce8c0 tx=0x7f38e402b880 comp rx=0 tx=0).stop 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 -- 172.21.15.186:0/544011183 shutdown_connections 2024-03-18T15:00:26.578 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 --2- 172.21.15.186:0/544011183 >> v2:172.21.15.152:3300/0 conn(0x7f38e815ccf0 0x7f38e815fb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e815c7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 --2- 172.21.15.186:0/544011183 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e8072770 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 -- 172.21.15.186:0/544011183 >> 172.21.15.186:0/544011183 conn(0x7f38e80d0da0 msgr2=0x7f38e80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 -- 172.21.15.186:0/544011183 shutdown_connections 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.569+0000 7f38eff9d640 1 -- 172.21.15.186:0/544011183 wait complete. 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.570+0000 7f38eff9d640 1 Processor -- start 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 -- start start 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e80c74c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e815ccf0 0x7f38e80b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80ccea0 con 0x7f38e815ccf0 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f38e80cb800 con 0x7f38e815c3d0 2024-03-18T15:00:26.579 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38eff9d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f38e806f950 con 0x7f38e80cd410 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38ed538640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38edd39640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e80c74c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38ed538640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.186:50494/0 (socket says 172.21.15.186:50494) 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38ed538640 1 -- 172.21.15.186:0/3500273089 learned_addr learned my addr 172.21.15.186:0/3500273089 (peer_addr_for_me v2:172.21.15.186:0/0) 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.571+0000 7f38ee53a640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e815ccf0 0x7f38e80b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 -- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 msgr2=0x7f38e80c74c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e80c74c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 -- 172.21.15.186:0/3500273089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e815ccf0 msgr2=0x7f38e80b3f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e815ccf0 0x7f38e80b3f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 -- 172.21.15.186:0/3500273089 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e80b5d80 con 0x7f38e815c3d0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38ed538640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38d800e9b0 tx=0x7f38d800ee70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d8017070 con 0x7f38e815c3d0 2024-03-18T15:00:26.580 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38d800c9a0 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e80b6060 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d800cd70 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e80b6620 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f38d801a070 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.572+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f38d8003b00 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.573+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e804f540 con 0x7f38e815c3d0 2024-03-18T15:00:26.581 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.577+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f38d8003610 con 0x7f38e815c3d0 2024-03-18T15:00:26.597 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:26.596+0000 7fe8a0445040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-03-18T15:00:26.649 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.648+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0505d7d0-a9e4-4303-877d-0fb3289b1bbf", "id": 7} v 0) -- 0x7f38e81601b0 con 0x7f38e815c3d0 2024-03-18T15:00:26.662 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.661+0000 7f38de7fc640 1 -- 172.21.15.186:0/3500273089 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0505d7d0-a9e4-4303-877d-0fb3289b1bbf", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f38d8005990 con 0x7f38e815c3d0 2024-03-18T15:00:26.662 INFO:teuthology.orchestra.run.smithi186.stdout:7 2024-03-18T15:00:26.663 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 msgr2=0x7f38e80b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.663 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f38d800e9b0 tx=0x7f38d800ee70 comp rx=0 tx=0).stop 2024-03-18T15:00:26.663 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 shutdown_connections 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e815ccf0 0x7f38e80b3f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e815c3d0 0x7f38e80b3a40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 --2- 172.21.15.186:0/3500273089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e80cd410 0x7f38e80c74c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.662+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 >> 172.21.15.186:0/3500273089 conn(0x7f38e80d0da0 msgr2=0x7f38e80b0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.663+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 shutdown_connections 2024-03-18T15:00:26.664 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:00:26.663+0000 7f38eff9d640 1 -- 172.21.15.186:0/3500273089 wait complete. 2024-03-18T15:00:26.673 INFO:tasks.ceph.osd.0:Restarting daemon 2024-03-18T15:00:26.674 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-03-18T15:00:26.676 INFO:tasks.ceph.osd.0:Started 2024-03-18T15:00:26.676 INFO:tasks.ceph.osd.1:Restarting daemon 2024-03-18T15:00:26.676 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-03-18T15:00:26.678 INFO:tasks.ceph.osd.1:Started 2024-03-18T15:00:26.678 INFO:tasks.ceph.osd.2:Restarting daemon 2024-03-18T15:00:26.678 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-03-18T15:00:26.681 INFO:tasks.ceph.osd.2:Started 2024-03-18T15:00:26.681 INFO:tasks.ceph.osd.3:Restarting daemon 2024-03-18T15:00:26.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-03-18T15:00:26.684 INFO:tasks.ceph.osd.3:Started 2024-03-18T15:00:26.684 INFO:tasks.ceph.osd.4:Restarting daemon 2024-03-18T15:00:26.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-03-18T15:00:26.686 INFO:tasks.ceph.osd.4:Started 2024-03-18T15:00:26.686 INFO:tasks.ceph.osd.5:Restarting daemon 2024-03-18T15:00:26.687 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-03-18T15:00:26.688 INFO:tasks.ceph.osd.5:Started 2024-03-18T15:00:26.688 INFO:tasks.ceph.osd.6:Restarting daemon 2024-03-18T15:00:26.689 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-03-18T15:00:26.690 INFO:tasks.ceph.osd.6:Started 2024-03-18T15:00:26.691 INFO:tasks.ceph.osd.7:Restarting daemon 2024-03-18T15:00:26.691 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-03-18T15:00:26.695 INFO:tasks.ceph.osd.7:Started 2024-03-18T15:00:26.695 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:26.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.815+0000 7f5a0ad48640 1 Processor -- start 2024-03-18T15:00:26.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.815+0000 7f5a0ad48640 1 -- start start 2024-03-18T15:00:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a0ad48640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 0x7f5a04162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a0ad48640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a040b3440 con 0x7f5a0415ea90 2024-03-18T15:00:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a0ad48640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a040d20a0 con 0x7f5a041622b0 2024-03-18T15:00:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a0ad48640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a040d16c0 con 0x7f5a040d10d0 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a092e5640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5a0415ea90 0x7f5a0415ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53792/0 (socket says 172.21.15.152:53792) 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a092e5640 1 -- 172.21.15.152:0/879219695 learned_addr learned my addr 172.21.15.152:0/879219695 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.816+0000 7f5a03fff640 1 --2- 172.21.15.152:0/879219695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 0x7f5a04162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1989600310 0 0) 0x7f5a040b3440 con 0x7f5a0415ea90 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f4003520 con 0x7f5a0415ea90 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2880748936 0 0) 0x7f5a040d20a0 con 0x7f5a041622b0 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5a040b3440 con 0x7f5a041622b0 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a03fff640 1 -- 172.21.15.152:0/879219695 >> v1:172.21.15.186:6789/0 conn(0x7f5a041622b0 legacy=0x7f5a04162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a03fff640 1 -- 172.21.15.152:0/879219695 >> v1:172.21.15.152:6789/0 conn(0x7f5a0415ea90 legacy=0x7f5a0415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.817+0000 7f5a03fff640 1 -- 172.21.15.152:0/879219695 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a040d2380 con 0x7f5a040d10d0 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a03fff640 1 --2- 172.21.15.152:0/879219695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 0x7f5a04162da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59f00097d0 tx=0x7f59f002b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b46312aad734300 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0031770 con 0x7f5a040d10d0 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f0037070 con 0x7f5a040d10d0 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a037fe640 1 -- 172.21.15.152:0/879219695 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0031b30 con 0x7f5a040d10d0 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 -- 172.21.15.152:0/879219695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 msgr2=0x7f5a04162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/879219695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 0x7f5a04162da0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f59f00097d0 tx=0x7f59f002b810 comp rx=0 tx=0).stop 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 -- 172.21.15.152:0/879219695 shutdown_connections 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/879219695 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d10d0 0x7f5a04162da0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 -- 172.21.15.152:0/879219695 >> 172.21.15.152:0/879219695 conn(0x7f5a040d4070 msgr2=0x7f5a040d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 -- 172.21.15.152:0/879219695 shutdown_connections 2024-03-18T15:00:26.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.818+0000 7f5a0ad48640 1 -- 172.21.15.152:0/879219695 wait complete. 2024-03-18T15:00:26.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.819+0000 7f5a0ad48640 1 Processor -- start 2024-03-18T15:00:26.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 -- start start 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d10d0 0x7f5a04150660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0415ea90 0x7f5a040b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040cfc90 con 0x7f5a041622b0 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040d2660 con 0x7f5a040d10d0 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.820+0000 7f5a0ad48640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a040cfe10 con 0x7f5a0415ea90 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a08ae4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d10d0 0x7f5a04150660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a03fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0415ea90 0x7f5a040b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58160/0 (socket says 172.21.15.152:58160) 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 -- 172.21.15.152:0/2453859208 learned_addr learned my addr 172.21.15.152:0/2453859208 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:26.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 -- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0415ea90 msgr2=0x7f5a040b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0415ea90 0x7f5a040b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 -- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d10d0 msgr2=0x7f5a04150660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d10d0 0x7f5a04150660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 -- 172.21.15.152:0/2453859208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a04150ba0 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a092e5640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00cb40 tx=0x7f59fc00a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc017070 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59fc00acc0 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a040b5040 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59fc012640 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a040b4280 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f59fc01a070 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.821+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f59fc007070 con 0x7f5a041622b0 2024-03-18T15:00:26.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.822+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a040cac40 con 0x7f5a041622b0 2024-03-18T15:00:26.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.824+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f5a040cac40 con 0x7f5a041622b0 2024-03-18T15:00:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.884+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a0404f5b0 con 0x7f5a041622b0 2024-03-18T15:00:26.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.884+0000 7f5a017fa640 1 -- 172.21.15.152:0/2453859208 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f59fc021020 con 0x7f5a041622b0 2024-03-18T15:00:26.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:26.885 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":10,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:26.655403+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 msgr2=0x7f5a040b5820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f59fc00cb40 tx=0x7f59fc00a060 comp rx=0 tx=0).stop 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 shutdown_connections 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a041622b0 0x7f5a040b5820 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0415ea90 0x7f5a040b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 --2- 172.21.15.152:0/2453859208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d10d0 0x7f5a04150660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 >> 172.21.15.152:0/2453859208 conn(0x7f5a040d4070 msgr2=0x7f5a040d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 shutdown_connections 2024-03-18T15:00:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:26.885+0000 7f5a0ad48640 1 -- 172.21.15.152:0/2453859208 wait complete. 2024-03-18T15:00:26.896 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-03-18T15:00:26.896 INFO:tasks.ceph:Waiting for OSDs to come up 2024-03-18T15:00:27.283 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T15:00:27.282+0000 7efefae0f640 -1 Falling back to public interface 2024-03-18T15:00:27.292 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T15:00:27.291+0000 7f6886536640 -1 Falling back to public interface 2024-03-18T15:00:27.310 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T15:00:27.310+0000 7fcb9320d640 -1 Falling back to public interface 2024-03-18T15:00:27.311 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T15:00:27.311+0000 7ff58ebaa640 -1 Falling back to public interface 2024-03-18T15:00:27.311 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T15:00:27.311+0000 7fb545a10640 -1 Falling back to public interface 2024-03-18T15:00:27.312 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T15:00:27.312+0000 7f695ee0e640 -1 Falling back to public interface 2024-03-18T15:00:27.315 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T15:00:27.315+0000 7f91dde0f640 -1 Falling back to public interface 2024-03-18T15:00:27.321 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T15:00:27.320+0000 7f547868b640 -1 Falling back to public interface 2024-03-18T15:00:27.337 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:27.337+0000 7f2ef0a45040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T15:00:27.455 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:27.454+0000 7fe8a0445040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-03-18T15:00:27.612 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:27.612+0000 7f2ef0a45040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T15:00:27.665 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:27.665+0000 7f2ef0a45040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T15:00:27.702 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:27.732 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:27.731+0000 7fe8a0445040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-03-18T15:00:27.782 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:27.782+0000 7f2ef0a45040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T15:00:27.785 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:27.782+0000 7fe8a0445040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-03-18T15:00:27.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.791+0000 7f4e774dc640 1 Processor -- start 2024-03-18T15:00:27.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.791+0000 7f4e774dc640 1 -- start start 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e774dc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4e7006fa80 0x7f4e7006b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e774dc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4e7006b710 0x7f4e700cd790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e774dc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4e7015fe10 con 0x7f4e700cdcd0 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e774dc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7006bb70 con 0x7f4e7006b710 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e774dc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4e7006fe60 con 0x7f4e7006fa80 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4e7006b710 0x7f4e700cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4e7006b710 0x7f4e700cd790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58170/0 (socket says 172.21.15.152:58170) 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 -- 172.21.15.152:0/4200385387 learned_addr learned my addr 172.21.15.152:0/4200385387 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e75278640 1 --2- 172.21.15.152:0/4200385387 >> v2:172.21.15.186:3300/0 conn(0x7f4e7006fa80 0x7f4e7006b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 -- 172.21.15.152:0/4200385387 >> v2:172.21.15.186:3300/0 conn(0x7f4e7006fa80 msgr2=0x7f4e7006b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:27.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 --2- 172.21.15.152:0/4200385387 >> v2:172.21.15.186:3300/0 conn(0x7f4e7006fa80 0x7f4e7006b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.794 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 -- 172.21.15.152:0/4200385387 >> v1:172.21.15.186:6789/0 conn(0x7f4e700cdcd0 legacy=0x7f4e7006df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:27.794 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.792+0000 7f4e74a77640 1 -- 172.21.15.152:0/4200385387 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e701600f0 con 0x7f4e7006b710 2024-03-18T15:00:27.795 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.793+0000 7f4e74a77640 1 --2- 172.21.15.152:0/4200385387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e7006b710 0x7f4e700cd790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e70072940 tx=0x7f4e6002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8e3be85dc561d84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:27.795 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.793+0000 7f4e67fff640 1 -- 172.21.15.152:0/4200385387 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e6002e070 con 0x7f4e7006b710 2024-03-18T15:00:27.795 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.793+0000 7f4e67fff640 1 -- 172.21.15.152:0/4200385387 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e60037070 con 0x7f4e7006b710 2024-03-18T15:00:27.795 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.793+0000 7f4e67fff640 1 -- 172.21.15.152:0/4200385387 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e60031a00 con 0x7f4e7006b710 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 -- 172.21.15.152:0/4200385387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e7006b710 msgr2=0x7f4e700cd790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 --2- 172.21.15.152:0/4200385387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e7006b710 0x7f4e700cd790 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f4e70072940 tx=0x7f4e6002b880 comp rx=0 tx=0).stop 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 -- 172.21.15.152:0/4200385387 shutdown_connections 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 --2- 172.21.15.152:0/4200385387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e7006b710 0x7f4e700cd790 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 --2- 172.21.15.152:0/4200385387 >> v2:172.21.15.186:3300/0 conn(0x7f4e7006fa80 0x7f4e7006b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 -- 172.21.15.152:0/4200385387 >> 172.21.15.152:0/4200385387 conn(0x7f4e700b28f0 msgr2=0x7f4e700b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 -- 172.21.15.152:0/4200385387 shutdown_connections 2024-03-18T15:00:27.796 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.794+0000 7f4e774dc640 1 -- 172.21.15.152:0/4200385387 wait complete. 2024-03-18T15:00:27.797 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.795+0000 7f4e774dc640 1 Processor -- start 2024-03-18T15:00:27.797 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.795+0000 7f4e774dc640 1 -- start start 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7006b710 0x7f4e700ce9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7006fa80 0x7f4e701f7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70160740 con 0x7f4e700cdcd0 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4e7015fbc0 con 0x7f4e7006b710 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e774dc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4e700ce140 con 0x7f4e7006fa80 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:58186/0 (socket says 172.21.15.152:58186) 2024-03-18T15:00:27.800 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 -- 172.21.15.152:0/1799582027 learned_addr learned my addr 172.21.15.152:0/1799582027 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75278640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7006b710 0x7f4e700ce9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e74a77640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7006fa80 0x7f4e701f7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 -- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7006fa80 msgr2=0x7f4e701f7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7006fa80 0x7f4e701f7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 -- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7006b710 msgr2=0x7f4e700ce9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7006b710 0x7f4e700ce9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.796+0000 7f4e75a79640 1 -- 172.21.15.152:0/1799582027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e700cf020 con 0x7f4e700cdcd0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.797+0000 7f4e75a79640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c730 tx=0x7f4e6800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.798+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e68003b90 con 0x7f4e700cdcd0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.798+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e700cf300 con 0x7f4e700cdcd0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.798+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4e68003d30 con 0x7f4e700cdcd0 2024-03-18T15:00:27.801 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.798+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e680052d0 con 0x7f4e700cdcd0 2024-03-18T15:00:27.802 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.799+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e701f7920 con 0x7f4e700cdcd0 2024-03-18T15:00:27.802 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.799+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 2) ==== 45093+0+0 (secure 0 0 0) 0x7f4e6800a640 con 0x7f4e700cdcd0 2024-03-18T15:00:27.802 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.800+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f4e68049fb0 con 0x7f4e700cdcd0 2024-03-18T15:00:27.802 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.800+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e700cf820 con 0x7f4e700cdcd0 2024-03-18T15:00:27.802 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.802+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73141 (secure 0 0 0) 0x7f4e700cf820 con 0x7f4e700cdcd0 2024-03-18T15:00:27.873 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.873+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4e7004f540 con 0x7f4e700cdcd0 2024-03-18T15:00:27.873 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.873+0000 7f4e65ffb640 1 -- 172.21.15.152:0/1799582027 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f4e68021020 con 0x7f4e700cdcd0 2024-03-18T15:00:27.874 INFO:teuthology.misc.health.smithi152.stdout: 2024-03-18T15:00:27.874 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":10,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:26.655403+0000","last_up_change":"0.000000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 msgr2=0x7f4e700b5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c730 tx=0x7f4e6800cbf0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 shutdown_connections 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4e700cdcd0 0x7f4e700b5900 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4e7006fa80 0x7f4e701f7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 --2- 172.21.15.152:0/1799582027 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4e7006b710 0x7f4e700ce9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 >> 172.21.15.152:0/1799582027 conn(0x7f4e700b28f0 msgr2=0x7f4e700b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 shutdown_connections 2024-03-18T15:00:27.875 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:27.874+0000 7f4e774dc640 1 -- 172.21.15.152:0/1799582027 wait complete. 2024-03-18T15:00:27.885 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-03-18T15:00:27.906 INFO:tasks.ceph.mgr.x.smithi186.stderr:2024-03-18T15:00:27.905+0000 7fe8a0445040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-03-18T15:00:28.807 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:28.806+0000 7f2e91711640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-03-18T15:00:28.807 INFO:tasks.ceph.mgr.y.smithi152.stderr:2024-03-18T15:00:28.806+0000 7f2e91711640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-03-18T15:00:30.719 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T15:00:30.718+0000 7efefae0f640 -1 osd.4 0 log_to_monitors true 2024-03-18T15:00:30.761 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T15:00:30.760+0000 7f6886536640 -1 osd.6 0 log_to_monitors true 2024-03-18T15:00:30.761 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T15:00:30.761+0000 7ff58ebaa640 -1 osd.0 0 log_to_monitors true 2024-03-18T15:00:30.805 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T15:00:30.804+0000 7f695ee0e640 -1 osd.7 0 log_to_monitors true 2024-03-18T15:00:30.814 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T15:00:30.814+0000 7fb545a10640 -1 osd.2 0 log_to_monitors true 2024-03-18T15:00:30.831 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T15:00:30.831+0000 7f547868b640 -1 osd.5 0 log_to_monitors true 2024-03-18T15:00:30.848 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T15:00:30.848+0000 7f91dde0f640 -1 osd.3 0 log_to_monitors true 2024-03-18T15:00:30.861 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T15:00:30.860+0000 7fcb9320d640 -1 osd.1 0 log_to_monitors true 2024-03-18T15:00:32.674 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T15:00:32.674+0000 7ff58ab40640 -1 osd.0 0 waiting for initial osdmap 2024-03-18T15:00:32.685 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T15:00:32.685+0000 7ff582960640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:33.287 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T15:00:33.287+0000 7efef6da5640 -1 osd.4 0 waiting for initial osdmap 2024-03-18T15:00:33.300 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T15:00:33.299+0000 7f68824cc640 -1 osd.6 0 waiting for initial osdmap 2024-03-18T15:00:33.390 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T15:00:33.390+0000 7f687a2ec640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:33.391 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T15:00:33.390+0000 7efeeebc5640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.080 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T15:00:34.079+0000 7f695a7e4640 -1 osd.7 0 waiting for initial osdmap 2024-03-18T15:00:34.090 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T15:00:34.090+0000 7f5474621640 -1 osd.5 0 waiting for initial osdmap 2024-03-18T15:00:34.096 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T15:00:34.096+0000 7f6952604640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.100 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T15:00:34.100+0000 7f546c441640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.507 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T15:00:34.507+0000 7fb5413e4640 -1 osd.2 0 waiting for initial osdmap 2024-03-18T15:00:34.508 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T15:00:34.508+0000 7f91d9827640 -1 osd.3 0 waiting for initial osdmap 2024-03-18T15:00:34.521 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T15:00:34.521+0000 7fb539204640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.521 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T15:00:34.521+0000 7fcb8ebaf640 -1 osd.1 0 waiting for initial osdmap 2024-03-18T15:00:34.528 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T15:00:34.528+0000 7f91d1647640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.534 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T15:00:34.534+0000 7fcb869cf640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-18T15:00:34.691 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:34.782 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.781+0000 7f711d819640 1 Processor -- start 2024-03-18T15:00:34.782 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.781+0000 7f711d819640 1 -- start start 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f711815c100 0x7f71180ce590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f71180b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71180d0000 0x7f71180b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f71180cedc0 con 0x7f71180d0000 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f71180cf0a0 con 0x7f711815c100 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f711d819640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f71180cf380 con 0x7f711815c4e0 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f71177fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71180d0000 0x7f71180b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f71177fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71180d0000 0x7f71180b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57740/0 (socket says 172.21.15.152:57740) 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.782+0000 7f71177fe640 1 -- 172.21.15.152:0/3863911099 learned_addr learned my addr 172.21.15.152:0/3863911099 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:34.785 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71167fc640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f71180b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f7116ffd640 1 --2- 172.21.15.152:0/3863911099 >> v2:172.21.15.186:3300/0 conn(0x7f711815c100 0x7f71180ce590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 -- 172.21.15.152:0/3863911099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 msgr2=0x7f71180b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f71180b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 -- 172.21.15.152:0/3863911099 >> v2:172.21.15.186:3300/0 conn(0x7f711815c100 msgr2=0x7f71180ce590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 --2- 172.21.15.152:0/3863911099 >> v2:172.21.15.186:3300/0 conn(0x7f711815c100 0x7f71180ce590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 -- 172.21.15.152:0/3863911099 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71180cf660 con 0x7f71180d0000 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71167fc640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f71180b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f71177fe640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f71180b3f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f711806efd0 tx=0x7f711002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a581a3072de86bfb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.783+0000 7f7115ffb640 1 -- 172.21.15.152:0/3863911099 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f711002e070 con 0x7f71180d0000 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f7115ffb640 1 -- 172.21.15.152:0/3863911099 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7110037070 con 0x7f71180d0000 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f7115ffb640 1 -- 172.21.15.152:0/3863911099 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7110031a00 con 0x7f71180d0000 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 -- 172.21.15.152:0/3863911099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 msgr2=0x7f71180b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:34.786 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f71180b3f80 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f711806efd0 tx=0x7f711002b880 comp rx=0 tx=0).stop 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 -- 172.21.15.152:0/3863911099 shutdown_connections 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f71180b3f80 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 --2- 172.21.15.152:0/3863911099 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f71180b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 --2- 172.21.15.152:0/3863911099 >> v2:172.21.15.186:3300/0 conn(0x7f711815c100 0x7f71180ce590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 -- 172.21.15.152:0/3863911099 >> 172.21.15.152:0/3863911099 conn(0x7f71180d1f80 msgr2=0x7f71180d2390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 -- 172.21.15.152:0/3863911099 shutdown_connections 2024-03-18T15:00:34.787 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.784+0000 7f711d819640 1 -- 172.21.15.152:0/3863911099 wait complete. 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.785+0000 7f711d819640 1 Processor -- start 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.785+0000 7f711d819640 1 -- start start 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711815c100 0x7f71180c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f711814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71180b1cd0 con 0x7f71180d0000 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f71180ccb70 con 0x7f711815c100 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f711d819640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f71180b1e50 con 0x7f711815c4e0 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:57746/0 (socket says 172.21.15.152:57746) 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 -- 172.21.15.152:0/2624540653 learned_addr learned my addr 172.21.15.152:0/2624540653 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f71177fe640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f711814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.790 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f71167fc640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711815c100 0x7f71180c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 -- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 msgr2=0x7f711814f810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f711814f810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 -- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711815c100 msgr2=0x7f71180c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.786+0000 7f7116ffd640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711815c100 0x7f71180c5ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f7116ffd640 1 -- 172.21.15.152:0/2624540653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711806d200 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f7116ffd640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f710800ce40 tx=0x7f710800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108003b90 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7108003d30 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71180c9050 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7108004260 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.787+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71180c9610 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.788+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f711804f540 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.788+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 4) ==== 90080+0+0 (secure 0 0 0) 0x7f7108004400 con 0x7f71180d0000 2024-03-18T15:00:34.791 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.789+0000 7f70fffff640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 0x7f710406e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:34.792 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.789+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(14..14 src has 1..14) ==== 3631+0+0 (secure 0 0 0) 0x7f710808ac20 con 0x7f71180d0000 2024-03-18T15:00:34.792 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.789+0000 7f71167fc640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 0x7f710406e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:34.792 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.789+0000 7f71167fc640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 0x7f710406e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71180cbe80 tx=0x7f710c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:34.793 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.793+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7108059930 con 0x7f71180d0000 2024-03-18T15:00:34.969 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.969+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f71180b35f0 con 0x7f71180d0000 2024-03-18T15:00:34.969 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.969+0000 7f70fffff640 1 -- 172.21.15.152:0/2624540653 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) ==== 74+0+9534 (secure 0 0 0) 0x7f710805d9d0 con 0x7f71180d0000 2024-03-18T15:00:34.970 INFO:teuthology.misc.health.smithi152.stdout: 2024-03-18T15:00:34.970 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":14,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:34.402472+0000","last_up_change":"2024-03-18T15:00:34.402472+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 msgr2=0x7f710406e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 0x7f710406e000 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f71180cbe80 tx=0x7f710c008040 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 msgr2=0x7f711806cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f710800ce40 tx=0x7f710800a660 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 shutdown_connections 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f710406bb40 0x7f710406e000 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f711815c4e0 0x7f711814f810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f711815c100 0x7f71180c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 --2- 172.21.15.152:0/2624540653 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71180d0000 0x7f711806cb70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 >> 172.21.15.152:0/2624540653 conn(0x7f71180d1f80 msgr2=0x7f71180b38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 shutdown_connections 2024-03-18T15:00:34.972 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:34.971+0000 7f711d819640 1 -- 172.21.15.152:0/2624540653 wait complete. 2024-03-18T15:00:34.982 DEBUG:teuthology.misc:5 of 8 OSDs are up 2024-03-18T15:00:41.789 DEBUG:teuthology.orchestra.run.smithi152:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:41.899 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.890+0000 7f16bbff4640 1 Processor -- start 2024-03-18T15:00:41.899 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.890+0000 7f16bbff4640 1 -- start start 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16bbff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b415c570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16bbff4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f16b40b4980 0x7f16b406b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16bbff4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16b40ae8c0 con 0x7f16b40b4dc0 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16bbff4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f16b40aeb40 con 0x7f16b40b4980 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16bbff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f16b40aee20 con 0x7f16b40cf580 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16b958f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f16b40b4980 0x7f16b406b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16ba591640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f16b40b4dc0 0x7f16b415ff40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39718/0 (socket says 172.21.15.152:39718) 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.891+0000 7f16ba591640 1 -- 172.21.15.152:0/573585690 learned_addr learned my addr 172.21.15.152:0/573585690 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b9d90640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b415c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b958f640 1 -- 172.21.15.152:0/573585690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 msgr2=0x7f16b415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b958f640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b415c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:41.900 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b958f640 1 -- 172.21.15.152:0/573585690 >> v1:172.21.15.152:6789/0 conn(0x7f16b40b4dc0 legacy=0x7f16b415ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b958f640 1 -- 172.21.15.152:0/573585690 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b40af100 con 0x7f16b40b4980 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.892+0000 7f16b958f640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b406b5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097a0 tx=0x7f16a402b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b15e43dc8217a6c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16b8d8e640 1 -- 172.21.15.152:0/573585690 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4031780 con 0x7f16b40b4980 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16b8d8e640 1 -- 172.21.15.152:0/573585690 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16a4037070 con 0x7f16b40b4980 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16b8d8e640 1 -- 172.21.15.152:0/573585690 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16a4031b40 con 0x7f16b40b4980 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 -- 172.21.15.152:0/573585690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 msgr2=0x7f16b406b5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b406b5f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f16a40097a0 tx=0x7f16a402b820 comp rx=0 tx=0).stop 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 -- 172.21.15.152:0/573585690 shutdown_connections 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b406b5f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 --2- 172.21.15.152:0/573585690 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b415c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 -- 172.21.15.152:0/573585690 >> 172.21.15.152:0/573585690 conn(0x7f16b40b1cd0 msgr2=0x7f16b40b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 -- 172.21.15.152:0/573585690 shutdown_connections 2024-03-18T15:00:41.901 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.893+0000 7f16bbff4640 1 -- 172.21.15.152:0/573585690 wait complete. 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.894+0000 7f16bbff4640 1 Processor -- start 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.894+0000 7f16bbff4640 1 -- start start 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16b40b4dc0 0x7f16b40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b409b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f16b40cf960 con 0x7f16b40b4980 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f16b40acf30 con 0x7f16b40b4dc0 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16bbff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f16b40cfae0 con 0x7f16b40cf580 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16b9d90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16b9d90640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51272/0 (socket says 172.21.15.152:51272) 2024-03-18T15:00:41.902 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.895+0000 7f16b9d90640 1 -- 172.21.15.152:0/1642461245 learned_addr learned my addr 172.21.15.152:0/1642461245 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16ba591640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b409b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 -- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 msgr2=0x7f16b409b350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b409b350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 -- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16b40b4dc0 msgr2=0x7f16b40c8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16b40b4dc0 0x7f16b40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 -- 172.21.15.152:0/1642461245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b409d7b0 con 0x7f16b40b4980 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16b9d90640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f16b000d5f0 tx=0x7f16b000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00125f0 con 0x7f16b40b4980 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16b0019070 con 0x7f16b40b4980 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00129d0 con 0x7f16b40b4980 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b409d4d0 con 0x7f16b40b4980 2024-03-18T15:00:41.903 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.896+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b40cc640 con 0x7f16b40b4980 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.897+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b40b2ef0 con 0x7f16b40b4980 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.897+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f16b0012b70 con 0x7f16b40b4980 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.898+0000 7f16aa7fc640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 0x7f169806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.898+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f16b008aac0 con 0x7f16b40b4980 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.898+0000 7f16b958f640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 0x7f169806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.898+0000 7f16b958f640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 0x7f169806e090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16a4036000 tx=0x7f16a4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:41.904 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:41.903+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f16b40b2ef0 con 0x7f16b40b4980 2024-03-18T15:00:42.078 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.078+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f16b404f540 con 0x7f16b40b4980 2024-03-18T15:00:42.079 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.079+0000 7f16aa7fc640 1 -- 172.21.15.152:0/1642461245 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7f16b0059990 con 0x7f16b40b4980 2024-03-18T15:00:42.079 INFO:teuthology.misc.health.smithi152.stdout: 2024-03-18T15:00:42.080 INFO:teuthology.misc.health.smithi152.stdout:{"epoch":18,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:38.536327+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 msgr2=0x7f169806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 0x7f169806e090 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f16a4036000 tx=0x7f16a4030000 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 msgr2=0x7f16b41506c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f16b000d5f0 tx=0x7f16b000dab0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 shutdown_connections 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f169806bbd0 0x7f169806e090 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f16b40cf580 0x7f16b409b350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f16b40b4dc0 0x7f16b40c8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 --2- 172.21.15.152:0/1642461245 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f16b40b4980 0x7f16b41506c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.082 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 >> 172.21.15.152:0/1642461245 conn(0x7f16b40b1cd0 msgr2=0x7f16b406cf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.083 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 shutdown_connections 2024-03-18T15:00:42.083 INFO:teuthology.misc.health.smithi152.stderr:2024-03-18T15:00:42.081+0000 7f16bbff4640 1 -- 172.21.15.152:0/1642461245 wait complete. 2024-03-18T15:00:42.091 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-03-18T15:00:42.091 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-03-18T15:00:42.092 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T15:00:42.092 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T15:00:42.094 INFO:tasks.ceph.mds.a:Started 2024-03-18T15:00:42.095 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T15:00:42.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T15:00:42.097 INFO:tasks.ceph.mds.c:Started 2024-03-18T15:00:42.097 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T15:00:42.097 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T15:00:42.102 INFO:tasks.ceph.mds.b:Started 2024-03-18T15:00:42.102 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-18T15:00:42.102 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-18T15:00:42.104 INFO:tasks.ceph.mds.d:Started 2024-03-18T15:00:42.104 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-03-18T15:00:42.105 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:42.172 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2024-03-18T15:00:42.173 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-03-18T15:00:42.185 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-03-18T15:00:42.187 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-03-18T15:00:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.210+0000 7f5a0ba9a640 1 Processor -- start 2024-03-18T15:00:42.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0ba9a640 1 -- start start 2024-03-18T15:00:42.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0ba9a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a040d2d50 0x7f5a040d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0ba9a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a040d1200 con 0x7f5a040d1e40 2024-03-18T15:00:42.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0ba9a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a040d14e0 con 0x7f5a0415e5a0 2024-03-18T15:00:42.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0ba9a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5a040cff90 con 0x7f5a040d2d50 2024-03-18T15:00:42.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0a037640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5a040d1e40 0x7f5a040b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39742/0 (socket says 172.21.15.152:39742) 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.211+0000 7f5a0a037640 1 -- 172.21.15.152:0/1908074957 learned_addr learned my addr 172.21.15.152:0/1908074957 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a09035640 1 --2- 172.21.15.152:0/1908074957 >> v2:172.21.15.186:3300/0 conn(0x7f5a040d2d50 0x7f5a040d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a08834640 1 -- 172.21.15.152:0/1908074957 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1909371678 0 0) 0x7f5a040d1200 con 0x7f5a040d1e40 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a08834640 1 -- 172.21.15.152:0/1908074957 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59f0003520 con 0x7f5a040d1e40 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a09035640 1 -- 172.21.15.152:0/1908074957 >> v1:172.21.15.186:6789/0 conn(0x7f5a0415e5a0 legacy=0x7f5a040d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a09035640 1 -- 172.21.15.152:0/1908074957 >> v1:172.21.15.152:6789/0 conn(0x7f5a040d1e40 legacy=0x7f5a040b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.212+0000 7f5a09035640 1 -- 172.21.15.152:0/1908074957 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a040d17c0 con 0x7f5a040d2d50 2024-03-18T15:00:42.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a09035640 1 --2- 172.21.15.152:0/1908074957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d2d50 0x7f5a040d4b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59f40097a0 tx=0x7f59f402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=554bc14f6bd2ed92 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a08834640 1 -- 172.21.15.152:0/1908074957 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4035020 con 0x7f5a040d2d50 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a08834640 1 -- 172.21.15.152:0/1908074957 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59f4031830 con 0x7f5a040d2d50 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a08834640 1 -- 172.21.15.152:0/1908074957 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f4031c00 con 0x7f5a040d2d50 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/1908074957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d2d50 msgr2=0x7f5a040d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/1908074957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d2d50 0x7f5a040d4b80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f59f40097a0 tx=0x7f59f402b8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/1908074957 shutdown_connections 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/1908074957 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a040d2d50 0x7f5a040d4b80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/1908074957 >> 172.21.15.152:0/1908074957 conn(0x7f5a040d4060 msgr2=0x7f5a040d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/1908074957 shutdown_connections 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.213+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/1908074957 wait complete. 2024-03-18T15:00:42.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.214+0000 7f5a0ba9a640 1 Processor -- start 2024-03-18T15:00:42.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 -- start start 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d2d50 0x7f5a0415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 0x7f5a040cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040b4720 con 0x7f5a040d1e40 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5a040b45a0 con 0x7f5a0415e5a0 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a0ba9a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a040b48a0 con 0x7f5a040d2d50 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a09836640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a09836640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51322/0 (socket says 172.21.15.152:51322) 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.215+0000 7f5a09836640 1 -- 172.21.15.152:0/2887507859 learned_addr learned my addr 172.21.15.152:0/2887507859 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a0a037640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 0x7f5a040cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09035640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d2d50 0x7f5a0415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 -- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d2d50 msgr2=0x7f5a0415c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d2d50 0x7f5a0415c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 -- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 msgr2=0x7f5a040cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 0x7f5a040cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 -- 172.21.15.152:0/2887507859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a040c7cc0 con 0x7f5a040d1e40 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a0a037640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 0x7f5a040cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a09836640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000c3c0 tx=0x7f5a0000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a000052d0 con 0x7f5a040d1e40 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00005490 con 0x7f5a040d1e40 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a040c7fa0 con 0x7f5a040d1e40 2024-03-18T15:00:42.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00007260 con 0x7f5a040d1e40 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.216+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0409de30 con 0x7f5a040d1e40 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.217+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0404f5b0 con 0x7f5a040d1e40 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.217+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5a00007400 con 0x7f5a040d1e40 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.218+0000 7f59fa7fc640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 0x7f59e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.218+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f5a00089ba0 con 0x7f5a040d1e40 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.218+0000 7f5a09035640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 0x7f59e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.218+0000 7f5a09035640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 0x7f59e806e090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59f4036000 tx=0x7f59f4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.222+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5a000589e0 con 0x7f5a040d1e40 2024-03-18T15:00:42.367 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:00:42.370 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:00:42.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.396+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5a040d29b0 con 0x7f5a040d1e40 2024-03-18T15:00:42.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.396+0000 7f59fa7fc640 1 -- 172.21.15.152:0/2887507859 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7f5a000582e0 con 0x7f5a040d1e40 2024-03-18T15:00:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:42.397 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:38.536327+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 msgr2=0x7f59e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 0x7f59e806e090 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f59f4036000 tx=0x7f59f4008030 comp rx=0 tx=0).stop 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 msgr2=0x7f5a040b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5a0000c3c0 tx=0x7f5a0000c880 comp rx=0 tx=0).stop 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 shutdown_connections 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0415e5a0 0x7f5a040cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59e806bbd0 0x7f59e806e090 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a040d2d50 0x7f5a0415c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 --2- 172.21.15.152:0/2887507859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a040d1e40 0x7f5a040b9140 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.398+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 >> 172.21.15.152:0/2887507859 conn(0x7f5a040d4060 msgr2=0x7f5a0406cb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.399+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 shutdown_connections 2024-03-18T15:00:42.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.399+0000 7f5a0ba9a640 1 -- 172.21.15.152:0/2887507859 wait complete. 2024-03-18T15:00:42.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:00:42.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:00:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.579+0000 7f0885fe1640 1 Processor -- start 2024-03-18T15:00:42.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 -- start start 2024-03-18T15:00:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f08800d10d0 0x7f08800c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 0x7f08800c8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08800d02f0 con 0x7f088015e6c0 2024-03-18T15:00:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f08800d4c10 con 0x7f08800d10d0 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.580+0000 7f0885fe1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f08800d4ef0 con 0x7f088015eaa0 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f08800d10d0 0x7f08800c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087ffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 0x7f08800c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f08800d10d0 0x7f08800c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:41478/0 (socket says 172.21.15.152:41478) 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 -- 172.21.15.152:0/2905308039 learned_addr learned my addr 172.21.15.152:0/2905308039 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087f7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f088015e6c0 0x7f08800d09c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:57244/0 (socket says 172.21.15.152:57244) 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 -- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 msgr2=0x7f08800c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 0x7f08800c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 -- 172.21.15.152:0/2905308039 >> v1:172.21.15.186:6789/0 conn(0x7f088015e6c0 legacy=0x7f08800d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087effd640 1 -- 172.21.15.152:0/2905308039 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08800cfaf0 con 0x7f08800d10d0 2024-03-18T15:00:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.581+0000 7f087ffff640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 0x7f08800c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f087effd640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08800d10d0 0x7f08800c7c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0874009870 tx=0x7f087402b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea7cc0359e6eb2a0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f087e7fc640 1 -- 172.21.15.152:0/2905308039 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874035020 con 0x7f08800d10d0 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f087e7fc640 1 -- 172.21.15.152:0/2905308039 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0874031640 con 0x7f08800d10d0 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f087e7fc640 1 -- 172.21.15.152:0/2905308039 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f087402d040 con 0x7f08800d10d0 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 -- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08800d10d0 msgr2=0x7f08800c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08800d10d0 0x7f08800c7c40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0874009870 tx=0x7f087402b8f0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 -- 172.21.15.152:0/2905308039 shutdown_connections 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015eaa0 0x7f08800c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 --2- 172.21.15.152:0/2905308039 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08800d10d0 0x7f08800c7c40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 -- 172.21.15.152:0/2905308039 >> 172.21.15.152:0/2905308039 conn(0x7f08800d40f0 msgr2=0x7f08800d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.582+0000 7f0885fe1640 1 -- 172.21.15.152:0/2905308039 shutdown_connections 2024-03-18T15:00:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.583+0000 7f0885fe1640 1 -- 172.21.15.152:0/2905308039 wait complete. 2024-03-18T15:00:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 Processor -- start 2024-03-18T15:00:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 -- start start 2024-03-18T15:00:42.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015e6c0 0x7f088006cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 0x7f08801f3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.584+0000 7f0885fe1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f08800d18b0 con 0x7f08800d10d0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0885fe1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f08800cf7c0 con 0x7f088015eaa0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0885fe1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f08800d1a30 con 0x7f088015e6c0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51330/0 (socket says 172.21.15.152:51330) 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 -- 172.21.15.152:0/801450605 learned_addr learned my addr 172.21.15.152:0/801450605 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087ffff640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 0x7f08801f3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087effd640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015e6c0 0x7f088006cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 -- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015e6c0 msgr2=0x7f088006cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015e6c0 0x7f088006cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 -- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 msgr2=0x7f08801f3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 0x7f08801f3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 -- 172.21.15.152:0/801450605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f088014c7e0 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087ffff640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 0x7f08801f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f087f7fe640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f087000c400 tx=0x7f087000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08700074e0 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0870007680 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0870004a00 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f088014cac0 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.585+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f088014a050 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.586+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f088004f540 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.587+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f087001a020 con 0x7f08800d10d0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.587+0000 7f0867fff640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 0x7f086c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.587+0000 7f087effd640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 0x7f086c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.587+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f0870089ec0 con 0x7f08800d10d0 2024-03-18T15:00:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.588+0000 7f087effd640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 0x7f086c06e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0874036000 tx=0x7f0874008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.592+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0870058d90 con 0x7f08800d10d0 2024-03-18T15:00:42.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.763+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f08800742e0 con 0x7f08800d10d0 2024-03-18T15:00:42.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.763+0000 7f0867fff640 1 -- 172.21.15.152:0/801450605 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f0870058690 con 0x7f08800d10d0 2024-03-18T15:00:42.764 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 msgr2=0x7f086c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 0x7f086c06e090 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0874036000 tx=0x7f0874008030 comp rx=0 tx=0).stop 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 msgr2=0x7f08801f7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f087000c400 tx=0x7f087000c8c0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 shutdown_connections 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f088015eaa0 0x7f08801f3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f086c06bbd0 0x7f086c06e090 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f088015e6c0 0x7f088006cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 --2- 172.21.15.152:0/801450605 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08800d10d0 0x7f08801f7e70 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 >> 172.21.15.152:0/801450605 conn(0x7f08800d40f0 msgr2=0x7f088006bb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 shutdown_connections 2024-03-18T15:00:42.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.765+0000 7f0885fe1640 1 -- 172.21.15.152:0/801450605 wait complete. 2024-03-18T15:00:42.777 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:00:42.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.877+0000 7f520c86a640 1 Processor -- start 2024-03-18T15:00:42.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.877+0000 7f520c86a640 1 -- start start 2024-03-18T15:00:42.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f520c86a640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f520815c780 0x7f52080d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f520c86a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 0x7f52080af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f520c86a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f52080cd510 con 0x7f520815c3a0 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f520c86a640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f52080cd7f0 con 0x7f520815c780 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f520c86a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f52080cdad0 con 0x7f52080cef80 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f5205d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f520815c780 0x7f52080d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f5205d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f520815c780 0x7f52080d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51338/0 (socket says 172.21.15.152:51338) 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f5205d9b640 1 -- 172.21.15.152:0/687305101 learned_addr learned my addr 172.21.15.152:0/687305101 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.878+0000 7f5206d9d640 1 --2- 172.21.15.152:0/687305101 >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 0x7f52080af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5205d9b640 1 -- 172.21.15.152:0/687305101 >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 msgr2=0x7f52080af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5205d9b640 1 --2- 172.21.15.152:0/687305101 >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 0x7f52080af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5205d9b640 1 -- 172.21.15.152:0/687305101 >> v1:172.21.15.186:6789/0 conn(0x7f520815c3a0 legacy=0x7f52080ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5205d9b640 1 -- 172.21.15.152:0/687305101 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52080cddb0 con 0x7f520815c780 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5206d9d640 1 --2- 172.21.15.152:0/687305101 >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 0x7f52080af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f5205d9b640 1 --2- 172.21.15.152:0/687305101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c780 0x7f52080d2980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5208072610 tx=0x7f51fc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09801df94e94f8f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f520559a640 1 -- 172.21.15.152:0/687305101 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc034070 con 0x7f520815c780 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f520559a640 1 -- 172.21.15.152:0/687305101 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc030860 con 0x7f520815c780 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.879+0000 7f520559a640 1 -- 172.21.15.152:0/687305101 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc030c30 con 0x7f520815c780 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 -- 172.21.15.152:0/687305101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c780 msgr2=0x7f52080d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 --2- 172.21.15.152:0/687305101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c780 0x7f52080d2980 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5208072610 tx=0x7f51fc02b9a0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 -- 172.21.15.152:0/687305101 shutdown_connections 2024-03-18T15:00:42.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 --2- 172.21.15.152:0/687305101 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c780 0x7f52080d2980 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 --2- 172.21.15.152:0/687305101 >> v2:172.21.15.186:3300/0 conn(0x7f52080cef80 0x7f52080af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 -- 172.21.15.152:0/687305101 >> 172.21.15.152:0/687305101 conn(0x7f52080d1e60 msgr2=0x7f52080d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:42.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 -- 172.21.15.152:0/687305101 shutdown_connections 2024-03-18T15:00:42.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.880+0000 7f520c86a640 1 -- 172.21.15.152:0/687305101 wait complete. 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.881+0000 7f520c86a640 1 Processor -- start 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.881+0000 7f520c86a640 1 -- start start 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52080cef80 0x7f52081576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 0x7f52081e5030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f52080cf570 con 0x7f520815c3a0 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f52080cf3f0 con 0x7f520815c780 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520c86a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5208144780 con 0x7f52080cef80 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5205d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5205d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51342/0 (socket says 172.21.15.152:51342) 2024-03-18T15:00:42.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5205d9b640 1 -- 172.21.15.152:0/4291010779 learned_addr learned my addr 172.21.15.152:0/4291010779 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5206d9d640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 0x7f52081e5030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f520659c640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52080cef80 0x7f52081576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5205d9b640 1 -- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52080cef80 msgr2=0x7f52081576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.882+0000 7f5205d9b640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52080cef80 0x7f52081576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f5205d9b640 1 -- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 msgr2=0x7f52081e5030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f5205d9b640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 0x7f52081e5030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f5205d9b640 1 -- 172.21.15.152:0/4291010779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5208144a60 con 0x7f520815c3a0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f5206d9d640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 0x7f52081e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f5205d9b640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51fc02b9e0 tx=0x7f51fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc034040 con 0x7f520815c3a0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51fc030660 con 0x7f520815c3a0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5208144d40 con 0x7f520815c3a0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51fc0423f0 con 0x7f520815c3a0 2024-03-18T15:00:42.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.883+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5208145300 con 0x7f520815c3a0 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.884+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5208145500 con 0x7f520815c3a0 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.884+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f51fc037070 con 0x7f520815c3a0 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.885+0000 7f51f6ffd640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 0x7f51e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.885+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f51fc0aca10 con 0x7f520815c3a0 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.885+0000 7f520659c640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 0x7f51e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:42.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.885+0000 7f520659c640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 0x7f51e806e090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52080cbf30 tx=0x7f51f8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:42.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:42.889+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5208145500 con 0x7f520815c3a0 2024-03-18T15:00:43.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.100+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f520804f5b0 con 0x7f520815c3a0 2024-03-18T15:00:43.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.100+0000 7f51f6ffd640 1 -- 172.21.15.152:0/4291010779 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1395 (secure 0 0 0) 0x7f51fc07b970 con 0x7f520815c3a0 2024-03-18T15:00:43.101 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:43.101 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-18T15:00:43.101 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 2 2024-03-18T15:00:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 msgr2=0x7f51e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 0x7f51e806e090 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f52080cbf30 tx=0x7f51f8009040 comp rx=0 tx=0).stop 2024-03-18T15:00:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 msgr2=0x7f52081e4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f51fc02b9e0 tx=0x7f51fc0046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:43.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 shutdown_connections 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f520815c780 0x7f52081e5030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f520815c3a0 0x7f52081e4af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f51e806bbd0 0x7f51e806e090 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 --2- 172.21.15.152:0/4291010779 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f52080cef80 0x7f52081576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 >> 172.21.15.152:0/4291010779 conn(0x7f52080d1e60 msgr2=0x7f520815e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 shutdown_connections 2024-03-18T15:00:43.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:43.102+0000 7f520c86a640 1 -- 172.21.15.152:0/4291010779 wait complete. 2024-03-18T15:00:45.114 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:00:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.225+0000 7f15a071b640 1 Processor -- start 2024-03-18T15:00:45.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.225+0000 7f15a071b640 1 -- start start 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f15a071b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f159815ad40 0x7f15980ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f15a071b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f15980b3400 0x7f15980d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f15a071b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f159815ee60 con 0x7f15980b3860 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f15a071b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f159815f140 con 0x7f15980b3400 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f15a071b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f159815f420 con 0x7f159815ad40 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159dcb6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f15980b3400 0x7f15980d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159ecb8640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f15980b3860 0x7f159806dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39748/0 (socket says 172.21.15.152:39748) 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159ecb8640 1 -- 172.21.15.152:0/1433713454 learned_addr learned my addr 172.21.15.152:0/1433713454 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159e4b7640 1 --2- 172.21.15.152:0/1433713454 >> v2:172.21.15.186:3300/0 conn(0x7f159815ad40 0x7f15980ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159dcb6640 1 -- 172.21.15.152:0/1433713454 >> v2:172.21.15.186:3300/0 conn(0x7f159815ad40 msgr2=0x7f15980ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:45.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159dcb6640 1 --2- 172.21.15.152:0/1433713454 >> v2:172.21.15.186:3300/0 conn(0x7f159815ad40 0x7f15980ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159dcb6640 1 -- 172.21.15.152:0/1433713454 >> v1:172.21.15.152:6789/0 conn(0x7f15980b3860 legacy=0x7f159806dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.226+0000 7f159dcb6640 1 -- 172.21.15.152:0/1433713454 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f159815f700 con 0x7f15980b3400 2024-03-18T15:00:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.227+0000 7f159dcb6640 1 --2- 172.21.15.152:0/1433713454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15980b3400 0x7f15980d00e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1598071130 tx=0x7f158802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8635d0465559f40 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.227+0000 7f159d4b5640 1 -- 172.21.15.152:0/1433713454 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15880315a0 con 0x7f15980b3400 2024-03-18T15:00:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.227+0000 7f159d4b5640 1 -- 172.21.15.152:0/1433713454 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1588037070 con 0x7f15980b3400 2024-03-18T15:00:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.227+0000 7f159d4b5640 1 -- 172.21.15.152:0/1433713454 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1588031960 con 0x7f15980b3400 2024-03-18T15:00:45.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 -- 172.21.15.152:0/1433713454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15980b3400 msgr2=0x7f15980d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 --2- 172.21.15.152:0/1433713454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15980b3400 0x7f15980d00e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f1598071130 tx=0x7f158802b840 comp rx=0 tx=0).stop 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 -- 172.21.15.152:0/1433713454 shutdown_connections 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 --2- 172.21.15.152:0/1433713454 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f15980b3400 0x7f15980d00e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 --2- 172.21.15.152:0/1433713454 >> v2:172.21.15.186:3300/0 conn(0x7f159815ad40 0x7f15980ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 -- 172.21.15.152:0/1433713454 >> 172.21.15.152:0/1433713454 conn(0x7f159806b5e0 msgr2=0x7f159806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 -- 172.21.15.152:0/1433713454 shutdown_connections 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.228+0000 7f15a071b640 1 -- 172.21.15.152:0/1433713454 wait complete. 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.229+0000 7f15a071b640 1 Processor -- start 2024-03-18T15:00:45.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.229+0000 7f15a071b640 1 -- start start 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15980b3400 0x7f1598144600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15980b3860 0x7f159815cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f159815eb90 con 0x7f159815ad40 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f159815ea10 con 0x7f15980b3400 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f15a071b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f15980d0620 con 0x7f15980b3860 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51362/0 (socket says 172.21.15.152:51362) 2024-03-18T15:00:45.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 -- 172.21.15.152:0/3847529036 learned_addr learned my addr 172.21.15.152:0/3847529036 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159dcb6640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15980b3860 0x7f159815cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159e4b7640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15980b3400 0x7f1598144600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 -- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15980b3860 msgr2=0x7f159815cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15980b3860 0x7f159815cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 -- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15980b3400 msgr2=0x7f1598144600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15980b3400 0x7f1598144600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 -- 172.21.15.152:0/3847529036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1598153580 con 0x7f159815ad40 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f159ecb8640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f159000caf0 tx=0x7f159000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590017070 con 0x7f159815ad40 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.230+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f159000aca0 con 0x7f159815ad40 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.231+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1598153860 con 0x7f159815ad40 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.231+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1590012600 con 0x7f159815ad40 2024-03-18T15:00:45.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.231+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1598153e20 con 0x7f159815ad40 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.231+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f159804f5b0 con 0x7f159815ad40 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.232+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f159001a070 con 0x7f159815ad40 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.232+0000 7f158effd640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 0x7f157c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.232+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f159008a3a0 con 0x7f159815ad40 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.232+0000 7f159e4b7640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 0x7f157c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.233+0000 7f159e4b7640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 0x7f157c06e090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15940079a0 tx=0x7f1594008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.237+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1590058b90 con 0x7f159815ad40 2024-03-18T15:00:45.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.447+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f15980cf390 con 0x7f159815ad40 2024-03-18T15:00:45.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.447+0000 7f158effd640 1 -- 172.21.15.152:0/3847529036 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3870 (secure 0 0 0) 0x7f159005cc30 con 0x7f159815ad40 2024-03-18T15:00:45.448 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:45.448 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4290,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-03-18T15:00:45.448 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 3 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 msgr2=0x7f157c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 0x7f157c06e090 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f15940079a0 tx=0x7f1594008040 comp rx=0 tx=0).stop 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 msgr2=0x7f159815d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f159000caf0 tx=0x7f159000a060 comp rx=0 tx=0).stop 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 shutdown_connections 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f159815ad40 0x7f159815d100 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f157c06bbd0 0x7f157c06e090 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f15980b3860 0x7f159815cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 --2- 172.21.15.152:0/3847529036 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f15980b3400 0x7f1598144600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 >> 172.21.15.152:0/3847529036 conn(0x7f159806b5e0 msgr2=0x7f159815dd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:45.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 shutdown_connections 2024-03-18T15:00:45.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.449+0000 7f15a071b640 1 -- 172.21.15.152:0/3847529036 wait complete. 2024-03-18T15:00:45.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:45.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.561+0000 7fafaf062640 1 Processor -- start 2024-03-18T15:00:45.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.561+0000 7fafaf062640 1 -- start start 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.561+0000 7fafaf062640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fafa80d07f0 0x7fafa8165da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafaf062640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa815ee60 con 0x7fafa815ad40 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafaf062640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fafa815f140 con 0x7fafa80ad800 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafaf062640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fafa80b3b10 con 0x7fafa80d07f0 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafad5ff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fafa80d07f0 0x7fafa8165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafacdfe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fafa815ad40 0x7fafa80b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39758/0 (socket says 172.21.15.152:39758) 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafacdfe640 1 -- 172.21.15.152:0/3296444070 learned_addr learned my addr 172.21.15.152:0/3296444070 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafad5ff640 1 -- 172.21.15.152:0/3296444070 >> v1:172.21.15.186:6789/0 conn(0x7fafa80ad800 legacy=0x7fafa80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafad5ff640 1 -- 172.21.15.152:0/3296444070 >> v1:172.21.15.152:6789/0 conn(0x7fafa815ad40 legacy=0x7fafa80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafad5ff640 1 -- 172.21.15.152:0/3296444070 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa815f420 con 0x7fafa80d07f0 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.562+0000 7fafa77fe640 1 -- 172.21.15.152:0/3296444070 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1635703857 0 0) 0x7fafa815ee60 con 0x7fafa815ad40 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafad5ff640 1 --2- 172.21.15.152:0/3296444070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa8165da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009d90 tx=0x7fafa002beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1eba6d704b4cfe server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafa77fe640 1 -- 172.21.15.152:0/3296444070 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0039070 con 0x7fafa80d07f0 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafa77fe640 1 -- 172.21.15.152:0/3296444070 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fafa002cc60 con 0x7fafa80d07f0 2024-03-18T15:00:45.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafa77fe640 1 -- 172.21.15.152:0/3296444070 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa0034660 con 0x7fafa80d07f0 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafaf062640 1 -- 172.21.15.152:0/3296444070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 msgr2=0x7fafa8165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafaf062640 1 --2- 172.21.15.152:0/3296444070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa8165da0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fafa0009d90 tx=0x7fafa002beb0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafaf062640 1 -- 172.21.15.152:0/3296444070 shutdown_connections 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafaf062640 1 --2- 172.21.15.152:0/3296444070 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa8165da0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.563+0000 7fafaf062640 1 -- 172.21.15.152:0/3296444070 >> 172.21.15.152:0/3296444070 conn(0x7fafa806b5e0 msgr2=0x7fafa806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.564+0000 7fafaf062640 1 -- 172.21.15.152:0/3296444070 shutdown_connections 2024-03-18T15:00:45.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.564+0000 7fafaf062640 1 -- 172.21.15.152:0/3296444070 wait complete. 2024-03-18T15:00:45.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 Processor -- start 2024-03-18T15:00:45.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 -- start start 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa80ad800 0x7fafa8155470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa815ad40 0x7fafa809d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fafa815b2a0 con 0x7fafa80d07f0 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fafa815b120 con 0x7fafa80ad800 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.565+0000 7fafaf062640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fafa815ea10 con 0x7fafa815ad40 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51386/0 (socket says 172.21.15.152:51386) 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 -- 172.21.15.152:0/2227668011 learned_addr learned my addr 172.21.15.152:0/2227668011 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafacdfe640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa80ad800 0x7fafa8155470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 -- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa815ad40 msgr2=0x7fafa809d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafad5ff640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa815ad40 0x7fafa809d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa815ad40 0x7fafa809d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 -- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa80ad800 msgr2=0x7fafa8155470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa80ad800 0x7fafa8155470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 -- 172.21.15.152:0/2227668011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafa8158800 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa7fff640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c480 tx=0x7faf9400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf940052d0 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf94005470 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafa8158ae0 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf94012870 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.566+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafa81590a0 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.567+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafa804f5b0 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.568+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7faf94012a10 con 0x7fafa80d07f0 2024-03-18T15:00:45.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.568+0000 7fafa57fa640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 0x7faf8c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.568+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7faf9408a320 con 0x7fafa80d07f0 2024-03-18T15:00:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.568+0000 7fafacdfe640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 0x7faf8c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.568+0000 7fafacdfe640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 0x7faf8c06e090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf9c000f60 tx=0x7faf9c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.572+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7faf940591f0 con 0x7fafa80d07f0 2024-03-18T15:00:45.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.746+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fafa8155f30 con 0x7fafa80d07f0 2024-03-18T15:00:45.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.746+0000 7fafa57fa640 1 -- 172.21.15.152:0/2227668011 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) ==== 74+0+12932 (secure 0 0 0) 0x7faf94058af0 con 0x7fafa80d07f0 2024-03-18T15:00:45.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:45.747 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":18,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:38.536327+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 msgr2=0x7faf8c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 0x7faf8c06e090 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7faf9c000f60 tx=0x7faf9c009040 comp rx=0 tx=0).stop 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 msgr2=0x7fafa80b20f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7faf9400c480 tx=0x7faf9400c940 comp rx=0 tx=0).stop 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 shutdown_connections 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7faf8c06bbd0 0x7faf8c06e090 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fafa815ad40 0x7fafa809d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fafa80d07f0 0x7fafa80b20f0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 --2- 172.21.15.152:0/2227668011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fafa80ad800 0x7fafa8155470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.748+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 >> 172.21.15.152:0/2227668011 conn(0x7fafa806b5e0 msgr2=0x7fafa806e420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.749+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 shutdown_connections 2024-03-18T15:00:45.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.749+0000 7fafaf062640 1 -- 172.21.15.152:0/2227668011 wait complete. 2024-03-18T15:00:45.760 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:00:45.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:00:45.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.864+0000 7f82bb777640 1 Processor -- start 2024-03-18T15:00:45.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.864+0000 7f82bb777640 1 -- start start 2024-03-18T15:00:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82bb777640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82b406e080 0x7f82b40cfdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82bb777640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b40cd5f0 con 0x7f82b406b1c0 2024-03-18T15:00:45.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82bb777640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f82b40709f0 con 0x7f82b415e3f0 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82bb777640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f82b40cb740 con 0x7f82b406e080 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9d14640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f82b406e080 0x7f82b40cfdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9513640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f82b406b1c0 0x7f82b406b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39764/0 (socket says 172.21.15.152:39764) 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9513640 1 -- 172.21.15.152:0/3652378573 learned_addr learned my addr 172.21.15.152:0/3652378573 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9d14640 1 -- 172.21.15.152:0/3652378573 >> v1:172.21.15.186:6789/0 conn(0x7f82b415e3f0 legacy=0x7f82b40702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9d14640 1 -- 172.21.15.152:0/3652378573 >> v1:172.21.15.152:6789/0 conn(0x7f82b406b1c0 legacy=0x7f82b406b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82abfff640 1 -- 172.21.15.152:0/3652378573 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 597527471 0 0) 0x7f82b40cd5f0 con 0x7f82b406b1c0 2024-03-18T15:00:45.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.865+0000 7f82b9d14640 1 -- 172.21.15.152:0/3652378573 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b40cba20 con 0x7f82b406e080 2024-03-18T15:00:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82b9d14640 1 --2- 172.21.15.152:0/3652378573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b406e080 0x7f82b40cfdd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009d90 tx=0x7f82ac02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2225103b56058860 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82abfff640 1 -- 172.21.15.152:0/3652378573 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac039070 con 0x7f82b406e080 2024-03-18T15:00:45.867 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82abfff640 1 -- 172.21.15.152:0/3652378573 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac02cd80 con 0x7f82b406e080 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82abfff640 1 -- 172.21.15.152:0/3652378573 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac034660 con 0x7f82b406e080 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82bb777640 1 -- 172.21.15.152:0/3652378573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b406e080 msgr2=0x7f82b40cfdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82bb777640 1 --2- 172.21.15.152:0/3652378573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b406e080 0x7f82b40cfdd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009d90 tx=0x7f82ac02bfd0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82bb777640 1 -- 172.21.15.152:0/3652378573 shutdown_connections 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82bb777640 1 --2- 172.21.15.152:0/3652378573 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b406e080 0x7f82b40cfdd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.866+0000 7f82bb777640 1 -- 172.21.15.152:0/3652378573 >> 172.21.15.152:0/3652378573 conn(0x7f82b40b2b20 msgr2=0x7f82b40b2f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.867+0000 7f82bb777640 1 -- 172.21.15.152:0/3652378573 shutdown_connections 2024-03-18T15:00:45.868 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.867+0000 7f82bb777640 1 -- 172.21.15.152:0/3652378573 wait complete. 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 Processor -- start 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 -- start start 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 0x7f82b415e7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 0x7f82b414dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40cbd00 con 0x7f82b415e3f0 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f82b40cf8b0 con 0x7f82b406e080 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82bb777640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f82b406e510 con 0x7f82b406b1c0 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.868+0000 7f82b9d14640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51412/0 (socket says 172.21.15.152:51412) 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 -- 172.21.15.152:0/2926240295 learned_addr learned my addr 172.21.15.152:0/2926240295 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:45.871 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b8d12640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 0x7f82b414dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9513640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 0x7f82b415e7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 -- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 msgr2=0x7f82b415e7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 0x7f82b415e7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 -- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 msgr2=0x7f82b414dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 0x7f82b414dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 -- 172.21.15.152:0/2926240295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82b41f7e90 con 0x7f82b415e3f0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b8d12640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 0x7f82b414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9513640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 0x7f82b415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82b9d14640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009eb0 tx=0x7f82ac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac044020 con 0x7f82b415e3f0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82ac03f470 con 0x7f82b415e3f0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82b41f3840 con 0x7f82b415e3f0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82ac039040 con 0x7f82b415e3f0 2024-03-18T15:00:45.872 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.869+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82b40c99f0 con 0x7f82b415e3f0 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.870+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82b40ca1c0 con 0x7f82b415e3f0 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.871+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f82ac047020 con 0x7f82b415e3f0 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.871+0000 7f82a9ffb640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 0x7f829806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.871+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f82ac0ad2a0 con 0x7f82b415e3f0 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.871+0000 7f82b9513640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 0x7f829806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:45.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.871+0000 7f82b9513640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 0x7f829806e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82b0000f60 tx=0x7f82b0007c50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:45.875 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:45.875+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f82ac04e030 con 0x7f82b415e3f0 2024-03-18T15:00:46.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.048+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f82b40c97e0 con 0x7f82b415e3f0 2024-03-18T15:00:46.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.048+0000 7f82a9ffb640 1 -- 172.21.15.152:0/2926240295 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v18) ==== 93+0+10 (secure 0 0 0) 0x7f82ac07c170 con 0x7f82b415e3f0 2024-03-18T15:00:46.049 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 msgr2=0x7f829806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 0x7f829806e090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f82b0000f60 tx=0x7f82b0007c50 comp rx=0 tx=0).stop 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 msgr2=0x7f82b40723c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f82ac009eb0 tx=0x7f82ac004a40 comp rx=0 tx=0).stop 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 shutdown_connections 2024-03-18T15:00:46.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f82b415e3f0 0x7f82b40723c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f82b406e080 0x7f82b414dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f829806bbd0 0x7f829806e090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 --2- 172.21.15.152:0/2926240295 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f82b406b1c0 0x7f82b415e7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 >> 172.21.15.152:0/2926240295 conn(0x7f82b40b2b20 msgr2=0x7f82b40cfdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 shutdown_connections 2024-03-18T15:00:46.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.050+0000 7f82bb777640 1 -- 172.21.15.152:0/2926240295 wait complete. 2024-03-18T15:00:46.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T15:00:46.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.162+0000 7f20da95b640 1 Processor -- start 2024-03-18T15:00:46.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.162+0000 7f20da95b640 1 -- start start 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20da95b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f20d415ad40 0x7f20d40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20da95b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 0x7f20d40722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20da95b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d415ee60 con 0x7f20d40b3400 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20da95b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f20d415f140 con 0x7f20d415ad40 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20da95b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f20d415f420 con 0x7f20d40d07f0 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f20d415ad40 0x7f20d40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d37fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f20d40b3400 0x7f20d40d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39770/0 (socket says 172.21.15.152:39770) 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f20d415ad40 0x7f20d40ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51416/0 (socket says 172.21.15.152:51416) 2024-03-18T15:00:46.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d37fe640 1 -- 172.21.15.152:0/1556423785 learned_addr learned my addr 172.21.15.152:0/1556423785 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d8ef8640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 0x7f20d40722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 -- 172.21.15.152:0/1556423785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 msgr2=0x7f20d40722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 0x7f20d40722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 -- 172.21.15.152:0/1556423785 >> v1:172.21.15.152:6789/0 conn(0x7f20d40b3400 legacy=0x7f20d40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d3fff640 1 -- 172.21.15.152:0/1556423785 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d415f700 con 0x7f20d415ad40 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d2ffd640 1 -- 172.21.15.152:0/1556423785 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2770150380 0 0) 0x7f20d415ee60 con 0x7f20d40b3400 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.163+0000 7f20d8ef8640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 0x7f20d40722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20d3fff640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d415ad40 0x7f20d40ad800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20c40097a0 tx=0x7f20c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8512112cb6051067 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20d2ffd640 1 -- 172.21.15.152:0/1556423785 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c40315a0 con 0x7f20d415ad40 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20d2ffd640 1 -- 172.21.15.152:0/1556423785 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c4037070 con 0x7f20d415ad40 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20d2ffd640 1 -- 172.21.15.152:0/1556423785 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4031960 con 0x7f20d415ad40 2024-03-18T15:00:46.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 -- 172.21.15.152:0/1556423785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d415ad40 msgr2=0x7f20d40ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d415ad40 0x7f20d40ad800 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20c40097a0 tx=0x7f20c402b840 comp rx=0 tx=0).stop 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 -- 172.21.15.152:0/1556423785 shutdown_connections 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d40d07f0 0x7f20d40722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 --2- 172.21.15.152:0/1556423785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d415ad40 0x7f20d40ad800 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 -- 172.21.15.152:0/1556423785 >> 172.21.15.152:0/1556423785 conn(0x7f20d406b5e0 msgr2=0x7f20d406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 -- 172.21.15.152:0/1556423785 shutdown_connections 2024-03-18T15:00:46.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.164+0000 7f20da95b640 1 -- 172.21.15.152:0/1556423785 wait complete. 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 Processor -- start 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 -- start start 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20d40d07f0 0x7f20d40b13f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d415ad40 0x7f20d4148710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20d415ea10 con 0x7f20d40b3400 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20d415b330 con 0x7f20d40d07f0 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.166+0000 7f20da95b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f20d415eb90 con 0x7f20d415ad40 2024-03-18T15:00:46.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51420/0 (socket says 172.21.15.152:51420) 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 -- 172.21.15.152:0/2058284942 learned_addr learned my addr 172.21.15.152:0/2058284942 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 -- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d415ad40 msgr2=0x7f20d4148710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d415ad40 0x7f20d4148710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 -- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20d40d07f0 msgr2=0x7f20d40b13f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20d40d07f0 0x7f20d40b13f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 -- 172.21.15.152:0/2058284942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d41516b0 con 0x7f20d40b3400 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d3fff640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20c40097a0 tx=0x7f20c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4032840 con 0x7f20d40b3400 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c40329e0 con 0x7f20d40b3400 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d4152120 con 0x7f20d40b3400 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c4032dd0 con 0x7f20d40b3400 2024-03-18T15:00:46.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.167+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d41526e0 con 0x7f20d40b3400 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.168+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d404f5b0 con 0x7f20d40b3400 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.168+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f20c403b3f0 con 0x7f20d40b3400 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.169+0000 7f20d0ff9640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 0x7f20c006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.169+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f20c402f030 con 0x7f20d40b3400 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.169+0000 7f20d37fe640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 0x7f20c006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.169+0000 7f20d37fe640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 0x7f20c006e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20c8007fd0 tx=0x7f20c8007960 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.173+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f20c4040070 con 0x7f20d40b3400 2024-03-18T15:00:46.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.348+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f20d4071ad0 con 0x7f20d40b3400 2024-03-18T15:00:46.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.348+0000 7f20d0ff9640 1 -- 172.21.15.152:0/2058284942 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v18) ==== 84+0+65 (secure 0 0 0) 0x7f20c407b460 con 0x7f20d40b3400 2024-03-18T15:00:46.350 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:46.350 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2024-03-18T15:00:46.350 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:00:46.350 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2024-03-18T15:00:46.351 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2024-03-18T15:00:46.351 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:00:46.351 INFO:teuthology.orchestra.run.smithi152.stdout:] 2024-03-18T15:00:46.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 msgr2=0x7f20c006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 0x7f20c006e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f20c8007fd0 tx=0x7f20c8007960 comp rx=0 tx=0).stop 2024-03-18T15:00:46.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 msgr2=0x7f20d4151170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f20c40097a0 tx=0x7f20c40046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 shutdown_connections 2024-03-18T15:00:46.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20c006bbd0 0x7f20c006e090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d415ad40 0x7f20d4148710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20d40d07f0 0x7f20d40b13f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 --2- 172.21.15.152:0/2058284942 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d40b3400 0x7f20d4151170 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.350+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 >> 172.21.15.152:0/2058284942 conn(0x7f20d406b5e0 msgr2=0x7f20d415dd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:46.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.351+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 shutdown_connections 2024-03-18T15:00:46.355 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.351+0000 7f20da95b640 1 -- 172.21.15.152:0/2058284942 wait complete. 2024-03-18T15:00:46.362 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T15:00:46.362 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T15:00:46.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.466+0000 7f7e18bd3640 1 Processor -- start 2024-03-18T15:00:46.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.466+0000 7f7e18bd3640 1 -- start start 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e18bd3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e18bd3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7e140cfbe0 0x7f7e140d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e18bd3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7e1415e870 con 0x7f7e140d16c0 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e18bd3640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7e140d06b0 con 0x7f7e140cfbe0 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e18bd3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7e140d1230 con 0x7f7e1415e490 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e11d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7e140cfbe0 0x7f7e140d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e11d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7e140cfbe0 0x7f7e140d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51434/0 (socket says 172.21.15.152:51434) 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e12d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7e140d16c0 0x7f7e14161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39780/0 (socket says 172.21.15.152:39780) 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.467+0000 7f7e11d9b640 1 -- 172.21.15.152:0/1525018604 learned_addr learned my addr 172.21.15.152:0/1525018604 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e1259c640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e11d9b640 1 -- 172.21.15.152:0/1525018604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 msgr2=0x7f7e140cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e11d9b640 1 -- 172.21.15.152:0/1525018604 >> v1:172.21.15.152:6789/0 conn(0x7f7e140d16c0 legacy=0x7f7e14161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e1159a640 1 -- 172.21.15.152:0/1525018604 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3626601718 0 0) 0x7f7e1415e870 con 0x7f7e140d16c0 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e11d9b640 1 -- 172.21.15.152:0/1525018604 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e140d0900 con 0x7f7e140cfbe0 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140d2660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009870 tx=0x7f7e0802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=464bc1e2161e0008 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.468+0000 7f7e1159a640 1 -- 172.21.15.152:0/1525018604 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e08035020 con 0x7f7e140cfbe0 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e1159a640 1 -- 172.21.15.152:0/1525018604 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e08031640 con 0x7f7e140cfbe0 2024-03-18T15:00:46.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e1159a640 1 -- 172.21.15.152:0/1525018604 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e0802d040 con 0x7f7e140cfbe0 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 -- 172.21.15.152:0/1525018604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 msgr2=0x7f7e140d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140d2660 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f7e08009870 tx=0x7f7e0802b8f0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 -- 172.21.15.152:0/1525018604 shutdown_connections 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140d2660 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/1525018604 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 -- 172.21.15.152:0/1525018604 >> 172.21.15.152:0/1525018604 conn(0x7f7e140d4080 msgr2=0x7f7e140d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:46.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 -- 172.21.15.152:0/1525018604 shutdown_connections 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.469+0000 7f7e18bd3640 1 -- 172.21.15.152:0/1525018604 wait complete. 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.470+0000 7f7e18bd3640 1 Processor -- start 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 -- start start 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 0x7f7e140b6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140b7130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140d2220 con 0x7f7e140cfbe0 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7e140d0ec0 con 0x7f7e140d16c0 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e18bd3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7e140d23a0 con 0x7f7e1415e490 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51442/0 (socket says 172.21.15.152:51442) 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.471+0000 7f7e1259c640 1 -- 172.21.15.152:0/421983887 learned_addr learned my addr 172.21.15.152:0/421983887 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 0x7f7e140b6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e12d9d640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140b7130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 -- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 msgr2=0x7f7e140b7130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140b7130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 -- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 msgr2=0x7f7e140b6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 0x7f7e140b6bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 -- 172.21.15.152:0/421983887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e140b9ab0 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 0x7f7e140b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e1259c640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e04007f20 tx=0x7f7e0400e570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04014620 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e04019070 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e140b9d90 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e04014a00 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.472+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1414b3d0 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.473+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e140b9f60 con 0x7f7e140cfbe0 2024-03-18T15:00:46.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.473+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7e04014ba0 con 0x7f7e140cfbe0 2024-03-18T15:00:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.474+0000 7f7e02ffd640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 0x7f7df406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.474+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 4857+0+0 (secure 0 0 0) 0x7f7e0408b060 con 0x7f7e140cfbe0 2024-03-18T15:00:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.474+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 0x7f7df406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:46.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.474+0000 7f7e11d9b640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 0x7f7df406e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e08036000 tx=0x7f7e08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:46.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.478+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7e140b9f60 con 0x7f7e140cfbe0 2024-03-18T15:00:46.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:46.651+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7e1415fab0 con 0x7f7e140cfbe0 2024-03-18T15:00:47.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.576+0000 7f7e02ffd640 1 -- 172.21.15.152:0/421983887 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v19) ==== 138+0+0 (secure 0 0 0) 0x7f7e04059ea0 con 0x7f7e140cfbe0 2024-03-18T15:00:47.576 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 msgr2=0x7f7df406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 0x7f7df406e090 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7e08036000 tx=0x7f7e08008030 comp rx=0 tx=0).stop 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 msgr2=0x7f7e140ca4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f7e04007f20 tx=0x7f7e0400e570 comp rx=0 tx=0).stop 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 shutdown_connections 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7df406bbd0 0x7f7df406e090 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7e1415e490 0x7f7e140b7130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7e140d16c0 0x7f7e140b6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 --2- 172.21.15.152:0/421983887 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7e140cfbe0 0x7f7e140ca4e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.578+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 >> 172.21.15.152:0/421983887 conn(0x7f7e140d4080 msgr2=0x7f7e140b3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.579+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 shutdown_connections 2024-03-18T15:00:47.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.579+0000 7f7e18bd3640 1 -- 172.21.15.152:0/421983887 wait complete. 2024-03-18T15:00:47.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T15:00:47.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.708+0000 7f7681827640 1 Processor -- start 2024-03-18T15:00:47.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.708+0000 7f7681827640 1 -- start start 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7681827640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f767c0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7681827640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c0cffe0 con 0x7f767c0b4ec0 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7681827640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f767c0cfa20 con 0x7f767c161890 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7681827640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0cfd00 con 0x7f767c0d1070 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767b7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f767c0b4ec0 0x7f767c0d2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39794/0 (socket says 172.21.15.152:39794) 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767b7fe640 1 -- 172.21.15.152:0/1393434383 learned_addr learned my addr 172.21.15.152:0/1393434383 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1931272287 0 0) 0x7f767c0cffe0 con 0x7f767c0b4ec0 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7668003520 con 0x7f767c0b4ec0 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7673fff640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f767c0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3225318239 0 0) 0x7f7668003520 con 0x7f767c0b4ec0 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 msgr2=0x7f767c0d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:47.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f767c0d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 >> v1:172.21.15.186:6789/0 conn(0x7f767c161890 legacy=0x7f767c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c0cf710 con 0x7f767c0b4ec0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f76740019f0 con 0x7f767c0b4ec0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 >> v1:172.21.15.152:6789/0 conn(0x7f767c0b4ec0 legacy=0x7f767c0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76680039e0 0x7f7668003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f7668004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668004d40 0x7f76680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0cfd00 con 0x7f7668004d40 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f766800ba70 con 0x7f76680039e0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f766800bc70 con 0x7f767c0d1070 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767b7fe640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668004d40 0x7f76680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f767affd640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76680039e0 0x7f7668003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.709+0000 7f7673fff640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f7668004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 -- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 msgr2=0x7f7668004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f767c0d1070 0x7f7668004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 -- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76680039e0 msgr2=0x7f7668003e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76680039e0 0x7f7668003e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 -- 172.21.15.152:0/1393434383 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7668003520 con 0x7f7668004d40 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767b7fe640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668004d40 0x7f76680051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7674002230 tx=0x7f7668005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bfb19429483fb51 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.710+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767400a4a0 con 0x7f7668004d40 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674034650 con 0x7f7668004d40 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f767a7fc640 1 -- 172.21.15.152:0/1393434383 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674034a40 con 0x7f7668004d40 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 -- 172.21.15.152:0/1393434383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668004d40 msgr2=0x7f76680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 --2- 172.21.15.152:0/1393434383 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7668004d40 0x7f76680051c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7674002230 tx=0x7f7668005830 comp rx=0 tx=0).stop 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f767b7fe640 1 -- 172.21.15.152:0/1393434383 reap_dead start 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 -- 172.21.15.152:0/1393434383 shutdown_connections 2024-03-18T15:00:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 -- 172.21.15.152:0/1393434383 >> 172.21.15.152:0/1393434383 conn(0x7f767c0d4090 msgr2=0x7f767c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 -- 172.21.15.152:0/1393434383 shutdown_connections 2024-03-18T15:00:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.711+0000 7f7681827640 1 -- 172.21.15.152:0/1393434383 wait complete. 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.712+0000 7f7681827640 1 Processor -- start 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.712+0000 7f7681827640 1 -- start start 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7668004d40 0x7f767c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 0x7f767c159890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0d4bb0 con 0x7f767c159dd0 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f767c0b5580 con 0x7f767c1569d0 2024-03-18T15:00:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7681827640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f767c0d4d30 con 0x7f7668004d40 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51450/0 (socket says 172.21.15.152:51450) 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 -- 172.21.15.152:0/3559532244 learned_addr learned my addr 172.21.15.152:0/3559532244 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767affd640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7668004d40 0x7f767c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7673fff640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 0x7f767c159890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 -- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7668004d40 msgr2=0x7f767c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7668004d40 0x7f767c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 -- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 msgr2=0x7f767c159890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 0x7f767c159890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f767b7fe640 1 -- 172.21.15.152:0/3559532244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f767c15a2e0 con 0x7f767c159dd0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.713+0000 7f7673fff640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 0x7f767c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f767b7fe640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f767400a940 tx=0x7f7674001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f767400a480 con 0x7f767c159dd0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7674044070 con 0x7f767c159dd0 2024-03-18T15:00:47.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f767c15a5c0 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7674034a20 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.714+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f767c0c8bb0 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.715+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f767c0c8db0 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.715+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7674034bc0 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.716+0000 7f7678ff9640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 0x7f765c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.716+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5227+0+0 (secure 0 0 0) 0x7f76740acc00 con 0x7f767c159dd0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.716+0000 7f767affd640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 0x7f765c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.716+0000 7f767affd640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 0x7f765c06e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f766c0017e0 tx=0x7f766c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:47.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.720+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f767c0c8db0 con 0x7f767c159dd0 2024-03-18T15:00:47.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:47.895+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f767c08d7e0 con 0x7f767c159dd0 2024-03-18T15:00:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.582+0000 7f7678ff9640 1 -- 172.21.15.152:0/3559532244 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v20) ==== 170+0+0 (secure 0 0 0) 0x7f76740b3080 con 0x7f767c159dd0 2024-03-18T15:00:48.583 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 msgr2=0x7f765c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 0x7f765c06e090 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f766c0017e0 tx=0x7f766c009040 comp rx=0 tx=0).stop 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 msgr2=0x7f767c1f3890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f767400a940 tx=0x7f7674001dc0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 shutdown_connections 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f767c159dd0 0x7f767c1f3890 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f767c1569d0 0x7f767c159890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f765c06bbd0 0x7f765c06e090 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 --2- 172.21.15.152:0/3559532244 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7668004d40 0x7f767c157b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 >> 172.21.15.152:0/3559532244 conn(0x7f767c0d4090 msgr2=0x7f767c0b5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:48.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.585+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 shutdown_connections 2024-03-18T15:00:48.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.586+0000 7f7681827640 1 -- 172.21.15.152:0/3559532244 wait complete. 2024-03-18T15:00:48.609 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T15:00:48.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.716+0000 7fd5e740b640 1 Processor -- start 2024-03-18T15:00:48.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.716+0000 7fd5e740b640 1 -- start start 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e740b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e740b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 0x7fd5e0071a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e740b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd5e0071fc0 con 0x7fd5e006b930 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e740b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd5e006efc0 con 0x7fd5e006c570 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e740b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e006b1c0 con 0x7fd5e00716a0 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e51a7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e49a6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 0x7fd5e0071a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e59a8640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd5e006b930 0x7fd5e00cef60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:57288/0 (socket says 172.21.15.152:57288) 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e59a8640 1 -- 172.21.15.152:0/581571015 learned_addr learned my addr 172.21.15.152:0/581571015 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5d7fff640 1 -- 172.21.15.152:0/581571015 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 965037152 0 0) 0x7fd5e0071fc0 con 0x7fd5e006b930 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5d7fff640 1 -- 172.21.15.152:0/581571015 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd5cc003520 con 0x7fd5e006b930 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e51a7640 1 -- 172.21.15.152:0/581571015 >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 msgr2=0x7fd5e0071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e51a7640 1 --2- 172.21.15.152:0/581571015 >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 0x7fd5e0071a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e51a7640 1 -- 172.21.15.152:0/581571015 >> v1:172.21.15.186:6789/0 conn(0x7fd5e006b930 legacy=0x7fd5e00cef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.717+0000 7fd5e51a7640 1 -- 172.21.15.152:0/581571015 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e006d700 con 0x7fd5e00716a0 2024-03-18T15:00:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.718+0000 7fd5e49a6640 1 --2- 172.21.15.152:0/581571015 >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 0x7fd5e0071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:48.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.718+0000 7fd5e51a7640 1 --2- 172.21.15.152:0/581571015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e006ea80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009d90 tx=0x7fd5dc02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cab0b4e303a7d304 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:48.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.718+0000 7fd5d7fff640 1 -- 172.21.15.152:0/581571015 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc039070 con 0x7fd5e00716a0 2024-03-18T15:00:48.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.718+0000 7fd5d7fff640 1 -- 172.21.15.152:0/581571015 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc02cc50 con 0x7fd5e00716a0 2024-03-18T15:00:48.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.718+0000 7fd5d7fff640 1 -- 172.21.15.152:0/581571015 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc034440 con 0x7fd5e00716a0 2024-03-18T15:00:48.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 -- 172.21.15.152:0/581571015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 msgr2=0x7fd5e006ea80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 --2- 172.21.15.152:0/581571015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e006ea80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc009d90 tx=0x7fd5dc02bea0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 -- 172.21.15.152:0/581571015 shutdown_connections 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 --2- 172.21.15.152:0/581571015 >> v2:172.21.15.186:3300/0 conn(0x7fd5e006c570 0x7fd5e0071a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 --2- 172.21.15.152:0/581571015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e006ea80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 -- 172.21.15.152:0/581571015 >> 172.21.15.152:0/581571015 conn(0x7fd5e00cd040 msgr2=0x7fd5e00cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 -- 172.21.15.152:0/581571015 shutdown_connections 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.719+0000 7fd5e740b640 1 -- 172.21.15.152:0/581571015 wait complete. 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.720+0000 7fd5e740b640 1 Processor -- start 2024-03-18T15:00:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.720+0000 7fd5e740b640 1 -- start start 2024-03-18T15:00:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 0x7fd5e0148140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e0160c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006dcc0 con 0x7fd5e006c570 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5e006b4a0 con 0x7fd5e006b930 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e740b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd5e00cf670 con 0x7fd5e00716a0 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e49a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 0x7fd5e0148140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e49a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51460/0 (socket says 172.21.15.152:51460) 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e49a6640 1 -- 172.21.15.152:0/1363084261 learned_addr learned my addr 172.21.15.152:0/1363084261 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e59a8640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e0160c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 -- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 msgr2=0x7fd5e0160c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e0160c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 -- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 msgr2=0x7fd5e0160750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e51a7640 1 -- 172.21.15.152:0/1363084261 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5e01554f0 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.721+0000 7fd5e49a6640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5e51a7640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 0x7fd5e0148140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc033000 tx=0x7fd5dc004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc042030 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd5dc03a040 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5e01557d0 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5dc039070 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.722+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5e0155d90 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.723+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5e00737b0 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.723+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd5dc045070 con 0x7fd5e006b930 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.724+0000 7fd5d5ffb640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 0x7fd5c406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:48.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.724+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5609+0+0 (secure 0 0 0) 0x7fd5dc0ac800 con 0x7fd5e006b930 2024-03-18T15:00:48.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.724+0000 7fd5e49a6640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 0x7fd5c406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:48.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.724+0000 7fd5e49a6640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 0x7fd5c406e090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0154370 tx=0x7fd5d0009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.729+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd5e00737b0 con 0x7fd5e006b930 2024-03-18T15:00:48.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:48.940+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd5e004f540 con 0x7fd5e006b930 2024-03-18T15:00:49.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.589+0000 7fd5d5ffb640 1 -- 172.21.15.152:0/1363084261 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fd5dc0ac0c0 con 0x7fd5e006b930 2024-03-18T15:00:49.589 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 2 and data pool 3 2024-03-18T15:00:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.605+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 msgr2=0x7fd5c406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.605+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 0x7fd5c406e090 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0154370 tx=0x7fd5d0009190 comp rx=0 tx=0).stop 2024-03-18T15:00:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.605+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 msgr2=0x7fd5e0148140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.605+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 0x7fd5e0148140 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fd5dc033000 tx=0x7fd5dc004a40 comp rx=0 tx=0).stop 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 shutdown_connections 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd5c406bbd0 0x7fd5c406e090 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5e00716a0 0x7fd5e0160c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5e006c570 0x7fd5e0160750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 --2- 172.21.15.152:0/1363084261 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5e006b930 0x7fd5e0148140 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.606+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 >> 172.21.15.152:0/1363084261 conn(0x7fd5e00cd040 msgr2=0x7fd5e00b5110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.607+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 shutdown_connections 2024-03-18T15:00:49.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.607+0000 7fd5e740b640 1 -- 172.21.15.152:0/1363084261 wait complete. 2024-03-18T15:00:49.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:49.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.725+0000 7f24e63d4640 1 Processor -- start 2024-03-18T15:00:49.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.725+0000 7f24e63d4640 1 -- start start 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24e63d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0146c20 0x7f24e00d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24e63d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24e01473f0 0x7f24e00d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24e63d4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24e0161d00 con 0x7f24e0147940 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24e63d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f24e0161fe0 con 0x7f24e01473f0 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24e63d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f24e01622c0 con 0x7f24e0146c20 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24e01473f0 0x7f24e00d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24e01473f0 0x7f24e00d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51462/0 (socket says 172.21.15.152:51462) 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 -- 172.21.15.152:0/3436411091 learned_addr learned my addr 172.21.15.152:0/3436411091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24dffff640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0146c20 0x7f24e00d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 -- 172.21.15.152:0/3436411091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0146c20 msgr2=0x7f24e00d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0146c20 0x7f24e00d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 -- 172.21.15.152:0/3436411091 >> v1:172.21.15.186:6789/0 conn(0x7f24e0147940 legacy=0x7f24e006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.726+0000 7f24df7fe640 1 -- 172.21.15.152:0/3436411091 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e01625a0 con 0x7f24e01473f0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.727+0000 7f24df7fe640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e00d0620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009870 tx=0x7f24d402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af64dd0750457bc5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.727+0000 7f24deffd640 1 -- 172.21.15.152:0/3436411091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4034070 con 0x7f24e01473f0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.727+0000 7f24deffd640 1 -- 172.21.15.152:0/3436411091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d4030840 con 0x7f24e01473f0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.727+0000 7f24deffd640 1 -- 172.21.15.152:0/3436411091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4030c10 con 0x7f24e01473f0 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 -- 172.21.15.152:0/3436411091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 msgr2=0x7f24e00d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e00d0620 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f24d4009870 tx=0x7f24d402b980 comp rx=0 tx=0).stop 2024-03-18T15:00:49.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 -- 172.21.15.152:0/3436411091 shutdown_connections 2024-03-18T15:00:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e00d0620 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3436411091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0146c20 0x7f24e00d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 -- 172.21.15.152:0/3436411091 >> 172.21.15.152:0/3436411091 conn(0x7f24e006b5e0 msgr2=0x7f24e006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 -- 172.21.15.152:0/3436411091 shutdown_connections 2024-03-18T15:00:49.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.728+0000 7f24e63d4640 1 -- 172.21.15.152:0/3436411091 wait complete. 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.729+0000 7f24e63d4640 1 Processor -- start 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.729+0000 7f24e63d4640 1 -- start start 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 0x7f24e01e9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 0x7f24e0160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b5230 con 0x7f24e01473f0 2024-03-18T15:00:49.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f24e00b50b0 con 0x7f24e0146c20 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f24e0147000 con 0x7f24e0147940 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51478/0 (socket says 172.21.15.152:51478) 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 -- 172.21.15.152:0/3408527627 learned_addr learned my addr 172.21.15.152:0/3408527627 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e4971640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 0x7f24e0160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24dffff640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 0x7f24e01e9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 -- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 msgr2=0x7f24e0160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 0x7f24e0160540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 -- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 msgr2=0x7f24e01e9150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 0x7f24e01e9150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 -- 172.21.15.152:0/3408527627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24e0160a80 con 0x7f24e01473f0 2024-03-18T15:00:49.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e4971640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 0x7f24e0160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24dffff640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 0x7f24e01e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24df7fe640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24d4000c00 tx=0x7f24d4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4048070 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24d4030640 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24d4034040 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.730+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24e01e9cf0 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.731+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24e01e7bc0 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.731+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24e004f5b0 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.732+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f24d404b070 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.732+0000 7f24dcff9640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 0x7f24cc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.732+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f24d40ac880 con 0x7f24e01473f0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.732+0000 7f24dffff640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 0x7f24cc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:49.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.733+0000 7f24dffff640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 0x7f24cc06e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009a20 tx=0x7f24d0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:49.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.737+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f24d407b400 con 0x7f24e01473f0 2024-03-18T15:00:49.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.912+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f24e0160cb0 con 0x7f24e01473f0 2024-03-18T15:00:49.913 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.913+0000 7f24dcff9640 1 -- 172.21.15.152:0/3408527627 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16666 (secure 0 0 0) 0x7f24d407ad00 con 0x7f24e01473f0 2024-03-18T15:00:49.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:49.914 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":21,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:48.942062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 msgr2=0x7f24cc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 0x7f24cc06e090 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f24d0009a20 tx=0x7f24d0008040 comp rx=0 tx=0).stop 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 msgr2=0x7f24e015d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f24d4000c00 tx=0x7f24d4004730 comp rx=0 tx=0).stop 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 shutdown_connections 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f24cc06bbd0 0x7f24cc06e090 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24e0147940 0x7f24e0160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24e01473f0 0x7f24e015d5c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 --2- 172.21.15.152:0/3408527627 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24e0146c20 0x7f24e01e9150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 >> 172.21.15.152:0/3408527627 conn(0x7f24e006b5e0 msgr2=0x7f24e0141e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 shutdown_connections 2024-03-18T15:00:49.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:49.915+0000 7f24e63d4640 1 -- 172.21.15.152:0/3408527627 wait complete. 2024-03-18T15:00:49.927 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:50.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 Processor -- start 2024-03-18T15:00:50.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 -- start start 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c980b3ba0 0x7f3c9806e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c980b4f90 0x7f3c980ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c9806f1c0 con 0x7f3c9806ed40 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3c9806f4a0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.028+0000 7f3c9d081640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3c9806f780 con 0x7f3c980b4f90 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c980b3ba0 0x7f3c9806e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c8ffff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3c9806ed40 0x7f3c980ce3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39810/0 (socket says 172.21.15.152:39810) 2024-03-18T15:00:50.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c8ffff640 1 -- 172.21.15.152:0/2985992290 learned_addr learned my addr 172.21.15.152:0/2985992290 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c980b3ba0 0x7f3c9806e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51492/0 (socket says 172.21.15.152:51492) 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c9759e640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c980b4f90 0x7f3c980ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 -- 172.21.15.152:0/2985992290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c980b4f90 msgr2=0x7f3c980ceaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c980b4f90 0x7f3c980ceaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 -- 172.21.15.152:0/2985992290 >> v1:172.21.15.152:6789/0 conn(0x7f3c9806ed40 legacy=0x7f3c980ce3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.029+0000 7f3c96d9d640 1 -- 172.21.15.152:0/2985992290 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c9806fa60 con 0x7f3c980b3ba0 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c96d9d640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9806e800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ba40 tx=0x7f3c8802e080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6322e60883ce85e4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9659c640 1 -- 172.21.15.152:0/2985992290 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c8803b070 con 0x7f3c980b3ba0 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9659c640 1 -- 172.21.15.152:0/2985992290 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c8802ee30 con 0x7f3c980b3ba0 2024-03-18T15:00:50.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9659c640 1 -- 172.21.15.152:0/2985992290 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c88036640 con 0x7f3c980b3ba0 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 -- 172.21.15.152:0/2985992290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 msgr2=0x7f3c9806e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9806e800 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3c8800ba40 tx=0x7f3c8802e080 comp rx=0 tx=0).stop 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 -- 172.21.15.152:0/2985992290 shutdown_connections 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c980b4f90 0x7f3c980ceaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 --2- 172.21.15.152:0/2985992290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9806e800 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 -- 172.21.15.152:0/2985992290 >> 172.21.15.152:0/2985992290 conn(0x7f3c980d0d30 msgr2=0x7f3c980d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 -- 172.21.15.152:0/2985992290 shutdown_connections 2024-03-18T15:00:50.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.030+0000 7f3c9d081640 1 -- 172.21.15.152:0/2985992290 wait complete. 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 Processor -- start 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 -- start start 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c9806ed40 0x7f3c9813b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 0x7f3c980ce3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c98144b00 con 0x7f3c980b3ba0 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3c980b5400 con 0x7f3c980b4f90 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c9d081640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3c98144c80 con 0x7f3c9806ed40 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51502/0 (socket says 172.21.15.152:51502) 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.032+0000 7f3c8ffff640 1 -- 172.21.15.152:0/1817038427 learned_addr learned my addr 172.21.15.152:0/1817038427 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c9759e640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 0x7f3c980ce3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c96d9d640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c9806ed40 0x7f3c9813b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 -- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c9806ed40 msgr2=0x7f3c9813b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c9806ed40 0x7f3c9813b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 -- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 msgr2=0x7f3c980ce3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 0x7f3c980ce3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 -- 172.21.15.152:0/1817038427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c981e3c40 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c9759e640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 0x7f3c980ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8ffff640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c400 tx=0x7f3c8000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c80017070 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c80005ce0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c981e3f20 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c800072f0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.033+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c981e44e0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.034+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c9804f5b0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.034+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3c8001a070 con 0x7f3c980b3ba0 2024-03-18T15:00:50.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.035+0000 7f3c8f7fe640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 0x7f3c7806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.035+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7f3c80089e00 con 0x7f3c980b3ba0 2024-03-18T15:00:50.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.035+0000 7f3c96d9d640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 0x7f3c7806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.035+0000 7f3c96d9d640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 0x7f3c7806e090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c88038000 tx=0x7f3c88032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.039+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3c800588f0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.215+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c980cd4d0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.216+0000 7f3c8f7fe640 1 -- 172.21.15.152:0/1817038427 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) ==== 74+0+16666 (secure 0 0 0) 0x7f3c800581f0 con 0x7f3c980b3ba0 2024-03-18T15:00:50.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:50.217 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":21,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:48.942062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 msgr2=0x7f3c7806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 0x7f3c7806e090 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3c88038000 tx=0x7f3c88032000 comp rx=0 tx=0).stop 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 msgr2=0x7f3c9813b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3c8000c400 tx=0x7f3c8000c8c0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 shutdown_connections 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c980b4f90 0x7f3c980ce3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c980b3ba0 0x7f3c9813b7a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c7806bbd0 0x7f3c7806e090 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 --2- 172.21.15.152:0/1817038427 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c9806ed40 0x7f3c9813b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.218+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 >> 172.21.15.152:0/1817038427 conn(0x7f3c980d0d30 msgr2=0x7f3c98141db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:50.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.219+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 shutdown_connections 2024-03-18T15:00:50.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.219+0000 7f3c9d081640 1 -- 172.21.15.152:0/1817038427 wait complete. 2024-03-18T15:00:50.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T15:00:50.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.333+0000 7ff36dba9640 1 Processor -- start 2024-03-18T15:00:50.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.333+0000 7ff36dba9640 1 -- start start 2024-03-18T15:00:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff36dba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff36815b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff36dba9640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff36806d3c0 con 0x7ff3680c4a90 2024-03-18T15:00:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff36dba9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff3680c50c0 con 0x7ff36806ee70 2024-03-18T15:00:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff36dba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff368158d80 con 0x7ff3681589a0 2024-03-18T15:00:50.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff366ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff3680c4a90 0x7ff36806e760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:39816/0 (socket says 172.21.15.152:39816) 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff366ffd640 1 -- 172.21.15.152:0/50705903 learned_addr learned my addr 172.21.15.152:0/50705903 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3677fe640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff36815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1125127988 0 0) 0x7ff36806d3c0 con 0x7ff3680c4a90 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff350003520 con 0x7ff3680c4a90 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1633297398 0 0) 0x7ff3680c50c0 con 0x7ff36806ee70 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff36806d3c0 con 0x7ff36806ee70 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3157231793 0 0) 0x7ff350003520 con 0x7ff3680c4a90 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 msgr2=0x7ff36815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff36815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 >> v1:172.21.15.186:6789/0 conn(0x7ff36806ee70 legacy=0x7ff3680cb180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3680c53a0 con 0x7ff3680c4a90 2024-03-18T15:00:50.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7ff35c001670 con 0x7ff3680c4a90 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 >> v1:172.21.15.152:6789/0 conn(0x7ff3680c4a90 legacy=0x7ff36806e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff350003b70 0x7ff350003f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff350004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.334+0000 7ff3667fc640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350004d40 0x7ff3500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff368158d80 con 0x7ff350003b70 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff35000ba70 con 0x7ff350004d40 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff35000bc20 con 0x7ff3681589a0 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff350003b70 0x7ff350003f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff366ffd640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff350004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff367fff640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350004d40 0x7ff3500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 -- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 msgr2=0x7ff350004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:50.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff350004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 -- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350004d40 msgr2=0x7ff3500051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350004d40 0x7ff3500051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 -- 172.21.15.152:0/50705903 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff350003520 con 0x7ff350003b70 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff366ffd640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3681589a0 0x7ff350004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.335+0000 7ff3677fe640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff350003b70 0x7ff350003f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff358009ac0 tx=0x7ff350005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b220b8c2bc03f546 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358039070 con 0x7ff350003b70 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35802c6b0 con 0x7ff350003b70 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff3667fc640 1 -- 172.21.15.152:0/50705903 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff358009690 con 0x7ff350003b70 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 -- 172.21.15.152:0/50705903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff350003b70 msgr2=0x7ff350003f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 --2- 172.21.15.152:0/50705903 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff350003b70 0x7ff350003f70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff358009ac0 tx=0x7ff350005830 comp rx=0 tx=0).stop 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff367fff640 1 -- 172.21.15.152:0/50705903 reap_dead start 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 -- 172.21.15.152:0/50705903 shutdown_connections 2024-03-18T15:00:50.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 -- 172.21.15.152:0/50705903 >> 172.21.15.152:0/50705903 conn(0x7ff3680cfbf0 msgr2=0x7ff3680cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:50.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 -- 172.21.15.152:0/50705903 shutdown_connections 2024-03-18T15:00:50.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.336+0000 7ff36dba9640 1 -- 172.21.15.152:0/50705903 wait complete. 2024-03-18T15:00:50.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.337+0000 7ff36dba9640 1 Processor -- start 2024-03-18T15:00:50.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 -- start start 2024-03-18T15:00:50.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 0x7ff36814f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3680c6cc0 0x7ff36815b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680c5960 con 0x7ff3681545b0 2024-03-18T15:00:50.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff3680c4e70 con 0x7ff350003b70 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff36dba9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff3680c5c40 con 0x7ff3680c6cc0 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff366ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff366ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:51522/0 (socket says 172.21.15.152:51522) 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.338+0000 7ff366ffd640 1 -- 172.21.15.152:0/849283595 learned_addr learned my addr 172.21.15.152:0/849283595 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff3677fe640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 0x7ff36814f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 -- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3680c6cc0 msgr2=0x7ff36815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3680c6cc0 0x7ff36815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 -- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 msgr2=0x7ff36814f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 0x7ff36814f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 -- 172.21.15.152:0/849283595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3681553c0 con 0x7ff3681545b0 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff3677fe640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 0x7ff36814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff366ffd640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00e8d0 tx=0x7ff35c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00c850 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff35c018070 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff368154b20 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00cc10 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.339+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3681550e0 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.340+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff36804f540 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.340+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff35c01d460 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.341+0000 7ff34ffff640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 0x7ff35406e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.341+0000 7ff3677fe640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 0x7ff35406e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.341+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5709+0+0 (secure 0 0 0) 0x7ff35c08aa20 con 0x7ff3681545b0 2024-03-18T15:00:50.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.341+0000 7ff3677fe640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 0x7ff35406e030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff358036000 tx=0x7ff358030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.345+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff35c059490 con 0x7ff3681545b0 2024-03-18T15:00:50.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.555+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ff36806cf00 con 0x7ff3681545b0 2024-03-18T15:00:50.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.598+0000 7ff34ffff640 1 -- 172.21.15.152:0/849283595 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) ==== 118+0+0 (secure 0 0 0) 0x7ff35c058d90 con 0x7ff3681545b0 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 msgr2=0x7ff35406e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 0x7ff35406e030 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff358036000 tx=0x7ff358030000 comp rx=0 tx=0).stop 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 msgr2=0x7ff3680ae5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00e8d0 tx=0x7ff35c00ed90 comp rx=0 tx=0).stop 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 shutdown_connections 2024-03-18T15:00:50.602 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff35406bb70 0x7ff35406e030 secure :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7ff358036000 tx=0x7ff358030000 comp rx=0 tx=0).stop 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff3680c6cc0 0x7ff36815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff3681545b0 0x7ff3680ae5e0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 --2- 172.21.15.152:0/849283595 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff350003b70 0x7ff36814f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.601+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 >> 172.21.15.152:0/849283595 conn(0x7ff3680cfbf0 msgr2=0x7ff3680b0140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.602+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 shutdown_connections 2024-03-18T15:00:50.603 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.602+0000 7ff36dba9640 1 -- 172.21.15.152:0/849283595 wait complete. 2024-03-18T15:00:50.613 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-18T15:00:50.613 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T15:00:50.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.719+0000 7f5b6587e640 1 Processor -- start 2024-03-18T15:00:50.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.719+0000 7f5b6587e640 1 -- start start 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b6587e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b6015e3b0 0x7f5b600d1210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b6587e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5b600d1e80 0x7f5b600b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b6587e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5b600b33b0 con 0x7f5b600b11a0 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b6587e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5b600d22e0 con 0x7f5b6015e3b0 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b6587e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5b600d17f0 con 0x7f5b600d1e80 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b6015e3b0 0x7f5b600d1210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5b6015e3b0 0x7f5b600d1210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34054/0 (socket says 172.21.15.152:34054) 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 -- 172.21.15.152:0/1572221126 learned_addr learned my addr 172.21.15.152:0/1572221126 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5f7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5b600b11a0 0x7f5b600cf9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53096/0 (socket says 172.21.15.152:53096) 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 -- 172.21.15.152:0/1572221126 >> v2:172.21.15.186:3300/0 conn(0x7f5b600d1e80 msgr2=0x7f5b600b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:50.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5e7fc640 1 --2- 172.21.15.152:0/1572221126 >> v2:172.21.15.186:3300/0 conn(0x7f5b600d1e80 0x7f5b600b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 --2- 172.21.15.152:0/1572221126 >> v2:172.21.15.186:3300/0 conn(0x7f5b600d1e80 0x7f5b600b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 -- 172.21.15.152:0/1572221126 >> v1:172.21.15.152:6789/0 conn(0x7f5b600b11a0 legacy=0x7f5b600cf9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5dffb640 1 -- 172.21.15.152:0/1572221126 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1349900508 0 0) 0x7f5b58001490 con 0x7f5b600b11a0 2024-03-18T15:00:50.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.720+0000 7f5b5effd640 1 -- 172.21.15.152:0/1572221126 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b600cef00 con 0x7f5b6015e3b0 2024-03-18T15:00:50.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.721+0000 7f5b5effd640 1 --2- 172.21.15.152:0/1572221126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6015e3b0 0x7f5b600d1210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b600a1fb0 tx=0x7f5b5002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66801f97b13559ad server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.721+0000 7f5b5dffb640 1 -- 172.21.15.152:0/1572221126 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50035020 con 0x7f5b6015e3b0 2024-03-18T15:00:50.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.721+0000 7f5b5dffb640 1 -- 172.21.15.152:0/1572221126 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b50031870 con 0x7f5b6015e3b0 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.721+0000 7f5b5dffb640 1 -- 172.21.15.152:0/1572221126 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b50031c40 con 0x7f5b6015e3b0 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 -- 172.21.15.152:0/1572221126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6015e3b0 msgr2=0x7f5b600d1210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 --2- 172.21.15.152:0/1572221126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6015e3b0 0x7f5b600d1210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5b600a1fb0 tx=0x7f5b5002b910 comp rx=0 tx=0).stop 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 -- 172.21.15.152:0/1572221126 shutdown_connections 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 --2- 172.21.15.152:0/1572221126 >> v2:172.21.15.186:3300/0 conn(0x7f5b600d1e80 0x7f5b600b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 --2- 172.21.15.152:0/1572221126 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b6015e3b0 0x7f5b600d1210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 -- 172.21.15.152:0/1572221126 >> 172.21.15.152:0/1572221126 conn(0x7f5b600d40a0 msgr2=0x7f5b600d44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 -- 172.21.15.152:0/1572221126 shutdown_connections 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.722+0000 7f5b6587e640 1 -- 172.21.15.152:0/1572221126 wait complete. 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.723+0000 7f5b6587e640 1 Processor -- start 2024-03-18T15:00:50.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.723+0000 7f5b6587e640 1 -- start start 2024-03-18T15:00:50.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b600b11a0 0x7f5b600b5460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 0x7f5b600b3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5b6015e790 con 0x7f5b600d1e80 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5b600cebb0 con 0x7f5b6015e3b0 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b6587e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5b6015e910 con 0x7f5b600b11a0 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34064/0 (socket says 172.21.15.152:34064) 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 -- 172.21.15.152:0/317108008 learned_addr learned my addr 172.21.15.152:0/317108008 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5f7fe640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 0x7f5b600b3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5effd640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b600b11a0 0x7f5b600b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 -- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b600b11a0 msgr2=0x7f5b600b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b600b11a0 0x7f5b600b5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 -- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 msgr2=0x7f5b600b3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 0x7f5b600b3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5e7fc640 1 -- 172.21.15.152:0/317108008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b600b5d00 con 0x7f5b600d1e80 2024-03-18T15:00:50.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.724+0000 7f5b5f7fe640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 0x7f5b600b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b5e7fc640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400c7f0 tx=0x7f5b5400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54015070 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b54004220 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b600b5fe0 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b54007620 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.725+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b600b65a0 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.726+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b6004f540 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.726+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5b540079d0 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.727+0000 7f5b47fff640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 0x7f5b4c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.727+0000 7f5b5effd640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 0x7f5b4c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.727+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5b5408adc0 con 0x7f5b600d1e80 2024-03-18T15:00:50.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.727+0000 7f5b5effd640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 0x7f5b4c06e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b50036000 tx=0x7f5b50008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:50.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.731+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5b54059940 con 0x7f5b600d1e80 2024-03-18T15:00:50.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:50.947+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5b600b7d00 con 0x7f5b600d1e80 2024-03-18T15:00:51.604 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.604+0000 7f5b47fff640 1 -- 172.21.15.152:0/317108008 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) ==== 122+0+0 (secure 0 0 0) 0x7f5b54059240 con 0x7f5b600d1e80 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 msgr2=0x7f5b4c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 0x7f5b4c06e090 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5b50036000 tx=0x7f5b50008030 comp rx=0 tx=0).stop 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 msgr2=0x7f5b600b3590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5b5400c7f0 tx=0x7f5b5400ccb0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 shutdown_connections 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5b6015e3b0 0x7f5b600b3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.607 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5b600d1e80 0x7f5b600b3590 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b4c06bbd0 0x7f5b4c06e090 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 --2- 172.21.15.152:0/317108008 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5b600b11a0 0x7f5b600b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.606+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 >> 172.21.15.152:0/317108008 conn(0x7f5b600d40a0 msgr2=0x7f5b6015eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:51.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.607+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 shutdown_connections 2024-03-18T15:00:51.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.607+0000 7f5b6587e640 1 -- 172.21.15.152:0/317108008 wait complete. 2024-03-18T15:00:51.617 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T15:00:51.618 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:00:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.722+0000 7f628ac7e640 1 Processor -- start 2024-03-18T15:00:51.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 -- start start 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f62840d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f62840cef80 0x7f62840af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62840cd510 con 0x7f628415c780 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f62840cd7f0 con 0x7f62840cef80 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f628ac7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f62840cdad0 con 0x7f628415c3a0 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f6283fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f628415c780 0x7f62840ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53104/0 (socket says 172.21.15.152:53104) 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.723+0000 7f6283fff640 1 -- 172.21.15.152:0/1757217418 learned_addr learned my addr 172.21.15.152:0/1757217418 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f628921b640 1 --2- 172.21.15.152:0/1757217418 >> v2:172.21.15.186:3300/0 conn(0x7f62840cef80 0x7f62840af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6288a1a640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f62840d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 88422295 0 0) 0x7f62840cd510 con 0x7f628415c780 2024-03-18T15:00:51.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f626c003520 con 0x7f628415c780 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3401260673 0 0) 0x7f626c003520 con 0x7f628415c780 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 msgr2=0x7f62840d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f62840d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 >> v2:172.21.15.186:3300/0 conn(0x7f62840cef80 msgr2=0x7f62840af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 --2- 172.21.15.152:0/1757217418 >> v2:172.21.15.186:3300/0 conn(0x7f62840cef80 0x7f62840af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840cddb0 con 0x7f628415c780 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f6278001670 con 0x7f628415c780 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 >> v1:172.21.15.152:6789/0 conn(0x7f628415c780 legacy=0x7f62840ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f626c003a20 0x7f626c003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f626c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f626c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f62840cd7f0 con 0x7f626c004800 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f62840cdad0 con 0x7f626c003a20 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f626c00b9c0 con 0x7f628415c3a0 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f626c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6288a1a640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f626c003a20 0x7f626c003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f628921b640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f626c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 -- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 msgr2=0x7f626c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f628415c3a0 0x7f626c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 -- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f626c003a20 msgr2=0x7f626c003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f626c003a20 0x7f626c003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.724+0000 7f6283fff640 1 -- 172.21.15.152:0/1757217418 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f626c003520 con 0x7f626c004800 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f6283fff640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f626c004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f627800c240 tx=0x7f626c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bee80b566ce35b84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6278007d50 con 0x7f626c004800 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6278030070 con 0x7f626c004800 2024-03-18T15:00:51.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f62837fe640 1 -- 172.21.15.152:0/1757217418 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627802cd80 con 0x7f626c004800 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 -- 172.21.15.152:0/1757217418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 msgr2=0x7f626c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1757217418 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f626c004c80 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f627800c240 tx=0x7f626c005830 comp rx=0 tx=0).stop 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628921b640 1 -- 172.21.15.152:0/1757217418 reap_dead start 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 -- 172.21.15.152:0/1757217418 shutdown_connections 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 -- 172.21.15.152:0/1757217418 >> 172.21.15.152:0/1757217418 conn(0x7f62840d1e60 msgr2=0x7f62840d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 -- 172.21.15.152:0/1757217418 shutdown_connections 2024-03-18T15:00:51.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.726+0000 7f628ac7e640 1 -- 172.21.15.152:0/1757217418 wait complete. 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.728+0000 7f628ac7e640 1 Processor -- start 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.728+0000 7f628ac7e640 1 -- start start 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62840b2760 0x7f628415dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f628415e0f0 0x7f628415e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f62840cf590 con 0x7f626c004800 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f62840cf410 con 0x7f628415e0f0 2024-03-18T15:00:51.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628ac7e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f62840d2980 con 0x7f62840b2760 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34082/0 (socket says 172.21.15.152:34082) 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 -- 172.21.15.152:0/1550705011 learned_addr learned my addr 172.21.15.152:0/1550705011 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6283fff640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62840b2760 0x7f628415dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f628921b640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f628415e0f0 0x7f628415e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 -- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62840b2760 msgr2=0x7f628415dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62840b2760 0x7f628415dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 -- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f628415e0f0 msgr2=0x7f628415e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f628415e0f0 0x7f628415e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 -- 172.21.15.152:0/1550705011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62840b2c20 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f6288a1a640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f627c011e30 tx=0x7f627c00f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.729+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c00fea0 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.730+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627c015630 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.730+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627c015a20 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.730+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62840affd0 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.730+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628415a990 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.731+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f628404f5b0 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.731+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f627c015bc0 con 0x7f626c004800 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.732+0000 7f62817fa640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 0x7f627006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.732+0000 7f6283fff640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 0x7f627006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:51.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.732+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f627c08b970 con 0x7f626c004800 2024-03-18T15:00:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.732+0000 7f6283fff640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 0x7f627006e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6278034000 tx=0x7f6278007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:51.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.736+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f627c019030 con 0x7f626c004800 2024-03-18T15:00:51.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.952+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f628409fc90 con 0x7f626c004800 2024-03-18T15:00:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.953+0000 7f62817fa640 1 -- 172.21.15.152:0/1550705011 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f627c010040 con 0x7f626c004800 2024-03-18T15:00:51.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:51.953 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:00:51.953 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:00:51.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 msgr2=0x7f627006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 0x7f627006e090 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f6278034000 tx=0x7f6278007000 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 msgr2=0x7f628414b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f627c011e30 tx=0x7f627c00f580 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 shutdown_connections 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f628415e0f0 0x7f628415e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f627006bbd0 0x7f627006e090 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f62840b2760 0x7f628415dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 --2- 172.21.15.152:0/1550705011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f626c004800 0x7f628414b3b0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 >> 172.21.15.152:0/1550705011 conn(0x7f62840d1e60 msgr2=0x7f62840caf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:51.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 shutdown_connections 2024-03-18T15:00:51.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:51.955+0000 7f628ac7e640 1 -- 172.21.15.152:0/1550705011 wait complete. 2024-03-18T15:00:51.966 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:52.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.067+0000 7f38ea5b2640 1 Processor -- start 2024-03-18T15:00:52.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.067+0000 7f38ea5b2640 1 -- start start 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38ea5b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 0x7f38e40d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38ea5b2640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38e415c780 0x7f38e40ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38ea5b2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38e40cd510 con 0x7f38e40cedb0 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38ea5b2640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f38e40cd7f0 con 0x7f38e415c780 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38ea5b2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f38e40cdad0 con 0x7f38e415c3a0 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38e37fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38e415c780 0x7f38e40ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38e8b4f640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f38e40cedb0 0x7f38e40cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53118/0 (socket says 172.21.15.152:53118) 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.068+0000 7f38e8b4f640 1 -- 172.21.15.152:0/2678231004 learned_addr learned my addr 172.21.15.152:0/2678231004 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e3fff640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 0x7f38e40d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e37fe640 1 -- 172.21.15.152:0/2678231004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 msgr2=0x7f38e40d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e37fe640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 0x7f38e40d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e37fe640 1 -- 172.21.15.152:0/2678231004 >> v1:172.21.15.152:6789/0 conn(0x7f38e40cedb0 legacy=0x7f38e40cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e37fe640 1 -- 172.21.15.152:0/2678231004 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e40cddb0 con 0x7f38e415c780 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e2ffd640 1 -- 172.21.15.152:0/2678231004 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4245686659 0 0) 0x7f38e40cd510 con 0x7f38e40cedb0 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e3fff640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 0x7f38e40d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e37fe640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e40ce870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=faa18e9f9eb2ed79 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.069+0000 7f38e2ffd640 1 -- 172.21.15.152:0/2678231004 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc035020 con 0x7f38e415c780 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38e2ffd640 1 -- 172.21.15.152:0/2678231004 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38cc031830 con 0x7f38e415c780 2024-03-18T15:00:52.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38e2ffd640 1 -- 172.21.15.152:0/2678231004 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc031c00 con 0x7f38e415c780 2024-03-18T15:00:52.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 -- 172.21.15.152:0/2678231004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 msgr2=0x7f38e40ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e40ce870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0097a0 tx=0x7f38cc02b8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 -- 172.21.15.152:0/2678231004 shutdown_connections 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e40ce870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/2678231004 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e415c3a0 0x7f38e40d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 -- 172.21.15.152:0/2678231004 >> 172.21.15.152:0/2678231004 conn(0x7f38e40d1e60 msgr2=0x7f38e40d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 -- 172.21.15.152:0/2678231004 shutdown_connections 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.070+0000 7f38ea5b2640 1 -- 172.21.15.152:0/2678231004 wait complete. 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.071+0000 7f38ea5b2640 1 Processor -- start 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.071+0000 7f38ea5b2640 1 -- start start 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e40cedb0 0x7f38e415db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e415c3a0 0x7f38e415e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40b0190 con 0x7f38e415c780 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f38e40b0010 con 0x7f38e415c3a0 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38ea5b2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f38e40b0310 con 0x7f38e40cedb0 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38e8b4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38e8b4f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34110/0 (socket says 172.21.15.152:34110) 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38e8b4f640 1 -- 172.21.15.152:0/812798474 learned_addr learned my addr 172.21.15.152:0/812798474 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38e37fe640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e415c3a0 0x7f38e415e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.072+0000 7f38e3fff640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e40cedb0 0x7f38e415db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 -- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e40cedb0 msgr2=0x7f38e415db00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e40cedb0 0x7f38e415db00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 -- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e415c3a0 msgr2=0x7f38e415e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e415c3a0 0x7f38e415e1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 -- 172.21.15.152:0/812798474 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38e415e720 con 0x7f38e415c780 2024-03-18T15:00:52.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e8b4f640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c730 tx=0x7f38dc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc018070 con 0x7f38e415c780 2024-03-18T15:00:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38dc00ce40 con 0x7f38e415c780 2024-03-18T15:00:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38e415e9a0 con 0x7f38e415c780 2024-03-18T15:00:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38dc00a860 con 0x7f38e415c780 2024-03-18T15:00:52.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.073+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38e415ef60 con 0x7f38e415c780 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.074+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38e40d1670 con 0x7f38e415c780 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.074+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f38dc01b070 con 0x7f38e415c780 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.075+0000 7f38e0ff9640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 0x7f38c406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.075+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f38dc089f30 con 0x7f38e415c780 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.075+0000 7f38e3fff640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 0x7f38c406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.075+0000 7f38e3fff640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 0x7f38c406e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38e40b3690 tx=0x7f38d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.083+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f38e40d1670 con 0x7f38e415c780 2024-03-18T15:00:52.183 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:00:52.183+0000 7fd9211cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T15:00:52.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.302+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f38e40d2ce0 con 0x7f38e415c780 2024-03-18T15:00:52.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.304+0000 7f38e0ff9640 1 -- 172.21.15.152:0/812798474 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f38e40d2ce0 con 0x7f38e415c780 2024-03-18T15:00:52.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:52.304 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 msgr2=0x7f38c406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 0x7f38c406e090 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f38e40b3690 tx=0x7f38d4008040 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 msgr2=0x7f38e41545d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f38dc00c730 tx=0x7f38dc00cbf0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 shutdown_connections 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38e415c780 0x7f38e41545d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38e415c3a0 0x7f38e415e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f38c406bbd0 0x7f38c406e090 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 --2- 172.21.15.152:0/812798474 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38e40cedb0 0x7f38e415db00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 >> 172.21.15.152:0/812798474 conn(0x7f38e40d1e60 msgr2=0x7f38e40cc9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:52.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 shutdown_connections 2024-03-18T15:00:52.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.306+0000 7f38ea5b2640 1 -- 172.21.15.152:0/812798474 wait complete. 2024-03-18T15:00:52.318 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T15:00:52.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:00:52.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.422+0000 7fb7d808c640 1 Processor -- start 2024-03-18T15:00:52.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.422+0000 7fb7d808c640 1 -- start start 2024-03-18T15:00:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.423+0000 7fb7d808c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d015c3a0 0x7fb7d00d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d808c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00cd510 con 0x7fb7d00cef80 2024-03-18T15:00:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d808c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb7d00cd7f0 con 0x7fb7d015c780 2024-03-18T15:00:52.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d808c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb7d00cdad0 con 0x7fb7d015c3a0 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d5e28640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d015c3a0 0x7fb7d00d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d6629640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb7d00cef80 0x7fb7d00af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53132/0 (socket says 172.21.15.152:53132) 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d5e28640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb7d015c3a0 0x7fb7d00d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34118/0 (socket says 172.21.15.152:34118) 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d6629640 1 -- 172.21.15.152:0/1804721387 learned_addr learned my addr 172.21.15.152:0/1804721387 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d5e28640 1 -- 172.21.15.152:0/1804721387 >> v1:172.21.15.186:6789/0 conn(0x7fb7d015c780 legacy=0x7fb7d00ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d5e28640 1 -- 172.21.15.152:0/1804721387 >> v1:172.21.15.152:6789/0 conn(0x7fb7d00cef80 legacy=0x7fb7d00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d5e28640 1 -- 172.21.15.152:0/1804721387 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d00cddb0 con 0x7fb7d015c3a0 2024-03-18T15:00:52.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.424+0000 7fb7d4e26640 1 -- 172.21.15.152:0/1804721387 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1374828321 0 0) 0x7fb7d00cd510 con 0x7fb7d00cef80 2024-03-18T15:00:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.425+0000 7fb7d5e28640 1 --2- 172.21.15.152:0/1804721387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00d2980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00097a0 tx=0x7fb7c002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=698d669c5e637341 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.425+0000 7fb7d4e26640 1 -- 172.21.15.152:0/1804721387 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0034070 con 0x7fb7d015c3a0 2024-03-18T15:00:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.425+0000 7fb7d4e26640 1 -- 172.21.15.152:0/1804721387 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0030610 con 0x7fb7d015c3a0 2024-03-18T15:00:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.425+0000 7fb7d4e26640 1 -- 172.21.15.152:0/1804721387 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c00309e0 con 0x7fb7d015c3a0 2024-03-18T15:00:52.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 -- 172.21.15.152:0/1804721387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d015c3a0 msgr2=0x7fb7d00d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 --2- 172.21.15.152:0/1804721387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00d2980 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb7c00097a0 tx=0x7fb7c002b960 comp rx=0 tx=0).stop 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 -- 172.21.15.152:0/1804721387 shutdown_connections 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 --2- 172.21.15.152:0/1804721387 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00d2980 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 -- 172.21.15.152:0/1804721387 >> 172.21.15.152:0/1804721387 conn(0x7fb7d00d1e60 msgr2=0x7fb7d00d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 -- 172.21.15.152:0/1804721387 shutdown_connections 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.426+0000 7fb7d808c640 1 -- 172.21.15.152:0/1804721387 wait complete. 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.427+0000 7fb7d808c640 1 Processor -- start 2024-03-18T15:00:52.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.427+0000 7fb7d808c640 1 -- start start 2024-03-18T15:00:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 0x7fb7d00af440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d00cf570 con 0x7fb7d00cef80 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb7d00cf3f0 con 0x7fb7d015c3a0 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb7d0157ab0 con 0x7fb7d015c780 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34130/0 (socket says 172.21.15.152:34130) 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 -- 172.21.15.152:0/3832707931 learned_addr learned my addr 172.21.15.152:0/3832707931 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5627640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d6629640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 0x7fb7d00af440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 -- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 msgr2=0x7fb7d00af440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 0x7fb7d00af440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 -- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 msgr2=0x7fb7d00aef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00aef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 -- 172.21.15.152:0/3832707931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7d014dd20 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5627640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d6629640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 0x7fb7d00af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d5e28640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7c002bf70 tx=0x7fb7c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0034040 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7c0039a10 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7c0039de0 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.428+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7d00cb550 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.429+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7d00b1140 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.429+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7d00c8800 con 0x7fb7d00cef80 2024-03-18T15:00:52.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.430+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb7c0037070 con 0x7fb7d00cef80 2024-03-18T15:00:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.430+0000 7fb7c67fc640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 0x7fb7b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.431+0000 7fb7d5627640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 0x7fb7b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.431+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb7c00acc10 con 0x7fb7d00cef80 2024-03-18T15:00:52.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.431+0000 7fb7d5627640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 0x7fb7b406e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7d01569e0 tx=0x7fb7cc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.435+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb7d00c8800 con 0x7fb7d00cef80 2024-03-18T15:00:52.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.724+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb7d004f5b0 con 0x7fb7b406bbd0 2024-03-18T15:00:52.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.730+0000 7fb7c67fc640 1 -- 172.21.15.152:0/3832707931 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251081 (secure 0 0 0) 0x7fb7d004f5b0 con 0x7fb7b406bbd0 2024-03-18T15:00:52.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:52.738 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 msgr2=0x7fb7b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 0x7fb7b406e090 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb7d01569e0 tx=0x7fb7cc009040 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 msgr2=0x7fb7d014d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7c002bf70 tx=0x7fb7c00046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 shutdown_connections 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb7b406bbd0 0x7fb7b406e090 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb7d015c780 0x7fb7d00af440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb7d015c3a0 0x7fb7d00aef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 --2- 172.21.15.152:0/3832707931 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb7d00cef80 0x7fb7d014d320 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.733+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 >> 172.21.15.152:0/3832707931 conn(0x7fb7d00d1e60 msgr2=0x7fb7d00ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.734+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 shutdown_connections 2024-03-18T15:00:52.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.734+0000 7fb7d808c640 1 -- 172.21.15.152:0/3832707931 wait complete. 2024-03-18T15:00:52.744 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-18T15:00:51.804899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223136,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751584,"statfs":{"total":773094113280,"available":772865622016,"internally_reserved":0,"allocated":2875392,"data_stored":1743797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608555+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:49.608555+0000","last_peered":"2024-03-18T15:00:49.608555+0000","last_clean":"2024-03-18T15:00:49.608555+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:49.608555+0000","last_undegraded":"2024-03-18T15:00:49.608555+0000","last_fullsized":"2024-03-18T15:00:49.608555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593631+0000","last_change":"2024-03-18T15:00:48.593631+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593631+0000","last_undegraded":"2024-03-18T15:00:48.593631+0000","last_fullsized":"2024-03-18T15:00:48.593631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613546+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:49.613546+0000","last_peered":"2024-03-18T15:00:49.613546+0000","last_clean":"2024-03-18T15:00:49.613546+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.613546+0000","last_undegraded":"2024-03-18T15:00:49.613546+0000","last_fullsized":"2024-03-18T15:00:49.613546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616312+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:49.616312+0000","last_peered":"2024-03-18T15:00:49.616312+0000","last_clean":"2024-03-18T15:00:49.616312+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:49.616312+0000","last_undegraded":"2024-03-18T15:00:49.616312+0000","last_fullsized":"2024-03-18T15:00:49.616312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615774+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:49.615774+0000","last_peered":"2024-03-18T15:00:49.615774+0000","last_clean":"2024-03-18T15:00:49.615774+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:49.615774+0000","last_undegraded":"2024-03-18T15:00:49.615774+0000","last_fullsized":"2024-03-18T15:00:49.615774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613637+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:49.613637+0000","last_peered":"2024-03-18T15:00:49.613637+0000","last_clean":"2024-03-18T15:00:49.613637+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:49.613637+0000","last_undegraded":"2024-03-18T15:00:49.613637+0000","last_fullsized":"2024-03-18T15:00:49.613637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618050+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:49.618050+0000","last_peered":"2024-03-18T15:00:49.618050+0000","last_clean":"2024-03-18T15:00:49.618050+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:49.618050+0000","last_undegraded":"2024-03-18T15:00:49.618050+0000","last_fullsized":"2024-03-18T15:00:49.618050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618150+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:49.618150+0000","last_peered":"2024-03-18T15:00:49.618150+0000","last_clean":"2024-03-18T15:00:49.618150+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:49.618150+0000","last_undegraded":"2024-03-18T15:00:49.618150+0000","last_fullsized":"2024-03-18T15:00:49.618150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616062+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:49.616062+0000","last_peered":"2024-03-18T15:00:49.616062+0000","last_clean":"2024-03-18T15:00:49.616062+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:49.616062+0000","last_undegraded":"2024-03-18T15:00:49.616062+0000","last_fullsized":"2024-03-18T15:00:49.616062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611650+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:49.611650+0000","last_peered":"2024-03-18T15:00:49.611650+0000","last_clean":"2024-03-18T15:00:49.611650+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:49.611650+0000","last_undegraded":"2024-03-18T15:00:49.611650+0000","last_fullsized":"2024-03-18T15:00:49.611650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:30.729724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594920+0000","last_change":"2024-03-18T15:00:48.594920+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594920+0000","last_undegraded":"2024-03-18T15:00:48.594920+0000","last_fullsized":"2024-03-18T15:00:48.594920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612404+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:49.612404+0000","last_peered":"2024-03-18T15:00:49.612404+0000","last_clean":"2024-03-18T15:00:49.612404+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:49.612404+0000","last_undegraded":"2024-03-18T15:00:49.612404+0000","last_fullsized":"2024-03-18T15:00:49.612404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:55.684856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613062+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:49.613062+0000","last_peered":"2024-03-18T15:00:49.613062+0000","last_clean":"2024-03-18T15:00:49.613062+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:49.613062+0000","last_undegraded":"2024-03-18T15:00:49.613062+0000","last_fullsized":"2024-03-18T15:00:49.613062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.605350+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:49.605350+0000","last_peered":"2024-03-18T15:00:49.605350+0000","last_clean":"2024-03-18T15:00:49.605350+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:49.605350+0000","last_undegraded":"2024-03-18T15:00:49.605350+0000","last_fullsized":"2024-03-18T15:00:49.605350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616025+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:49.616025+0000","last_peered":"2024-03-18T15:00:49.616025+0000","last_clean":"2024-03-18T15:00:49.616025+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:49.616025+0000","last_undegraded":"2024-03-18T15:00:49.616025+0000","last_fullsized":"2024-03-18T15:00:49.616025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.596213+0000","last_change":"2024-03-18T15:00:48.596213+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.596213+0000","last_undegraded":"2024-03-18T15:00:48.596213+0000","last_fullsized":"2024-03-18T15:00:48.596213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614923+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:49.614923+0000","last_peered":"2024-03-18T15:00:49.614923+0000","last_clean":"2024-03-18T15:00:49.614923+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:49.614923+0000","last_undegraded":"2024-03-18T15:00:49.614923+0000","last_fullsized":"2024-03-18T15:00:49.614923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:54.207821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612383+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:49.612383+0000","last_peered":"2024-03-18T15:00:49.612383+0000","last_clean":"2024-03-18T15:00:49.612383+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:49.612383+0000","last_undegraded":"2024-03-18T15:00:49.612383+0000","last_fullsized":"2024-03-18T15:00:49.612383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:08.211280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611386+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:49.611386+0000","last_peered":"2024-03-18T15:00:49.611386+0000","last_clean":"2024-03-18T15:00:49.611386+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:49.611386+0000","last_undegraded":"2024-03-18T15:00:49.611386+0000","last_fullsized":"2024-03-18T15:00:49.611386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:42.048658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.595450+0000","last_change":"2024-03-18T15:00:48.595450+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.595450+0000","last_undegraded":"2024-03-18T15:00:48.595450+0000","last_fullsized":"2024-03-18T15:00:48.595450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616540+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:49.616540+0000","last_peered":"2024-03-18T15:00:49.616540+0000","last_clean":"2024-03-18T15:00:49.616540+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:49.616540+0000","last_undegraded":"2024-03-18T15:00:49.616540+0000","last_fullsized":"2024-03-18T15:00:49.616540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612427+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:49.612427+0000","last_peered":"2024-03-18T15:00:49.612427+0000","last_clean":"2024-03-18T15:00:49.612427+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:49.612427+0000","last_undegraded":"2024-03-18T15:00:49.612427+0000","last_fullsized":"2024-03-18T15:00:49.612427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608537+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:49.608537+0000","last_peered":"2024-03-18T15:00:49.608537+0000","last_clean":"2024-03-18T15:00:49.608537+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:49.608537+0000","last_undegraded":"2024-03-18T15:00:49.608537+0000","last_fullsized":"2024-03-18T15:00:49.608537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:16.293687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594247+0000","last_change":"2024-03-18T15:00:48.594247+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594247+0000","last_undegraded":"2024-03-18T15:00:48.594247+0000","last_fullsized":"2024-03-18T15:00:48.594247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609183+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:49.609183+0000","last_peered":"2024-03-18T15:00:49.609183+0000","last_clean":"2024-03-18T15:00:49.609183+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:49.609183+0000","last_undegraded":"2024-03-18T15:00:49.609183+0000","last_fullsized":"2024-03-18T15:00:49.609183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592533+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:49.592533+0000","last_peered":"2024-03-18T15:00:49.592533+0000","last_clean":"2024-03-18T15:00:49.592533+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:49.592533+0000","last_undegraded":"2024-03-18T15:00:49.592533+0000","last_fullsized":"2024-03-18T15:00:49.592533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.597147+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:49.597147+0000","last_peered":"2024-03-18T15:00:49.597147+0000","last_clean":"2024-03-18T15:00:49.597147+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:49.597147+0000","last_undegraded":"2024-03-18T15:00:49.597147+0000","last_fullsized":"2024-03-18T15:00:49.597147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612337+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:49.612337+0000","last_peered":"2024-03-18T15:00:49.612337+0000","last_clean":"2024-03-18T15:00:49.612337+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:49.612337+0000","last_undegraded":"2024-03-18T15:00:49.612337+0000","last_fullsized":"2024-03-18T15:00:49.612337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:02.312876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592512+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:49.592512+0000","last_peered":"2024-03-18T15:00:49.592512+0000","last_clean":"2024-03-18T15:00:49.592512+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:49.592512+0000","last_undegraded":"2024-03-18T15:00:49.592512+0000","last_fullsized":"2024-03-18T15:00:49.592512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593780+0000","last_change":"2024-03-18T15:00:48.593780+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593780+0000","last_undegraded":"2024-03-18T15:00:48.593780+0000","last_fullsized":"2024-03-18T15:00:48.593780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609061+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:49.609061+0000","last_peered":"2024-03-18T15:00:49.609061+0000","last_clean":"2024-03-18T15:00:49.609061+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:49.609061+0000","last_undegraded":"2024-03-18T15:00:49.609061+0000","last_fullsized":"2024-03-18T15:00:49.609061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:23.516467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.620698+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:49.620698+0000","last_peered":"2024-03-18T15:00:49.620698+0000","last_clean":"2024-03-18T15:00:49.620698+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:49.620698+0000","last_undegraded":"2024-03-18T15:00:49.620698+0000","last_fullsized":"2024-03-18T15:00:49.620698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616634+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:49.616634+0000","last_peered":"2024-03-18T15:00:49.616634+0000","last_clean":"2024-03-18T15:00:49.616634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.616634+0000","last_undegraded":"2024-03-18T15:00:49.616634+0000","last_fullsized":"2024-03-18T15:00:49.616634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.608884+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:48.608884+0000","last_peered":"2024-03-18T15:00:48.608884+0000","last_clean":"2024-03-18T15:00:48.608884+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:48.608884+0000","last_undegraded":"2024-03-18T15:00:48.608884+0000","last_fullsized":"2024-03-18T15:00:48.608884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:29:20.141971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594179+0000","last_change":"2024-03-18T15:00:48.594179+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594179+0000","last_undegraded":"2024-03-18T15:00:48.594179+0000","last_fullsized":"2024-03-18T15:00:48.594179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594704+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:49.594704+0000","last_peered":"2024-03-18T15:00:49.594704+0000","last_clean":"2024-03-18T15:00:49.594704+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:49.594704+0000","last_undegraded":"2024-03-18T15:00:49.594704+0000","last_fullsized":"2024-03-18T15:00:49.594704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616575+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:49.616575+0000","last_peered":"2024-03-18T15:00:49.616575+0000","last_clean":"2024-03-18T15:00:49.616575+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:49.616575+0000","last_undegraded":"2024-03-18T15:00:49.616575+0000","last_fullsized":"2024-03-18T15:00:49.616575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.593832+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:49.593832+0000","last_peered":"2024-03-18T15:00:49.593832+0000","last_clean":"2024-03-18T15:00:49.593832+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:49.593832+0000","last_undegraded":"2024-03-18T15:00:49.593832+0000","last_fullsized":"2024-03-18T15:00:49.593832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.610447+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:49.610447+0000","last_peered":"2024-03-18T15:00:49.610447+0000","last_clean":"2024-03-18T15:00:49.610447+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:49.610447+0000","last_undegraded":"2024-03-18T15:00:49.610447+0000","last_fullsized":"2024-03-18T15:00:49.610447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616394+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:49.616394+0000","last_peered":"2024-03-18T15:00:49.616394+0000","last_clean":"2024-03-18T15:00:49.616394+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:49.616394+0000","last_undegraded":"2024-03-18T15:00:49.616394+0000","last_fullsized":"2024-03-18T15:00:49.616394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608268+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:49.608268+0000","last_peered":"2024-03-18T15:00:49.608268+0000","last_clean":"2024-03-18T15:00:49.608268+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:49.608268+0000","last_undegraded":"2024-03-18T15:00:49.608268+0000","last_fullsized":"2024-03-18T15:00:49.608268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616415+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:49.616415+0000","last_peered":"2024-03-18T15:00:49.616415+0000","last_clean":"2024-03-18T15:00:49.616415+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:49.616415+0000","last_undegraded":"2024-03-18T15:00:49.616415+0000","last_fullsized":"2024-03-18T15:00:49.616415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616367+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:49.616367+0000","last_peered":"2024-03-18T15:00:49.616367+0000","last_clean":"2024-03-18T15:00:49.616367+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:49.616367+0000","last_undegraded":"2024-03-18T15:00:49.616367+0000","last_fullsized":"2024-03-18T15:00:49.616367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614883+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:49.614883+0000","last_peered":"2024-03-18T15:00:49.614883+0000","last_clean":"2024-03-18T15:00:49.614883+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:49.614883+0000","last_undegraded":"2024-03-18T15:00:49.614883+0000","last_fullsized":"2024-03-18T15:00:49.614883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616611+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:49.616611+0000","last_peered":"2024-03-18T15:00:49.616611+0000","last_clean":"2024-03-18T15:00:49.616611+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:49.616611+0000","last_undegraded":"2024-03-18T15:00:49.616611+0000","last_fullsized":"2024-03-18T15:00:49.616611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590521+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:49.590521+0000","last_peered":"2024-03-18T15:00:49.590521+0000","last_clean":"2024-03-18T15:00:49.590521+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:49.590521+0000","last_undegraded":"2024-03-18T15:00:49.590521+0000","last_fullsized":"2024-03-18T15:00:49.590521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.589875+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:49.589875+0000","last_peered":"2024-03-18T15:00:49.589875+0000","last_clean":"2024-03-18T15:00:49.589875+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:49.589875+0000","last_undegraded":"2024-03-18T15:00:49.589875+0000","last_fullsized":"2024-03-18T15:00:49.589875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588220+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:49.588220+0000","last_peered":"2024-03-18T15:00:49.588220+0000","last_clean":"2024-03-18T15:00:49.588220+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:49.588220+0000","last_undegraded":"2024-03-18T15:00:49.588220+0000","last_fullsized":"2024-03-18T15:00:49.588220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593049+0000","last_change":"2024-03-18T15:00:48.593049+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593049+0000","last_undegraded":"2024-03-18T15:00:48.593049+0000","last_fullsized":"2024-03-18T15:00:48.593049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594873+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:49.594873+0000","last_peered":"2024-03-18T15:00:49.594873+0000","last_clean":"2024-03-18T15:00:49.594873+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:49.594873+0000","last_undegraded":"2024-03-18T15:00:49.594873+0000","last_fullsized":"2024-03-18T15:00:49.594873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608607+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:49.608607+0000","last_peered":"2024-03-18T15:00:49.608607+0000","last_clean":"2024-03-18T15:00:49.608607+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:49.608607+0000","last_undegraded":"2024-03-18T15:00:49.608607+0000","last_fullsized":"2024-03-18T15:00:49.608607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:03.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614800+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:49.614800+0000","last_peered":"2024-03-18T15:00:49.614800+0000","last_clean":"2024-03-18T15:00:49.614800+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:49.614800+0000","last_undegraded":"2024-03-18T15:00:49.614800+0000","last_fullsized":"2024-03-18T15:00:49.614800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590156+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:49.590156+0000","last_peered":"2024-03-18T15:00:49.590156+0000","last_clean":"2024-03-18T15:00:49.590156+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:49.590156+0000","last_undegraded":"2024-03-18T15:00:49.590156+0000","last_fullsized":"2024-03-18T15:00:49.590156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621300+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.621300+0000","last_peered":"2024-03-18T15:00:50.621300+0000","last_clean":"2024-03-18T15:00:50.621300+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.621300+0000","last_undegraded":"2024-03-18T15:00:50.621300+0000","last_fullsized":"2024-03-18T15:00:50.621300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609666+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:49.609666+0000","last_peered":"2024-03-18T15:00:49.609666+0000","last_clean":"2024-03-18T15:00:49.609666+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:49.609666+0000","last_undegraded":"2024-03-18T15:00:49.609666+0000","last_fullsized":"2024-03-18T15:00:49.609666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593111+0000","last_change":"2024-03-18T15:00:48.593111+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593111+0000","last_undegraded":"2024-03-18T15:00:48.593111+0000","last_fullsized":"2024-03-18T15:00:48.593111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588061+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:49.588061+0000","last_peered":"2024-03-18T15:00:49.588061+0000","last_clean":"2024-03-18T15:00:49.588061+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:49.588061+0000","last_undegraded":"2024-03-18T15:00:49.588061+0000","last_fullsized":"2024-03-18T15:00:49.588061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608459+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:49.608459+0000","last_peered":"2024-03-18T15:00:49.608459+0000","last_clean":"2024-03-18T15:00:49.608459+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:49.608459+0000","last_undegraded":"2024-03-18T15:00:49.608459+0000","last_fullsized":"2024-03-18T15:00:49.608459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:50.089898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616192+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:49.616192+0000","last_peered":"2024-03-18T15:00:49.616192+0000","last_clean":"2024-03-18T15:00:49.616192+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:49.616192+0000","last_undegraded":"2024-03-18T15:00:49.616192+0000","last_fullsized":"2024-03-18T15:00:49.616192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614175+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:49.614175+0000","last_peered":"2024-03-18T15:00:49.614175+0000","last_clean":"2024-03-18T15:00:49.614175+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:49.614175+0000","last_undegraded":"2024-03-18T15:00:49.614175+0000","last_fullsized":"2024-03-18T15:00:49.614175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614780+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:49.614780+0000","last_peered":"2024-03-18T15:00:49.614780+0000","last_clean":"2024-03-18T15:00:49.614780+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:49.614780+0000","last_undegraded":"2024-03-18T15:00:49.614780+0000","last_fullsized":"2024-03-18T15:00:49.614780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615568+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:49.615568+0000","last_peered":"2024-03-18T15:00:49.615568+0000","last_clean":"2024-03-18T15:00:49.615568+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:49.615568+0000","last_undegraded":"2024-03-18T15:00:49.615568+0000","last_fullsized":"2024-03-18T15:00:49.615568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613525+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:49.613525+0000","last_peered":"2024-03-18T15:00:49.613525+0000","last_clean":"2024-03-18T15:00:49.613525+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:49.613525+0000","last_undegraded":"2024-03-18T15:00:49.613525+0000","last_fullsized":"2024-03-18T15:00:49.613525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613781+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:49.613781+0000","last_peered":"2024-03-18T15:00:49.613781+0000","last_clean":"2024-03-18T15:00:49.613781+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:49.613781+0000","last_undegraded":"2024-03-18T15:00:49.613781+0000","last_fullsized":"2024-03-18T15:00:49.613781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594498+0000","last_change":"2024-03-18T15:00:48.594498+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594498+0000","last_undegraded":"2024-03-18T15:00:48.594498+0000","last_fullsized":"2024-03-18T15:00:48.594498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.611737+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:48.611737+0000","last_peered":"2024-03-18T15:00:48.611737+0000","last_clean":"2024-03-18T15:00:48.611737+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:48.611737+0000","last_undegraded":"2024-03-18T15:00:48.611737+0000","last_fullsized":"2024-03-18T15:00:48.611737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":649070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:00:52.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.885+0000 7f9ca3b40640 1 Processor -- start 2024-03-18T15:00:52.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.886+0000 7f9ca3b40640 1 -- start start 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.886+0000 7f9ca3b40640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.886+0000 7f9ca3b40640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9c0cd510 con 0x7f9c9c15c780 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.886+0000 7f9ca3b40640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c9c0cd7f0 con 0x7f9c9c0cef80 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.886+0000 7f9ca3b40640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9c9c0cdad0 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca18dc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca10db640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f9c9c15c780 0x7f9c9c0ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53142/0 (socket says 172.21.15.152:53142) 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca18dc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34140/0 (socket says 172.21.15.152:34140) 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca10db640 1 -- 172.21.15.152:0/3310275125 learned_addr learned my addr 172.21.15.152:0/3310275125 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca18dc640 1 -- 172.21.15.152:0/3310275125 >> v1:172.21.15.186:6789/0 conn(0x7f9c9c0cef80 legacy=0x7f9c9c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca18dc640 1 -- 172.21.15.152:0/3310275125 >> v1:172.21.15.152:6789/0 conn(0x7f9c9c15c780 legacy=0x7f9c9c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca18dc640 1 -- 172.21.15.152:0/3310275125 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c0cddb0 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.887+0000 7f9ca08da640 1 -- 172.21.15.152:0/3310275125 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1470920319 0 0) 0x7f9c9c0cd510 con 0x7f9c9c15c780 2024-03-18T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca18dc640 1 --2- 172.21.15.152:0/3310275125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ad3121a83489164 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca08da640 1 -- 172.21.15.152:0/3310275125 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98035020 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca08da640 1 -- 172.21.15.152:0/3310275125 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c98031830 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca08da640 1 -- 172.21.15.152:0/3310275125 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98031c00 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 -- 172.21.15.152:0/3310275125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c15c3a0 msgr2=0x7f9c9c0d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/3310275125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c9802b8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 -- 172.21.15.152:0/3310275125 shutdown_connections 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/3310275125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c15c3a0 0x7f9c9c0d2980 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 -- 172.21.15.152:0/3310275125 >> 172.21.15.152:0/3310275125 conn(0x7f9c9c0d1e60 msgr2=0x7f9c9c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 -- 172.21.15.152:0/3310275125 shutdown_connections 2024-03-18T15:00:52.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.888+0000 7f9ca3b40640 1 -- 172.21.15.152:0/3310275125 wait complete. 2024-03-18T15:00:52.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 Processor -- start 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 -- start start 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 0x7f9c9c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 0x7f9c9c06ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c0cf570 con 0x7f9c9c0cef80 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c9c0cf3f0 con 0x7f9c9c15c780 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca3b40640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9c9c06e310 con 0x7f9c9c15c3a0 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca18dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca18dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34156/0 (socket says 172.21.15.152:34156) 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.890+0000 7f9ca18dc640 1 -- 172.21.15.152:0/2866861291 learned_addr learned my addr 172.21.15.152:0/2866861291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca20dd640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 0x7f9c9c06ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca10db640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 0x7f9c9c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 -- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 msgr2=0x7f9c9c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 0x7f9c9c0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 -- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 msgr2=0x7f9c9c06ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 0x7f9c9c06ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 -- 172.21.15.152:0/2866861291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c9c0b3f30 con 0x7f9c9c0cef80 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca10db640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 0x7f9c9c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca20dd640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 0x7f9c9c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca18dc640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c98004230 con 0x7f9c9c0cef80 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c980043d0 con 0x7f9c9c0cef80 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c9c0b4210 con 0x7f9c9c0cef80 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c9803cad0 con 0x7f9c9c0cef80 2024-03-18T15:00:52.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.891+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c9c0b47d0 con 0x7f9c9c0cef80 2024-03-18T15:00:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.892+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c9c04f5b0 con 0x7f9c9c0cef80 2024-03-18T15:00:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.892+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9c98038020 con 0x7f9c9c0cef80 2024-03-18T15:00:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.893+0000 7f9c927fc640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 0x7f9c8006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:52.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.893+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9c980ace90 con 0x7f9c9c0cef80 2024-03-18T15:00:52.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.893+0000 7f9ca10db640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 0x7f9c8006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:52.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.893+0000 7f9ca10db640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 0x7f9c8006e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c09fed0 tx=0x7f9c8c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:52.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:52.897+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9c98041070 con 0x7f9c9c0cef80 2024-03-18T15:00:53.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.214+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c9c0ce370 con 0x7f9c8006bbd0 2024-03-18T15:00:53.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.220+0000 7f9c927fc640 1 -- 172.21.15.152:0/2866861291 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251081 (secure 0 0 0) 0x7f9c9c0ce370 con 0x7f9c8006bbd0 2024-03-18T15:00:53.223 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:53.224 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 msgr2=0x7f9c8006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 0x7f9c8006e090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f9c9c09fed0 tx=0x7f9c8c009040 comp rx=0 tx=0).stop 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 msgr2=0x7f9c9c0b3950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f9c980097a0 tx=0x7f9c980046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 shutdown_connections 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c9c15c780 0x7f9c9c06ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c8006bbd0 0x7f9c8006e090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c9c15c3a0 0x7f9c9c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 --2- 172.21.15.152:0/2866861291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c9c0cef80 0x7f9c9c0b3950 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 >> 172.21.15.152:0/2866861291 conn(0x7f9c9c0d1e60 msgr2=0x7f9c9c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 shutdown_connections 2024-03-18T15:00:53.227 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.224+0000 7f9ca3b40640 1 -- 172.21.15.152:0/2866861291 wait complete. 2024-03-18T15:00:53.235 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-18T15:00:51.804899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223136,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751584,"statfs":{"total":773094113280,"available":772865622016,"internally_reserved":0,"allocated":2875392,"data_stored":1743797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608555+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:49.608555+0000","last_peered":"2024-03-18T15:00:49.608555+0000","last_clean":"2024-03-18T15:00:49.608555+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:49.608555+0000","last_undegraded":"2024-03-18T15:00:49.608555+0000","last_fullsized":"2024-03-18T15:00:49.608555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593631+0000","last_change":"2024-03-18T15:00:48.593631+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593631+0000","last_undegraded":"2024-03-18T15:00:48.593631+0000","last_fullsized":"2024-03-18T15:00:48.593631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613546+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:49.613546+0000","last_peered":"2024-03-18T15:00:49.613546+0000","last_clean":"2024-03-18T15:00:49.613546+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.613546+0000","last_undegraded":"2024-03-18T15:00:49.613546+0000","last_fullsized":"2024-03-18T15:00:49.613546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616312+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:49.616312+0000","last_peered":"2024-03-18T15:00:49.616312+0000","last_clean":"2024-03-18T15:00:49.616312+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:49.616312+0000","last_undegraded":"2024-03-18T15:00:49.616312+0000","last_fullsized":"2024-03-18T15:00:49.616312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615774+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:49.615774+0000","last_peered":"2024-03-18T15:00:49.615774+0000","last_clean":"2024-03-18T15:00:49.615774+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:49.615774+0000","last_undegraded":"2024-03-18T15:00:49.615774+0000","last_fullsized":"2024-03-18T15:00:49.615774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613637+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:49.613637+0000","last_peered":"2024-03-18T15:00:49.613637+0000","last_clean":"2024-03-18T15:00:49.613637+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:49.613637+0000","last_undegraded":"2024-03-18T15:00:49.613637+0000","last_fullsized":"2024-03-18T15:00:49.613637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618050+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:49.618050+0000","last_peered":"2024-03-18T15:00:49.618050+0000","last_clean":"2024-03-18T15:00:49.618050+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:49.618050+0000","last_undegraded":"2024-03-18T15:00:49.618050+0000","last_fullsized":"2024-03-18T15:00:49.618050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618150+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:49.618150+0000","last_peered":"2024-03-18T15:00:49.618150+0000","last_clean":"2024-03-18T15:00:49.618150+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:49.618150+0000","last_undegraded":"2024-03-18T15:00:49.618150+0000","last_fullsized":"2024-03-18T15:00:49.618150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616062+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:49.616062+0000","last_peered":"2024-03-18T15:00:49.616062+0000","last_clean":"2024-03-18T15:00:49.616062+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:49.616062+0000","last_undegraded":"2024-03-18T15:00:49.616062+0000","last_fullsized":"2024-03-18T15:00:49.616062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611650+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:49.611650+0000","last_peered":"2024-03-18T15:00:49.611650+0000","last_clean":"2024-03-18T15:00:49.611650+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:49.611650+0000","last_undegraded":"2024-03-18T15:00:49.611650+0000","last_fullsized":"2024-03-18T15:00:49.611650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:30.729724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594920+0000","last_change":"2024-03-18T15:00:48.594920+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594920+0000","last_undegraded":"2024-03-18T15:00:48.594920+0000","last_fullsized":"2024-03-18T15:00:48.594920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612404+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:49.612404+0000","last_peered":"2024-03-18T15:00:49.612404+0000","last_clean":"2024-03-18T15:00:49.612404+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:49.612404+0000","last_undegraded":"2024-03-18T15:00:49.612404+0000","last_fullsized":"2024-03-18T15:00:49.612404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:55.684856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613062+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:49.613062+0000","last_peered":"2024-03-18T15:00:49.613062+0000","last_clean":"2024-03-18T15:00:49.613062+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:49.613062+0000","last_undegraded":"2024-03-18T15:00:49.613062+0000","last_fullsized":"2024-03-18T15:00:49.613062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.605350+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:49.605350+0000","last_peered":"2024-03-18T15:00:49.605350+0000","last_clean":"2024-03-18T15:00:49.605350+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:49.605350+0000","last_undegraded":"2024-03-18T15:00:49.605350+0000","last_fullsized":"2024-03-18T15:00:49.605350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616025+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:49.616025+0000","last_peered":"2024-03-18T15:00:49.616025+0000","last_clean":"2024-03-18T15:00:49.616025+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:49.616025+0000","last_undegraded":"2024-03-18T15:00:49.616025+0000","last_fullsized":"2024-03-18T15:00:49.616025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.596213+0000","last_change":"2024-03-18T15:00:48.596213+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.596213+0000","last_undegraded":"2024-03-18T15:00:48.596213+0000","last_fullsized":"2024-03-18T15:00:48.596213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614923+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:49.614923+0000","last_peered":"2024-03-18T15:00:49.614923+0000","last_clean":"2024-03-18T15:00:49.614923+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:49.614923+0000","last_undegraded":"2024-03-18T15:00:49.614923+0000","last_fullsized":"2024-03-18T15:00:49.614923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:54.207821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612383+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:49.612383+0000","last_peered":"2024-03-18T15:00:49.612383+0000","last_clean":"2024-03-18T15:00:49.612383+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:49.612383+0000","last_undegraded":"2024-03-18T15:00:49.612383+0000","last_fullsized":"2024-03-18T15:00:49.612383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:08.211280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611386+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:49.611386+0000","last_peered":"2024-03-18T15:00:49.611386+0000","last_clean":"2024-03-18T15:00:49.611386+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:49.611386+0000","last_undegraded":"2024-03-18T15:00:49.611386+0000","last_fullsized":"2024-03-18T15:00:49.611386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:42.048658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.595450+0000","last_change":"2024-03-18T15:00:48.595450+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.595450+0000","last_undegraded":"2024-03-18T15:00:48.595450+0000","last_fullsized":"2024-03-18T15:00:48.595450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616540+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:49.616540+0000","last_peered":"2024-03-18T15:00:49.616540+0000","last_clean":"2024-03-18T15:00:49.616540+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:49.616540+0000","last_undegraded":"2024-03-18T15:00:49.616540+0000","last_fullsized":"2024-03-18T15:00:49.616540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612427+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:49.612427+0000","last_peered":"2024-03-18T15:00:49.612427+0000","last_clean":"2024-03-18T15:00:49.612427+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:49.612427+0000","last_undegraded":"2024-03-18T15:00:49.612427+0000","last_fullsized":"2024-03-18T15:00:49.612427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608537+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:49.608537+0000","last_peered":"2024-03-18T15:00:49.608537+0000","last_clean":"2024-03-18T15:00:49.608537+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:49.608537+0000","last_undegraded":"2024-03-18T15:00:49.608537+0000","last_fullsized":"2024-03-18T15:00:49.608537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:16.293687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594247+0000","last_change":"2024-03-18T15:00:48.594247+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594247+0000","last_undegraded":"2024-03-18T15:00:48.594247+0000","last_fullsized":"2024-03-18T15:00:48.594247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609183+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:49.609183+0000","last_peered":"2024-03-18T15:00:49.609183+0000","last_clean":"2024-03-18T15:00:49.609183+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:49.609183+0000","last_undegraded":"2024-03-18T15:00:49.609183+0000","last_fullsized":"2024-03-18T15:00:49.609183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592533+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:49.592533+0000","last_peered":"2024-03-18T15:00:49.592533+0000","last_clean":"2024-03-18T15:00:49.592533+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:49.592533+0000","last_undegraded":"2024-03-18T15:00:49.592533+0000","last_fullsized":"2024-03-18T15:00:49.592533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.597147+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:49.597147+0000","last_peered":"2024-03-18T15:00:49.597147+0000","last_clean":"2024-03-18T15:00:49.597147+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:49.597147+0000","last_undegraded":"2024-03-18T15:00:49.597147+0000","last_fullsized":"2024-03-18T15:00:49.597147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612337+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:49.612337+0000","last_peered":"2024-03-18T15:00:49.612337+0000","last_clean":"2024-03-18T15:00:49.612337+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:49.612337+0000","last_undegraded":"2024-03-18T15:00:49.612337+0000","last_fullsized":"2024-03-18T15:00:49.612337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:02.312876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592512+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:49.592512+0000","last_peered":"2024-03-18T15:00:49.592512+0000","last_clean":"2024-03-18T15:00:49.592512+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:49.592512+0000","last_undegraded":"2024-03-18T15:00:49.592512+0000","last_fullsized":"2024-03-18T15:00:49.592512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593780+0000","last_change":"2024-03-18T15:00:48.593780+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593780+0000","last_undegraded":"2024-03-18T15:00:48.593780+0000","last_fullsized":"2024-03-18T15:00:48.593780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609061+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:49.609061+0000","last_peered":"2024-03-18T15:00:49.609061+0000","last_clean":"2024-03-18T15:00:49.609061+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:49.609061+0000","last_undegraded":"2024-03-18T15:00:49.609061+0000","last_fullsized":"2024-03-18T15:00:49.609061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:23.516467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.620698+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:49.620698+0000","last_peered":"2024-03-18T15:00:49.620698+0000","last_clean":"2024-03-18T15:00:49.620698+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:49.620698+0000","last_undegraded":"2024-03-18T15:00:49.620698+0000","last_fullsized":"2024-03-18T15:00:49.620698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616634+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:49.616634+0000","last_peered":"2024-03-18T15:00:49.616634+0000","last_clean":"2024-03-18T15:00:49.616634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.616634+0000","last_undegraded":"2024-03-18T15:00:49.616634+0000","last_fullsized":"2024-03-18T15:00:49.616634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.608884+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:48.608884+0000","last_peered":"2024-03-18T15:00:48.608884+0000","last_clean":"2024-03-18T15:00:48.608884+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:48.608884+0000","last_undegraded":"2024-03-18T15:00:48.608884+0000","last_fullsized":"2024-03-18T15:00:48.608884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:29:20.141971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594179+0000","last_change":"2024-03-18T15:00:48.594179+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594179+0000","last_undegraded":"2024-03-18T15:00:48.594179+0000","last_fullsized":"2024-03-18T15:00:48.594179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594704+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:49.594704+0000","last_peered":"2024-03-18T15:00:49.594704+0000","last_clean":"2024-03-18T15:00:49.594704+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:49.594704+0000","last_undegraded":"2024-03-18T15:00:49.594704+0000","last_fullsized":"2024-03-18T15:00:49.594704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616575+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:49.616575+0000","last_peered":"2024-03-18T15:00:49.616575+0000","last_clean":"2024-03-18T15:00:49.616575+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:49.616575+0000","last_undegraded":"2024-03-18T15:00:49.616575+0000","last_fullsized":"2024-03-18T15:00:49.616575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.593832+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:49.593832+0000","last_peered":"2024-03-18T15:00:49.593832+0000","last_clean":"2024-03-18T15:00:49.593832+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:49.593832+0000","last_undegraded":"2024-03-18T15:00:49.593832+0000","last_fullsized":"2024-03-18T15:00:49.593832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.610447+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:49.610447+0000","last_peered":"2024-03-18T15:00:49.610447+0000","last_clean":"2024-03-18T15:00:49.610447+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:49.610447+0000","last_undegraded":"2024-03-18T15:00:49.610447+0000","last_fullsized":"2024-03-18T15:00:49.610447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616394+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:49.616394+0000","last_peered":"2024-03-18T15:00:49.616394+0000","last_clean":"2024-03-18T15:00:49.616394+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:49.616394+0000","last_undegraded":"2024-03-18T15:00:49.616394+0000","last_fullsized":"2024-03-18T15:00:49.616394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608268+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:49.608268+0000","last_peered":"2024-03-18T15:00:49.608268+0000","last_clean":"2024-03-18T15:00:49.608268+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:49.608268+0000","last_undegraded":"2024-03-18T15:00:49.608268+0000","last_fullsized":"2024-03-18T15:00:49.608268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616415+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:49.616415+0000","last_peered":"2024-03-18T15:00:49.616415+0000","last_clean":"2024-03-18T15:00:49.616415+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:49.616415+0000","last_undegraded":"2024-03-18T15:00:49.616415+0000","last_fullsized":"2024-03-18T15:00:49.616415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616367+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:49.616367+0000","last_peered":"2024-03-18T15:00:49.616367+0000","last_clean":"2024-03-18T15:00:49.616367+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:49.616367+0000","last_undegraded":"2024-03-18T15:00:49.616367+0000","last_fullsized":"2024-03-18T15:00:49.616367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614883+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:49.614883+0000","last_peered":"2024-03-18T15:00:49.614883+0000","last_clean":"2024-03-18T15:00:49.614883+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:49.614883+0000","last_undegraded":"2024-03-18T15:00:49.614883+0000","last_fullsized":"2024-03-18T15:00:49.614883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616611+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:49.616611+0000","last_peered":"2024-03-18T15:00:49.616611+0000","last_clean":"2024-03-18T15:00:49.616611+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:49.616611+0000","last_undegraded":"2024-03-18T15:00:49.616611+0000","last_fullsized":"2024-03-18T15:00:49.616611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590521+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:49.590521+0000","last_peered":"2024-03-18T15:00:49.590521+0000","last_clean":"2024-03-18T15:00:49.590521+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:49.590521+0000","last_undegraded":"2024-03-18T15:00:49.590521+0000","last_fullsized":"2024-03-18T15:00:49.590521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.589875+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:49.589875+0000","last_peered":"2024-03-18T15:00:49.589875+0000","last_clean":"2024-03-18T15:00:49.589875+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:49.589875+0000","last_undegraded":"2024-03-18T15:00:49.589875+0000","last_fullsized":"2024-03-18T15:00:49.589875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588220+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:49.588220+0000","last_peered":"2024-03-18T15:00:49.588220+0000","last_clean":"2024-03-18T15:00:49.588220+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:49.588220+0000","last_undegraded":"2024-03-18T15:00:49.588220+0000","last_fullsized":"2024-03-18T15:00:49.588220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593049+0000","last_change":"2024-03-18T15:00:48.593049+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593049+0000","last_undegraded":"2024-03-18T15:00:48.593049+0000","last_fullsized":"2024-03-18T15:00:48.593049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594873+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:49.594873+0000","last_peered":"2024-03-18T15:00:49.594873+0000","last_clean":"2024-03-18T15:00:49.594873+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:49.594873+0000","last_undegraded":"2024-03-18T15:00:49.594873+0000","last_fullsized":"2024-03-18T15:00:49.594873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608607+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:49.608607+0000","last_peered":"2024-03-18T15:00:49.608607+0000","last_clean":"2024-03-18T15:00:49.608607+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:49.608607+0000","last_undegraded":"2024-03-18T15:00:49.608607+0000","last_fullsized":"2024-03-18T15:00:49.608607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:03.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614800+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:49.614800+0000","last_peered":"2024-03-18T15:00:49.614800+0000","last_clean":"2024-03-18T15:00:49.614800+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:49.614800+0000","last_undegraded":"2024-03-18T15:00:49.614800+0000","last_fullsized":"2024-03-18T15:00:49.614800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590156+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:49.590156+0000","last_peered":"2024-03-18T15:00:49.590156+0000","last_clean":"2024-03-18T15:00:49.590156+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:49.590156+0000","last_undegraded":"2024-03-18T15:00:49.590156+0000","last_fullsized":"2024-03-18T15:00:49.590156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621300+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.621300+0000","last_peered":"2024-03-18T15:00:50.621300+0000","last_clean":"2024-03-18T15:00:50.621300+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.621300+0000","last_undegraded":"2024-03-18T15:00:50.621300+0000","last_fullsized":"2024-03-18T15:00:50.621300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609666+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:49.609666+0000","last_peered":"2024-03-18T15:00:49.609666+0000","last_clean":"2024-03-18T15:00:49.609666+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:49.609666+0000","last_undegraded":"2024-03-18T15:00:49.609666+0000","last_fullsized":"2024-03-18T15:00:49.609666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593111+0000","last_change":"2024-03-18T15:00:48.593111+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593111+0000","last_undegraded":"2024-03-18T15:00:48.593111+0000","last_fullsized":"2024-03-18T15:00:48.593111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588061+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:49.588061+0000","last_peered":"2024-03-18T15:00:49.588061+0000","last_clean":"2024-03-18T15:00:49.588061+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:49.588061+0000","last_undegraded":"2024-03-18T15:00:49.588061+0000","last_fullsized":"2024-03-18T15:00:49.588061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608459+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:49.608459+0000","last_peered":"2024-03-18T15:00:49.608459+0000","last_clean":"2024-03-18T15:00:49.608459+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:49.608459+0000","last_undegraded":"2024-03-18T15:00:49.608459+0000","last_fullsized":"2024-03-18T15:00:49.608459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:50.089898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616192+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:49.616192+0000","last_peered":"2024-03-18T15:00:49.616192+0000","last_clean":"2024-03-18T15:00:49.616192+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:49.616192+0000","last_undegraded":"2024-03-18T15:00:49.616192+0000","last_fullsized":"2024-03-18T15:00:49.616192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614175+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:49.614175+0000","last_peered":"2024-03-18T15:00:49.614175+0000","last_clean":"2024-03-18T15:00:49.614175+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:49.614175+0000","last_undegraded":"2024-03-18T15:00:49.614175+0000","last_fullsized":"2024-03-18T15:00:49.614175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614780+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:49.614780+0000","last_peered":"2024-03-18T15:00:49.614780+0000","last_clean":"2024-03-18T15:00:49.614780+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:49.614780+0000","last_undegraded":"2024-03-18T15:00:49.614780+0000","last_fullsized":"2024-03-18T15:00:49.614780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615568+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:49.615568+0000","last_peered":"2024-03-18T15:00:49.615568+0000","last_clean":"2024-03-18T15:00:49.615568+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:49.615568+0000","last_undegraded":"2024-03-18T15:00:49.615568+0000","last_fullsized":"2024-03-18T15:00:49.615568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613525+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:49.613525+0000","last_peered":"2024-03-18T15:00:49.613525+0000","last_clean":"2024-03-18T15:00:49.613525+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:49.613525+0000","last_undegraded":"2024-03-18T15:00:49.613525+0000","last_fullsized":"2024-03-18T15:00:49.613525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613781+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:49.613781+0000","last_peered":"2024-03-18T15:00:49.613781+0000","last_clean":"2024-03-18T15:00:49.613781+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:49.613781+0000","last_undegraded":"2024-03-18T15:00:49.613781+0000","last_fullsized":"2024-03-18T15:00:49.613781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594498+0000","last_change":"2024-03-18T15:00:48.594498+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594498+0000","last_undegraded":"2024-03-18T15:00:48.594498+0000","last_fullsized":"2024-03-18T15:00:48.594498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.611737+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:48.611737+0000","last_peered":"2024-03-18T15:00:48.611737+0000","last_clean":"2024-03-18T15:00:48.611737+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:48.611737+0000","last_undegraded":"2024-03-18T15:00:48.611737+0000","last_fullsized":"2024-03-18T15:00:48.611737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":649070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:00:53.239 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:00:53.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.379+0000 7f7910c75640 1 Processor -- start 2024-03-18T15:00:53.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.379+0000 7f7910c75640 1 -- start start 2024-03-18T15:00:53.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7910c75640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f790c06f460 0x7f790c06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7910c75640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c165b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7910c75640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f790c0d0b40 con 0x7f790c145a50 2024-03-18T15:00:53.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7910c75640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f790c06bb70 con 0x7f790c06f460 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7910c75640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f790c0d0050 con 0x7f790c06b700 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f790a59c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f790c145a50 0x7f790c0cd710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53146/0 (socket says 172.21.15.152:53146) 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f790a59c640 1 -- 172.21.15.152:0/3712521805 learned_addr learned my addr 172.21.15.152:0/3712521805 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.380+0000 7f7901d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f790c06f460 0x7f790c06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7909d9b640 1 -- 172.21.15.152:0/3712521805 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3283958828 0 0) 0x7f790c0d0b40 con 0x7f790c145a50 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f790ad9d640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c165b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7909d9b640 1 -- 172.21.15.152:0/3712521805 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f78f8003520 con 0x7f790c145a50 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7901d9b640 1 -- 172.21.15.152:0/3712521805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 msgr2=0x7f790c165b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7901d9b640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c165b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7901d9b640 1 -- 172.21.15.152:0/3712521805 >> v1:172.21.15.152:6789/0 conn(0x7f790c145a50 legacy=0x7f790c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f7901d9b640 1 -- 172.21.15.152:0/3712521805 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c06df70 con 0x7f790c06f460 2024-03-18T15:00:53.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.381+0000 7f790ad9d640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c165b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7901d9b640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c06f460 0x7f790c06b1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78f40097a0 tx=0x7f78f402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42268ca3591d5a91 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7909d9b640 1 -- 172.21.15.152:0/3712521805 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4038070 con 0x7f790c06f460 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7909d9b640 1 -- 172.21.15.152:0/3712521805 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f78f4031700 con 0x7f790c06f460 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7909d9b640 1 -- 172.21.15.152:0/3712521805 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f4031ad0 con 0x7f790c06f460 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7910c75640 1 -- 172.21.15.152:0/3712521805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c06f460 msgr2=0x7f790c06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.382+0000 7f7910c75640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c06f460 0x7f790c06b1c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f78f40097a0 tx=0x7f78f402b7a0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 -- 172.21.15.152:0/3712521805 shutdown_connections 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c165b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 --2- 172.21.15.152:0/3712521805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c06f460 0x7f790c06b1c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 -- 172.21.15.152:0/3712521805 >> 172.21.15.152:0/3712521805 conn(0x7f790c0d0d30 msgr2=0x7f790c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 -- 172.21.15.152:0/3712521805 shutdown_connections 2024-03-18T15:00:53.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.383+0000 7f7910c75640 1 -- 172.21.15.152:0/3712521805 wait complete. 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.384+0000 7f7910c75640 1 Processor -- start 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.384+0000 7f7910c75640 1 -- start start 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c13e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f790c06f460 0x7f790c0aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0d0860 con 0x7f790c145a50 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f790c0d0580 con 0x7f790c06f460 2024-03-18T15:00:53.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f790c0cde20 con 0x7f790c06b700 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34170/0 (socket says 172.21.15.152:34170) 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 -- 172.21.15.152:0/2475875444 learned_addr learned my addr 172.21.15.152:0/2475875444 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790a59c640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c13e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7901d9b640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f790c06f460 0x7f790c0aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 -- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 msgr2=0x7f790c13e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c13e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 -- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f790c06f460 msgr2=0x7f790c0aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f790c06f460 0x7f790c0aedc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 -- 172.21.15.152:0/2475875444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f790c13bff0 con 0x7f790c145a50 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790a59c640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c13e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f790ad9d640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7904007df0 tx=0x7f790400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f790401a070 con 0x7f790c145a50 2024-03-18T15:00:53.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f790c0af530 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7904003990 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.385+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7904003d80 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.386+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f790c0afaf0 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.387+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f790c04f5b0 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.387+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f790401d070 con 0x7f790c145a50 2024-03-18T15:00:53.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.387+0000 7f79037fe640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 0x7f78ec06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.387+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f790408aca0 con 0x7f790c145a50 2024-03-18T15:00:53.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.387+0000 7f790a59c640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 0x7f78ec06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.388+0000 7f790a59c640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 0x7f78ec06e0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78fc005880 tx=0x7f78fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.392+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7904010070 con 0x7f790c145a50 2024-03-18T15:00:53.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.637+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f790c144c70 con 0x7f78ec06bc00 2024-03-18T15:00:53.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.643+0000 7f79037fe640 1 -- 172.21.15.152:0/2475875444 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251081 (secure 0 0 0) 0x7f790c144c70 con 0x7f78ec06bc00 2024-03-18T15:00:53.646 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:53.647 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:00:53.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 msgr2=0x7f78ec06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 0x7f78ec06e0c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f78fc005880 tx=0x7f78fc009040 comp rx=0 tx=0).stop 2024-03-18T15:00:53.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 msgr2=0x7f790c13bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7904007df0 tx=0x7f790400d4a0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 shutdown_connections 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f790c145a50 0x7f790c13bab0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f790c06f460 0x7f790c0aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f78ec06bc00 0x7f78ec06e0c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 --2- 172.21.15.152:0/2475875444 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f790c06b700 0x7f790c13e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 >> 172.21.15.152:0/2475875444 conn(0x7f790c0d0d30 msgr2=0x7f790c0726b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 shutdown_connections 2024-03-18T15:00:53.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.646+0000 7f7910c75640 1 -- 172.21.15.152:0/2475875444 wait complete. 2024-03-18T15:00:53.660 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-03-18T15:00:51.804899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223136,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751584,"statfs":{"total":773094113280,"available":772865622016,"internally_reserved":0,"allocated":2875392,"data_stored":1743797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225506"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608555+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:49.608555+0000","last_peered":"2024-03-18T15:00:49.608555+0000","last_clean":"2024-03-18T15:00:49.608555+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:49.608555+0000","last_undegraded":"2024-03-18T15:00:49.608555+0000","last_fullsized":"2024-03-18T15:00:49.608555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593631+0000","last_change":"2024-03-18T15:00:48.593631+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593631+0000","last_undegraded":"2024-03-18T15:00:48.593631+0000","last_fullsized":"2024-03-18T15:00:48.593631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613546+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:49.613546+0000","last_peered":"2024-03-18T15:00:49.613546+0000","last_clean":"2024-03-18T15:00:49.613546+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.613546+0000","last_undegraded":"2024-03-18T15:00:49.613546+0000","last_fullsized":"2024-03-18T15:00:49.613546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616312+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:49.616312+0000","last_peered":"2024-03-18T15:00:49.616312+0000","last_clean":"2024-03-18T15:00:49.616312+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:49.616312+0000","last_undegraded":"2024-03-18T15:00:49.616312+0000","last_fullsized":"2024-03-18T15:00:49.616312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615774+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:49.615774+0000","last_peered":"2024-03-18T15:00:49.615774+0000","last_clean":"2024-03-18T15:00:49.615774+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:49.615774+0000","last_undegraded":"2024-03-18T15:00:49.615774+0000","last_fullsized":"2024-03-18T15:00:49.615774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613637+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:49.613637+0000","last_peered":"2024-03-18T15:00:49.613637+0000","last_clean":"2024-03-18T15:00:49.613637+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:49.613637+0000","last_undegraded":"2024-03-18T15:00:49.613637+0000","last_fullsized":"2024-03-18T15:00:49.613637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618050+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:49.618050+0000","last_peered":"2024-03-18T15:00:49.618050+0000","last_clean":"2024-03-18T15:00:49.618050+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:49.618050+0000","last_undegraded":"2024-03-18T15:00:49.618050+0000","last_fullsized":"2024-03-18T15:00:49.618050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618150+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:49.618150+0000","last_peered":"2024-03-18T15:00:49.618150+0000","last_clean":"2024-03-18T15:00:49.618150+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:49.618150+0000","last_undegraded":"2024-03-18T15:00:49.618150+0000","last_fullsized":"2024-03-18T15:00:49.618150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616062+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:49.616062+0000","last_peered":"2024-03-18T15:00:49.616062+0000","last_clean":"2024-03-18T15:00:49.616062+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:49.616062+0000","last_undegraded":"2024-03-18T15:00:49.616062+0000","last_fullsized":"2024-03-18T15:00:49.616062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611650+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:49.611650+0000","last_peered":"2024-03-18T15:00:49.611650+0000","last_clean":"2024-03-18T15:00:49.611650+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:49.611650+0000","last_undegraded":"2024-03-18T15:00:49.611650+0000","last_fullsized":"2024-03-18T15:00:49.611650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:30.729724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594920+0000","last_change":"2024-03-18T15:00:48.594920+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594920+0000","last_undegraded":"2024-03-18T15:00:48.594920+0000","last_fullsized":"2024-03-18T15:00:48.594920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612404+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:49.612404+0000","last_peered":"2024-03-18T15:00:49.612404+0000","last_clean":"2024-03-18T15:00:49.612404+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:49.612404+0000","last_undegraded":"2024-03-18T15:00:49.612404+0000","last_fullsized":"2024-03-18T15:00:49.612404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:55.684856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613062+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:49.613062+0000","last_peered":"2024-03-18T15:00:49.613062+0000","last_clean":"2024-03-18T15:00:49.613062+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:49.613062+0000","last_undegraded":"2024-03-18T15:00:49.613062+0000","last_fullsized":"2024-03-18T15:00:49.613062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.605350+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:49.605350+0000","last_peered":"2024-03-18T15:00:49.605350+0000","last_clean":"2024-03-18T15:00:49.605350+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:49.605350+0000","last_undegraded":"2024-03-18T15:00:49.605350+0000","last_fullsized":"2024-03-18T15:00:49.605350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616025+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:49.616025+0000","last_peered":"2024-03-18T15:00:49.616025+0000","last_clean":"2024-03-18T15:00:49.616025+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:49.616025+0000","last_undegraded":"2024-03-18T15:00:49.616025+0000","last_fullsized":"2024-03-18T15:00:49.616025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.596213+0000","last_change":"2024-03-18T15:00:48.596213+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.596213+0000","last_undegraded":"2024-03-18T15:00:48.596213+0000","last_fullsized":"2024-03-18T15:00:48.596213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614923+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:49.614923+0000","last_peered":"2024-03-18T15:00:49.614923+0000","last_clean":"2024-03-18T15:00:49.614923+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:49.614923+0000","last_undegraded":"2024-03-18T15:00:49.614923+0000","last_fullsized":"2024-03-18T15:00:49.614923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:54.207821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612383+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:49.612383+0000","last_peered":"2024-03-18T15:00:49.612383+0000","last_clean":"2024-03-18T15:00:49.612383+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:49.612383+0000","last_undegraded":"2024-03-18T15:00:49.612383+0000","last_fullsized":"2024-03-18T15:00:49.612383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:08.211280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611386+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:49.611386+0000","last_peered":"2024-03-18T15:00:49.611386+0000","last_clean":"2024-03-18T15:00:49.611386+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:49.611386+0000","last_undegraded":"2024-03-18T15:00:49.611386+0000","last_fullsized":"2024-03-18T15:00:49.611386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:42.048658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.595450+0000","last_change":"2024-03-18T15:00:48.595450+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.595450+0000","last_undegraded":"2024-03-18T15:00:48.595450+0000","last_fullsized":"2024-03-18T15:00:48.595450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616540+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:49.616540+0000","last_peered":"2024-03-18T15:00:49.616540+0000","last_clean":"2024-03-18T15:00:49.616540+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:49.616540+0000","last_undegraded":"2024-03-18T15:00:49.616540+0000","last_fullsized":"2024-03-18T15:00:49.616540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612427+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:49.612427+0000","last_peered":"2024-03-18T15:00:49.612427+0000","last_clean":"2024-03-18T15:00:49.612427+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:49.612427+0000","last_undegraded":"2024-03-18T15:00:49.612427+0000","last_fullsized":"2024-03-18T15:00:49.612427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608537+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:49.608537+0000","last_peered":"2024-03-18T15:00:49.608537+0000","last_clean":"2024-03-18T15:00:49.608537+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:49.608537+0000","last_undegraded":"2024-03-18T15:00:49.608537+0000","last_fullsized":"2024-03-18T15:00:49.608537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:16.293687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594247+0000","last_change":"2024-03-18T15:00:48.594247+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594247+0000","last_undegraded":"2024-03-18T15:00:48.594247+0000","last_fullsized":"2024-03-18T15:00:48.594247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609183+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:49.609183+0000","last_peered":"2024-03-18T15:00:49.609183+0000","last_clean":"2024-03-18T15:00:49.609183+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:49.609183+0000","last_undegraded":"2024-03-18T15:00:49.609183+0000","last_fullsized":"2024-03-18T15:00:49.609183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592533+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:49.592533+0000","last_peered":"2024-03-18T15:00:49.592533+0000","last_clean":"2024-03-18T15:00:49.592533+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:49.592533+0000","last_undegraded":"2024-03-18T15:00:49.592533+0000","last_fullsized":"2024-03-18T15:00:49.592533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.597147+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:49.597147+0000","last_peered":"2024-03-18T15:00:49.597147+0000","last_clean":"2024-03-18T15:00:49.597147+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:49.597147+0000","last_undegraded":"2024-03-18T15:00:49.597147+0000","last_fullsized":"2024-03-18T15:00:49.597147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612337+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:49.612337+0000","last_peered":"2024-03-18T15:00:49.612337+0000","last_clean":"2024-03-18T15:00:49.612337+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:49.612337+0000","last_undegraded":"2024-03-18T15:00:49.612337+0000","last_fullsized":"2024-03-18T15:00:49.612337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:02.312876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592512+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:49.592512+0000","last_peered":"2024-03-18T15:00:49.592512+0000","last_clean":"2024-03-18T15:00:49.592512+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:49.592512+0000","last_undegraded":"2024-03-18T15:00:49.592512+0000","last_fullsized":"2024-03-18T15:00:49.592512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593780+0000","last_change":"2024-03-18T15:00:48.593780+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593780+0000","last_undegraded":"2024-03-18T15:00:48.593780+0000","last_fullsized":"2024-03-18T15:00:48.593780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609061+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:49.609061+0000","last_peered":"2024-03-18T15:00:49.609061+0000","last_clean":"2024-03-18T15:00:49.609061+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:49.609061+0000","last_undegraded":"2024-03-18T15:00:49.609061+0000","last_fullsized":"2024-03-18T15:00:49.609061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:23.516467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.620698+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:49.620698+0000","last_peered":"2024-03-18T15:00:49.620698+0000","last_clean":"2024-03-18T15:00:49.620698+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:49.620698+0000","last_undegraded":"2024-03-18T15:00:49.620698+0000","last_fullsized":"2024-03-18T15:00:49.620698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616634+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:49.616634+0000","last_peered":"2024-03-18T15:00:49.616634+0000","last_clean":"2024-03-18T15:00:49.616634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.616634+0000","last_undegraded":"2024-03-18T15:00:49.616634+0000","last_fullsized":"2024-03-18T15:00:49.616634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.608884+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:48.608884+0000","last_peered":"2024-03-18T15:00:48.608884+0000","last_clean":"2024-03-18T15:00:48.608884+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:48.608884+0000","last_undegraded":"2024-03-18T15:00:48.608884+0000","last_fullsized":"2024-03-18T15:00:48.608884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:29:20.141971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594179+0000","last_change":"2024-03-18T15:00:48.594179+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594179+0000","last_undegraded":"2024-03-18T15:00:48.594179+0000","last_fullsized":"2024-03-18T15:00:48.594179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594704+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:49.594704+0000","last_peered":"2024-03-18T15:00:49.594704+0000","last_clean":"2024-03-18T15:00:49.594704+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:49.594704+0000","last_undegraded":"2024-03-18T15:00:49.594704+0000","last_fullsized":"2024-03-18T15:00:49.594704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616575+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:49.616575+0000","last_peered":"2024-03-18T15:00:49.616575+0000","last_clean":"2024-03-18T15:00:49.616575+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:49.616575+0000","last_undegraded":"2024-03-18T15:00:49.616575+0000","last_fullsized":"2024-03-18T15:00:49.616575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.593832+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:49.593832+0000","last_peered":"2024-03-18T15:00:49.593832+0000","last_clean":"2024-03-18T15:00:49.593832+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:49.593832+0000","last_undegraded":"2024-03-18T15:00:49.593832+0000","last_fullsized":"2024-03-18T15:00:49.593832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.610447+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:49.610447+0000","last_peered":"2024-03-18T15:00:49.610447+0000","last_clean":"2024-03-18T15:00:49.610447+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:49.610447+0000","last_undegraded":"2024-03-18T15:00:49.610447+0000","last_fullsized":"2024-03-18T15:00:49.610447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616394+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:49.616394+0000","last_peered":"2024-03-18T15:00:49.616394+0000","last_clean":"2024-03-18T15:00:49.616394+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:49.616394+0000","last_undegraded":"2024-03-18T15:00:49.616394+0000","last_fullsized":"2024-03-18T15:00:49.616394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608268+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:49.608268+0000","last_peered":"2024-03-18T15:00:49.608268+0000","last_clean":"2024-03-18T15:00:49.608268+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:49.608268+0000","last_undegraded":"2024-03-18T15:00:49.608268+0000","last_fullsized":"2024-03-18T15:00:49.608268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616415+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:49.616415+0000","last_peered":"2024-03-18T15:00:49.616415+0000","last_clean":"2024-03-18T15:00:49.616415+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:49.616415+0000","last_undegraded":"2024-03-18T15:00:49.616415+0000","last_fullsized":"2024-03-18T15:00:49.616415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616367+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:49.616367+0000","last_peered":"2024-03-18T15:00:49.616367+0000","last_clean":"2024-03-18T15:00:49.616367+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:49.616367+0000","last_undegraded":"2024-03-18T15:00:49.616367+0000","last_fullsized":"2024-03-18T15:00:49.616367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614883+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:49.614883+0000","last_peered":"2024-03-18T15:00:49.614883+0000","last_clean":"2024-03-18T15:00:49.614883+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:49.614883+0000","last_undegraded":"2024-03-18T15:00:49.614883+0000","last_fullsized":"2024-03-18T15:00:49.614883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616611+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:49.616611+0000","last_peered":"2024-03-18T15:00:49.616611+0000","last_clean":"2024-03-18T15:00:49.616611+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:49.616611+0000","last_undegraded":"2024-03-18T15:00:49.616611+0000","last_fullsized":"2024-03-18T15:00:49.616611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590521+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:49.590521+0000","last_peered":"2024-03-18T15:00:49.590521+0000","last_clean":"2024-03-18T15:00:49.590521+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:49.590521+0000","last_undegraded":"2024-03-18T15:00:49.590521+0000","last_fullsized":"2024-03-18T15:00:49.590521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.589875+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:49.589875+0000","last_peered":"2024-03-18T15:00:49.589875+0000","last_clean":"2024-03-18T15:00:49.589875+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:49.589875+0000","last_undegraded":"2024-03-18T15:00:49.589875+0000","last_fullsized":"2024-03-18T15:00:49.589875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588220+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:49.588220+0000","last_peered":"2024-03-18T15:00:49.588220+0000","last_clean":"2024-03-18T15:00:49.588220+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:49.588220+0000","last_undegraded":"2024-03-18T15:00:49.588220+0000","last_fullsized":"2024-03-18T15:00:49.588220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593049+0000","last_change":"2024-03-18T15:00:48.593049+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593049+0000","last_undegraded":"2024-03-18T15:00:48.593049+0000","last_fullsized":"2024-03-18T15:00:48.593049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594873+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:49.594873+0000","last_peered":"2024-03-18T15:00:49.594873+0000","last_clean":"2024-03-18T15:00:49.594873+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:49.594873+0000","last_undegraded":"2024-03-18T15:00:49.594873+0000","last_fullsized":"2024-03-18T15:00:49.594873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608607+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:49.608607+0000","last_peered":"2024-03-18T15:00:49.608607+0000","last_clean":"2024-03-18T15:00:49.608607+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:49.608607+0000","last_undegraded":"2024-03-18T15:00:49.608607+0000","last_fullsized":"2024-03-18T15:00:49.608607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:03.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614800+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:49.614800+0000","last_peered":"2024-03-18T15:00:49.614800+0000","last_clean":"2024-03-18T15:00:49.614800+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:49.614800+0000","last_undegraded":"2024-03-18T15:00:49.614800+0000","last_fullsized":"2024-03-18T15:00:49.614800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590156+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:49.590156+0000","last_peered":"2024-03-18T15:00:49.590156+0000","last_clean":"2024-03-18T15:00:49.590156+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:49.590156+0000","last_undegraded":"2024-03-18T15:00:49.590156+0000","last_fullsized":"2024-03-18T15:00:49.590156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621300+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.621300+0000","last_peered":"2024-03-18T15:00:50.621300+0000","last_clean":"2024-03-18T15:00:50.621300+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.621300+0000","last_undegraded":"2024-03-18T15:00:50.621300+0000","last_fullsized":"2024-03-18T15:00:50.621300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609666+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:49.609666+0000","last_peered":"2024-03-18T15:00:49.609666+0000","last_clean":"2024-03-18T15:00:49.609666+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:49.609666+0000","last_undegraded":"2024-03-18T15:00:49.609666+0000","last_fullsized":"2024-03-18T15:00:49.609666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593111+0000","last_change":"2024-03-18T15:00:48.593111+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593111+0000","last_undegraded":"2024-03-18T15:00:48.593111+0000","last_fullsized":"2024-03-18T15:00:48.593111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588061+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:49.588061+0000","last_peered":"2024-03-18T15:00:49.588061+0000","last_clean":"2024-03-18T15:00:49.588061+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:49.588061+0000","last_undegraded":"2024-03-18T15:00:49.588061+0000","last_fullsized":"2024-03-18T15:00:49.588061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608459+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:49.608459+0000","last_peered":"2024-03-18T15:00:49.608459+0000","last_clean":"2024-03-18T15:00:49.608459+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:49.608459+0000","last_undegraded":"2024-03-18T15:00:49.608459+0000","last_fullsized":"2024-03-18T15:00:49.608459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:50.089898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616192+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:49.616192+0000","last_peered":"2024-03-18T15:00:49.616192+0000","last_clean":"2024-03-18T15:00:49.616192+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:49.616192+0000","last_undegraded":"2024-03-18T15:00:49.616192+0000","last_fullsized":"2024-03-18T15:00:49.616192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614175+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:49.614175+0000","last_peered":"2024-03-18T15:00:49.614175+0000","last_clean":"2024-03-18T15:00:49.614175+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:49.614175+0000","last_undegraded":"2024-03-18T15:00:49.614175+0000","last_fullsized":"2024-03-18T15:00:49.614175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614780+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:49.614780+0000","last_peered":"2024-03-18T15:00:49.614780+0000","last_clean":"2024-03-18T15:00:49.614780+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:49.614780+0000","last_undegraded":"2024-03-18T15:00:49.614780+0000","last_fullsized":"2024-03-18T15:00:49.614780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615568+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:49.615568+0000","last_peered":"2024-03-18T15:00:49.615568+0000","last_clean":"2024-03-18T15:00:49.615568+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:49.615568+0000","last_undegraded":"2024-03-18T15:00:49.615568+0000","last_fullsized":"2024-03-18T15:00:49.615568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613525+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:49.613525+0000","last_peered":"2024-03-18T15:00:49.613525+0000","last_clean":"2024-03-18T15:00:49.613525+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:49.613525+0000","last_undegraded":"2024-03-18T15:00:49.613525+0000","last_fullsized":"2024-03-18T15:00:49.613525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613781+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:49.613781+0000","last_peered":"2024-03-18T15:00:49.613781+0000","last_clean":"2024-03-18T15:00:49.613781+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:49.613781+0000","last_undegraded":"2024-03-18T15:00:49.613781+0000","last_fullsized":"2024-03-18T15:00:49.613781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594498+0000","last_change":"2024-03-18T15:00:48.594498+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594498+0000","last_undegraded":"2024-03-18T15:00:48.594498+0000","last_fullsized":"2024-03-18T15:00:48.594498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.611737+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:48.611737+0000","last_peered":"2024-03-18T15:00:48.611737+0000","last_clean":"2024-03-18T15:00:48.611737+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:48.611737+0000","last_undegraded":"2024-03-18T15:00:48.611737+0000","last_fullsized":"2024-03-18T15:00:48.611737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":649070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:00:53.664 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2024-03-18T15:00:53.664 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.593631+0000', 'last_change': '2024-03-18T15:00:48.593631+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.593631+0000', 'last_undegraded': '2024-03-18T15:00:48.593631+0000', 'last_fullsized': '2024-03-18T15:00:48.593631+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.594920+0000', 'last_change': '2024-03-18T15:00:48.594920+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.594920+0000', 'last_undegraded': '2024-03-18T15:00:48.594920+0000', 'last_fullsized': '2024-03-18T15:00:48.594920+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.596213+0000', 'last_change': '2024-03-18T15:00:48.596213+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.596213+0000', 'last_undegraded': '2024-03-18T15:00:48.596213+0000', 'last_fullsized': '2024-03-18T15:00:48.596213+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.595450+0000', 'last_change': '2024-03-18T15:00:48.595450+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.595450+0000', 'last_undegraded': '2024-03-18T15:00:48.595450+0000', 'last_fullsized': '2024-03-18T15:00:48.595450+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.594247+0000', 'last_change': '2024-03-18T15:00:48.594247+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.594247+0000', 'last_undegraded': '2024-03-18T15:00:48.594247+0000', 'last_fullsized': '2024-03-18T15:00:48.594247+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.665 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.593780+0000', 'last_change': '2024-03-18T15:00:48.593780+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.593780+0000', 'last_undegraded': '2024-03-18T15:00:48.593780+0000', 'last_fullsized': '2024-03-18T15:00:48.593780+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.594179+0000', 'last_change': '2024-03-18T15:00:48.594179+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.594179+0000', 'last_undegraded': '2024-03-18T15:00:48.594179+0000', 'last_fullsized': '2024-03-18T15:00:48.594179+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.593049+0000', 'last_change': '2024-03-18T15:00:48.593049+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.593049+0000', 'last_undegraded': '2024-03-18T15:00:48.593049+0000', 'last_fullsized': '2024-03-18T15:00:48.593049+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.593111+0000', 'last_change': '2024-03-18T15:00:48.593111+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.593111+0000', 'last_undegraded': '2024-03-18T15:00:48.593111+0000', 'last_fullsized': '2024-03-18T15:00:48.593111+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2024-03-18T15:00:53.666 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 20, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:00:48.594498+0000', 'last_change': '2024-03-18T15:00:48.594498+0000', 'last_active': '2024-03-18T15:00:48.576868+0000', 'last_peered': '2024-03-18T15:00:48.576868+0000', 'last_clean': '2024-03-18T15:00:48.576868+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:00:48.594498+0000', 'last_undegraded': '2024-03-18T15:00:48.594498+0000', 'last_fullsized': '2024-03-18T15:00:48.594498+0000', 'mapping_epoch': 20, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 20, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'last_clean_scrub_stamp': '2024-03-18T15:00:48.576868+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-03-18T15:00:53.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-18T15:00:53.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.800+0000 7f90b55cd640 1 Processor -- start 2024-03-18T15:00:53.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 -- start start 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f90b00b4720 0x7f90b00d0450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90b00cda00 con 0x7f90b015f9c0 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f90b00c6160 con 0x7f90b00b4720 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90b55cd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00cffc0 con 0x7f90b00d0990 2024-03-18T15:00:53.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90a7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f90b00b4720 0x7f90b00d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90aeffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f90b015f9c0 0x7f90b00c5a50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53156/0 (socket says 172.21.15.152:53156) 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.801+0000 7f90aeffd640 1 -- 172.21.15.152:0/2829206831 learned_addr learned my addr 172.21.15.152:0/2829206831 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90af7fe640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b009aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90a7fff640 1 -- 172.21.15.152:0/2829206831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 msgr2=0x7f90b009aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90a7fff640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b009aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90a7fff640 1 -- 172.21.15.152:0/2829206831 >> v1:172.21.15.152:6789/0 conn(0x7f90b015f9c0 legacy=0x7f90b00c5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90a7fff640 1 -- 172.21.15.152:0/2829206831 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00cdce0 con 0x7f90b00b4720 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90ae7fc640 1 -- 172.21.15.152:0/2829206831 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4222467198 0 0) 0x7f90b00cda00 con 0x7f90b015f9c0 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.802+0000 7f90a7fff640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00d0450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90980097a0 tx=0x7f909802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db44d14599232bc server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90ae7fc640 1 -- 172.21.15.152:0/2829206831 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098035020 con 0x7f90b00b4720 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90ae7fc640 1 -- 172.21.15.152:0/2829206831 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9098031830 con 0x7f90b00b4720 2024-03-18T15:00:53.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90ae7fc640 1 -- 172.21.15.152:0/2829206831 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9098031c00 con 0x7f90b00b4720 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 -- 172.21.15.152:0/2829206831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 msgr2=0x7f90b00d0450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00d0450 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f90980097a0 tx=0x7f909802b8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 -- 172.21.15.152:0/2829206831 shutdown_connections 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 --2- 172.21.15.152:0/2829206831 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00d0450 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 -- 172.21.15.152:0/2829206831 >> 172.21.15.152:0/2829206831 conn(0x7f90b00b39f0 msgr2=0x7f90b00b3e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.803+0000 7f90b55cd640 1 -- 172.21.15.152:0/2829206831 shutdown_connections 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.804+0000 7f90b55cd640 1 -- 172.21.15.152:0/2829206831 wait complete. 2024-03-18T15:00:53.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 Processor -- start 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 -- start start 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b0153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90b015f9c0 0x7f90b00701b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f90b00d0e40 con 0x7f90b00b4720 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f90b015fda0 con 0x7f90b015f9c0 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90b55cd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f90b00cd620 con 0x7f90b00d0990 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90aeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90aeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34188/0 (socket says 172.21.15.152:34188) 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.805+0000 7f90aeffd640 1 -- 172.21.15.152:0/890483430 learned_addr learned my addr 172.21.15.152:0/890483430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:53.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90a7fff640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b0153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90af7fe640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90b015f9c0 0x7f90b00701b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 -- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 msgr2=0x7f90b0153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b0153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 -- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90b015f9c0 msgr2=0x7f90b00701b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90b015f9c0 0x7f90b00701b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 -- 172.21.15.152:0/890483430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b00cc240 con 0x7f90b00b4720 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90a7fff640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90aeffd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c430 tx=0x7f90a000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a00074e0 con 0x7f90b00b4720 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90a00047e0 con 0x7f90b00b4720 2024-03-18T15:00:53.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b006c8b0 con 0x7f90b00b4720 2024-03-18T15:00:53.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a0004bd0 con 0x7f90b00b4720 2024-03-18T15:00:53.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.806+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b006ce70 con 0x7f90b00b4720 2024-03-18T15:00:53.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.807+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b0068220 con 0x7f90b00b4720 2024-03-18T15:00:53.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.808+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f90a0011070 con 0x7f90b00b4720 2024-03-18T15:00:53.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.808+0000 7f90a77fe640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 0x7f909006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:53.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.808+0000 7f90a7fff640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 0x7f909006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:53.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.808+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f90a008a6d0 con 0x7f90b00b4720 2024-03-18T15:00:53.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.809+0000 7f90a7fff640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 0x7f909006e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9098036000 tx=0x7f9098008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:53.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:53.817+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f90a0059250 con 0x7f90b00b4720 2024-03-18T15:00:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.062+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f90b00c87a0 con 0x7f90b00b4720 2024-03-18T15:00:54.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.063+0000 7f90a77fe640 1 -- 172.21.15.152:0/890483430 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1097 (secure 0 0 0) 0x7f90a0058b50 con 0x7f90b00b4720 2024-03-18T15:00:54.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:54.064 INFO:teuthology.orchestra.run.smithi152.stdout:{"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":30,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":22,"num_osds":8,"num_up_osds":8,"osd_up_since":1710774035,"num_in_osds":8,"osd_in_since":1710774026,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":87},{"state_name":"creating+peering","count":10}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592162,"bytes_used":228491264,"bytes_avail":772865622016,"bytes_total":773094113280,"inactive_pgs_ratio":0.10309278219938278,"write_bytes_sec":1454,"read_op_per_sec":0,"write_op_per_sec":8},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"c","status":"up:active","gid":4290}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-03-18T15:00:23.631936+0000","services":{}},"progress_events":{}} 2024-03-18T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 msgr2=0x7f909006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 0x7f909006e090 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9098036000 tx=0x7f9098008030 comp rx=0 tx=0).stop 2024-03-18T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 msgr2=0x7f90b00cbbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c430 tx=0x7f90a000c8f0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 shutdown_connections 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f90b015f9c0 0x7f90b00701b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f909006bbd0 0x7f909006e090 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f90b00d0990 0x7f90b0153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 --2- 172.21.15.152:0/890483430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f90b00b4720 0x7f90b00cbbd0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 >> 172.21.15.152:0/890483430 conn(0x7f90b00b39f0 msgr2=0x7f90b00c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 shutdown_connections 2024-03-18T15:00:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.065+0000 7f90b55cd640 1 -- 172.21.15.152:0/890483430 wait complete. 2024-03-18T15:00:54.076 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-18T15:00:54.076 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:00:54.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.181+0000 7f8441aea640 1 Processor -- start 2024-03-18T15:00:54.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.181+0000 7f8441aea640 1 -- start start 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8441aea640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f843c15c3a0 0x7f843c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8441aea640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843c0cd510 con 0x7f843c15c780 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8441aea640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f843c0cd7f0 con 0x7f843c0cef80 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8441aea640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f843c0cdad0 con 0x7f843c15c3a0 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8432ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f843c15c780 0x7f843c0ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53168/0 (socket says 172.21.15.152:53168) 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f8432ffd640 1 -- 172.21.15.152:0/233634911 learned_addr learned my addr 172.21.15.152:0/233634911 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2838069373 0 0) 0x7f843c0cd510 con 0x7f843c15c780 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8428003520 con 0x7f843c15c780 2024-03-18T15:00:54.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843b7fe640 1 --2- 172.21.15.152:0/233634911 >> v2:172.21.15.186:3300/0 conn(0x7f843c15c3a0 0x7f843c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2795402827 0 0) 0x7f8428003520 con 0x7f843c15c780 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 >> v2:172.21.15.186:3300/0 conn(0x7f843c15c3a0 msgr2=0x7f843c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 --2- 172.21.15.152:0/233634911 >> v2:172.21.15.186:3300/0 conn(0x7f843c15c3a0 0x7f843c0d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 >> v1:172.21.15.186:6789/0 conn(0x7f843c0cef80 legacy=0x7f843c0af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c0cddb0 con 0x7f843c15c780 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.182+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f8424001670 con 0x7f843c15c780 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 >> v1:172.21.15.152:6789/0 conn(0x7f843c15c780 legacy=0x7f843c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f8428003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8428004800 0x7f8428004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280051c0 0x7f842800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f843c0cdad0 con 0x7f8428003a20 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f842800c0f0 con 0x7f8428004800 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f842800c2f0 con 0x7f84280051c0 2024-03-18T15:00:54.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f8428003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f8432ffd640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8428004800 0x7f8428004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843bfff640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280051c0 0x7f842800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 -- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280051c0 msgr2=0x7f842800b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280051c0 0x7f842800b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 -- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8428004800 msgr2=0x7f8428004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8428004800 0x7f8428004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843b7fe640 1 -- 172.21.15.152:0/233634911 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8428003520 con 0x7f8428003a20 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843bfff640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84280051c0 0x7f842800b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.183+0000 7f843bfff640 1 -- 172.21.15.152:0/233634911 reap_dead start 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f843b7fe640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f8428003e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f842c009ac0 tx=0x7f8428005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a360e54c4f5ae0be server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c039070 con 0x7f8428003a20 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c02c6b0 con 0x7f8428003a20 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f843affd640 1 -- 172.21.15.152:0/233634911 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c009690 con 0x7f8428003a20 2024-03-18T15:00:54.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 -- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 msgr2=0x7f8428003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f8428003e40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f842c009ac0 tx=0x7f8428005830 comp rx=0 tx=0).stop 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 -- 172.21.15.152:0/233634911 shutdown_connections 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 --2- 172.21.15.152:0/233634911 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f8428003e40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 -- 172.21.15.152:0/233634911 >> 172.21.15.152:0/233634911 conn(0x7f843c0d1e60 msgr2=0x7f843c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 -- 172.21.15.152:0/233634911 shutdown_connections 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.184+0000 7f8441aea640 1 -- 172.21.15.152:0/233634911 wait complete. 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 Processor -- start 2024-03-18T15:00:54.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 -- start start 2024-03-18T15:00:54.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 0x7f843c154870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f843c1563d0 0x7f843c156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f843c0cf570 con 0x7f8428003a20 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f843c0cf3f0 con 0x7f843c15e860 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.186+0000 7f8441aea640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f843c153d10 con 0x7f843c1563d0 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34194/0 (socket says 172.21.15.152:34194) 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 -- 172.21.15.152:0/3496557347 learned_addr learned my addr 172.21.15.152:0/3496557347 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8432ffd640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 0x7f843c154870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843bfff640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f843c1563d0 0x7f843c156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 -- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f843c1563d0 msgr2=0x7f843c156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f843c1563d0 0x7f843c156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 -- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 msgr2=0x7f843c154870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 0x7f843c154870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 -- 172.21.15.152:0/3496557347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f843c15f870 con 0x7f8428003a20 2024-03-18T15:00:54.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8432ffd640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 0x7f843c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f843b7fe640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f842c000c00 tx=0x7f842c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c042020 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f842c03a040 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f843c15ecf0 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f842c039070 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.187+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f843c15f2b0 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.188+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f843c04f5b0 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.189+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f842c045020 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.189+0000 7f8438ff9640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 0x7f841c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.189+0000 7f8432ffd640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 0x7f841c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.189+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f842c0abdd0 con 0x7f8428003a20 2024-03-18T15:00:54.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.189+0000 7f8432ffd640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 0x7f841c06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8424001cd0 tx=0x7f8424009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:54.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.193+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f842c04c070 con 0x7f8428003a20 2024-03-18T15:00:54.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.362+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f843c156dc0 con 0x7f841c06bbd0 2024-03-18T15:00:54.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.368+0000 7f8438ff9640 1 -- 172.21.15.152:0/3496557347 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251081 (secure 0 0 0) 0x7f843c156dc0 con 0x7f841c06bbd0 2024-03-18T15:00:54.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:54.374 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:00:54.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 msgr2=0x7f841c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 0x7f841c06e090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8424001cd0 tx=0x7f8424009040 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 msgr2=0x7f843c1537d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f842c000c00 tx=0x7f842c004730 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 shutdown_connections 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841c06bbd0 0x7f841c06e090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f843c1563d0 0x7f843c156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f843c15e860 0x7f843c154870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 --2- 172.21.15.152:0/3496557347 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8428003a20 0x7f843c1537d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 >> 172.21.15.152:0/3496557347 conn(0x7f843c0d1e60 msgr2=0x7f843c0c75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 shutdown_connections 2024-03-18T15:00:54.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:54.371+0000 7f8441aea640 1 -- 172.21.15.152:0/3496557347 wait complete. 2024-03-18T15:00:54.383 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-03-18T15:00:53.805359+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592162,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":196,"num_write_kb":2422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":149,"ondisk_log_size":149,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223136,"kb_used_data":2808,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751584,"statfs":{"total":773094113280,"available":772865622016,"internally_reserved":0,"allocated":2875392,"data_stored":1743797,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":39,"apply_latency_ms":39,"commit_latency_ns":39000000,"apply_latency_ns":39000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001162"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608555+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:49.608555+0000","last_peered":"2024-03-18T15:00:49.608555+0000","last_clean":"2024-03-18T15:00:49.608555+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:49.608555+0000","last_undegraded":"2024-03-18T15:00:49.608555+0000","last_fullsized":"2024-03-18T15:00:49.608555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593631+0000","last_change":"2024-03-18T15:00:48.593631+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593631+0000","last_undegraded":"2024-03-18T15:00:48.593631+0000","last_fullsized":"2024-03-18T15:00:48.593631+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613546+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:49.613546+0000","last_peered":"2024-03-18T15:00:49.613546+0000","last_clean":"2024-03-18T15:00:49.613546+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.613546+0000","last_undegraded":"2024-03-18T15:00:49.613546+0000","last_fullsized":"2024-03-18T15:00:49.613546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616312+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:49.616312+0000","last_peered":"2024-03-18T15:00:49.616312+0000","last_clean":"2024-03-18T15:00:49.616312+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:49.616312+0000","last_undegraded":"2024-03-18T15:00:49.616312+0000","last_fullsized":"2024-03-18T15:00:49.616312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615774+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:49.615774+0000","last_peered":"2024-03-18T15:00:49.615774+0000","last_clean":"2024-03-18T15:00:49.615774+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:49.615774+0000","last_undegraded":"2024-03-18T15:00:49.615774+0000","last_fullsized":"2024-03-18T15:00:49.615774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613637+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:49.613637+0000","last_peered":"2024-03-18T15:00:49.613637+0000","last_clean":"2024-03-18T15:00:49.613637+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:49.613637+0000","last_undegraded":"2024-03-18T15:00:49.613637+0000","last_fullsized":"2024-03-18T15:00:49.613637+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618050+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:49.618050+0000","last_peered":"2024-03-18T15:00:49.618050+0000","last_clean":"2024-03-18T15:00:49.618050+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:49.618050+0000","last_undegraded":"2024-03-18T15:00:49.618050+0000","last_fullsized":"2024-03-18T15:00:49.618050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.618150+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:49.618150+0000","last_peered":"2024-03-18T15:00:49.618150+0000","last_clean":"2024-03-18T15:00:49.618150+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:49.618150+0000","last_undegraded":"2024-03-18T15:00:49.618150+0000","last_fullsized":"2024-03-18T15:00:49.618150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616062+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:49.616062+0000","last_peered":"2024-03-18T15:00:49.616062+0000","last_clean":"2024-03-18T15:00:49.616062+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:49.616062+0000","last_undegraded":"2024-03-18T15:00:49.616062+0000","last_fullsized":"2024-03-18T15:00:49.616062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611650+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:49.611650+0000","last_peered":"2024-03-18T15:00:49.611650+0000","last_clean":"2024-03-18T15:00:49.611650+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:49.611650+0000","last_undegraded":"2024-03-18T15:00:49.611650+0000","last_fullsized":"2024-03-18T15:00:49.611650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:30.729724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594920+0000","last_change":"2024-03-18T15:00:48.594920+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594920+0000","last_undegraded":"2024-03-18T15:00:48.594920+0000","last_fullsized":"2024-03-18T15:00:48.594920+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612404+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:49.612404+0000","last_peered":"2024-03-18T15:00:49.612404+0000","last_clean":"2024-03-18T15:00:49.612404+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:49.612404+0000","last_undegraded":"2024-03-18T15:00:49.612404+0000","last_fullsized":"2024-03-18T15:00:49.612404+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:55.684856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613062+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:49.613062+0000","last_peered":"2024-03-18T15:00:49.613062+0000","last_clean":"2024-03-18T15:00:49.613062+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:49.613062+0000","last_undegraded":"2024-03-18T15:00:49.613062+0000","last_fullsized":"2024-03-18T15:00:49.613062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.605350+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:49.605350+0000","last_peered":"2024-03-18T15:00:49.605350+0000","last_clean":"2024-03-18T15:00:49.605350+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:49.605350+0000","last_undegraded":"2024-03-18T15:00:49.605350+0000","last_fullsized":"2024-03-18T15:00:49.605350+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616025+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:49.616025+0000","last_peered":"2024-03-18T15:00:49.616025+0000","last_clean":"2024-03-18T15:00:49.616025+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:49.616025+0000","last_undegraded":"2024-03-18T15:00:49.616025+0000","last_fullsized":"2024-03-18T15:00:49.616025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.596213+0000","last_change":"2024-03-18T15:00:48.596213+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.596213+0000","last_undegraded":"2024-03-18T15:00:48.596213+0000","last_fullsized":"2024-03-18T15:00:48.596213+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614923+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:49.614923+0000","last_peered":"2024-03-18T15:00:49.614923+0000","last_clean":"2024-03-18T15:00:49.614923+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:49.614923+0000","last_undegraded":"2024-03-18T15:00:49.614923+0000","last_fullsized":"2024-03-18T15:00:49.614923+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:54.207821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612383+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:49.612383+0000","last_peered":"2024-03-18T15:00:49.612383+0000","last_clean":"2024-03-18T15:00:49.612383+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:49.612383+0000","last_undegraded":"2024-03-18T15:00:49.612383+0000","last_fullsized":"2024-03-18T15:00:49.612383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:08.211280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.611386+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:49.611386+0000","last_peered":"2024-03-18T15:00:49.611386+0000","last_clean":"2024-03-18T15:00:49.611386+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:49.611386+0000","last_undegraded":"2024-03-18T15:00:49.611386+0000","last_fullsized":"2024-03-18T15:00:49.611386+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:42.048658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.595450+0000","last_change":"2024-03-18T15:00:48.595450+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.595450+0000","last_undegraded":"2024-03-18T15:00:48.595450+0000","last_fullsized":"2024-03-18T15:00:48.595450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616540+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:49.616540+0000","last_peered":"2024-03-18T15:00:49.616540+0000","last_clean":"2024-03-18T15:00:49.616540+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:49.616540+0000","last_undegraded":"2024-03-18T15:00:49.616540+0000","last_fullsized":"2024-03-18T15:00:49.616540+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612427+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:49.612427+0000","last_peered":"2024-03-18T15:00:49.612427+0000","last_clean":"2024-03-18T15:00:49.612427+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:49.612427+0000","last_undegraded":"2024-03-18T15:00:49.612427+0000","last_fullsized":"2024-03-18T15:00:49.612427+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608537+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:49.608537+0000","last_peered":"2024-03-18T15:00:49.608537+0000","last_clean":"2024-03-18T15:00:49.608537+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:49.608537+0000","last_undegraded":"2024-03-18T15:00:49.608537+0000","last_fullsized":"2024-03-18T15:00:49.608537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:16.293687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594247+0000","last_change":"2024-03-18T15:00:48.594247+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594247+0000","last_undegraded":"2024-03-18T15:00:48.594247+0000","last_fullsized":"2024-03-18T15:00:48.594247+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609183+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:49.609183+0000","last_peered":"2024-03-18T15:00:49.609183+0000","last_clean":"2024-03-18T15:00:49.609183+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:49.609183+0000","last_undegraded":"2024-03-18T15:00:49.609183+0000","last_fullsized":"2024-03-18T15:00:49.609183+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592533+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:49.592533+0000","last_peered":"2024-03-18T15:00:49.592533+0000","last_clean":"2024-03-18T15:00:49.592533+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:49.592533+0000","last_undegraded":"2024-03-18T15:00:49.592533+0000","last_fullsized":"2024-03-18T15:00:49.592533+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.597147+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:49.597147+0000","last_peered":"2024-03-18T15:00:49.597147+0000","last_clean":"2024-03-18T15:00:49.597147+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:49.597147+0000","last_undegraded":"2024-03-18T15:00:49.597147+0000","last_fullsized":"2024-03-18T15:00:49.597147+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.612337+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:49.612337+0000","last_peered":"2024-03-18T15:00:49.612337+0000","last_clean":"2024-03-18T15:00:49.612337+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:49.612337+0000","last_undegraded":"2024-03-18T15:00:49.612337+0000","last_fullsized":"2024-03-18T15:00:49.612337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:02.312876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.592512+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:49.592512+0000","last_peered":"2024-03-18T15:00:49.592512+0000","last_clean":"2024-03-18T15:00:49.592512+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:49.592512+0000","last_undegraded":"2024-03-18T15:00:49.592512+0000","last_fullsized":"2024-03-18T15:00:49.592512+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593780+0000","last_change":"2024-03-18T15:00:48.593780+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593780+0000","last_undegraded":"2024-03-18T15:00:48.593780+0000","last_fullsized":"2024-03-18T15:00:48.593780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609061+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:49.609061+0000","last_peered":"2024-03-18T15:00:49.609061+0000","last_clean":"2024-03-18T15:00:49.609061+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:49.609061+0000","last_undegraded":"2024-03-18T15:00:49.609061+0000","last_fullsized":"2024-03-18T15:00:49.609061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:23.516467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":18,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.620698+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:49.620698+0000","last_peered":"2024-03-18T15:00:49.620698+0000","last_clean":"2024-03-18T15:00:49.620698+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:49.620698+0000","last_undegraded":"2024-03-18T15:00:49.620698+0000","last_fullsized":"2024-03-18T15:00:49.620698+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616634+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:49.616634+0000","last_peered":"2024-03-18T15:00:49.616634+0000","last_clean":"2024-03-18T15:00:49.616634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:49.616634+0000","last_undegraded":"2024-03-18T15:00:49.616634+0000","last_fullsized":"2024-03-18T15:00:49.616634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.608884+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:48.608884+0000","last_peered":"2024-03-18T15:00:48.608884+0000","last_clean":"2024-03-18T15:00:48.608884+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:48.608884+0000","last_undegraded":"2024-03-18T15:00:48.608884+0000","last_fullsized":"2024-03-18T15:00:48.608884+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:29:20.141971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594179+0000","last_change":"2024-03-18T15:00:48.594179+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594179+0000","last_undegraded":"2024-03-18T15:00:48.594179+0000","last_fullsized":"2024-03-18T15:00:48.594179+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594704+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:49.594704+0000","last_peered":"2024-03-18T15:00:49.594704+0000","last_clean":"2024-03-18T15:00:49.594704+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:49.594704+0000","last_undegraded":"2024-03-18T15:00:49.594704+0000","last_fullsized":"2024-03-18T15:00:49.594704+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616575+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:49.616575+0000","last_peered":"2024-03-18T15:00:49.616575+0000","last_clean":"2024-03-18T15:00:49.616575+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:49.616575+0000","last_undegraded":"2024-03-18T15:00:49.616575+0000","last_fullsized":"2024-03-18T15:00:49.616575+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.593832+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:49.593832+0000","last_peered":"2024-03-18T15:00:49.593832+0000","last_clean":"2024-03-18T15:00:49.593832+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:49.593832+0000","last_undegraded":"2024-03-18T15:00:49.593832+0000","last_fullsized":"2024-03-18T15:00:49.593832+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.610447+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:49.610447+0000","last_peered":"2024-03-18T15:00:49.610447+0000","last_clean":"2024-03-18T15:00:49.610447+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:49.610447+0000","last_undegraded":"2024-03-18T15:00:49.610447+0000","last_fullsized":"2024-03-18T15:00:49.610447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616394+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:49.616394+0000","last_peered":"2024-03-18T15:00:49.616394+0000","last_clean":"2024-03-18T15:00:49.616394+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:49.616394+0000","last_undegraded":"2024-03-18T15:00:49.616394+0000","last_fullsized":"2024-03-18T15:00:49.616394+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":13,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608268+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:49.608268+0000","last_peered":"2024-03-18T15:00:49.608268+0000","last_clean":"2024-03-18T15:00:49.608268+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:49.608268+0000","last_undegraded":"2024-03-18T15:00:49.608268+0000","last_fullsized":"2024-03-18T15:00:49.608268+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616415+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:49.616415+0000","last_peered":"2024-03-18T15:00:49.616415+0000","last_clean":"2024-03-18T15:00:49.616415+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:49.616415+0000","last_undegraded":"2024-03-18T15:00:49.616415+0000","last_fullsized":"2024-03-18T15:00:49.616415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616367+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:49.616367+0000","last_peered":"2024-03-18T15:00:49.616367+0000","last_clean":"2024-03-18T15:00:49.616367+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:49.616367+0000","last_undegraded":"2024-03-18T15:00:49.616367+0000","last_fullsized":"2024-03-18T15:00:49.616367+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614883+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:49.614883+0000","last_peered":"2024-03-18T15:00:49.614883+0000","last_clean":"2024-03-18T15:00:49.614883+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:49.614883+0000","last_undegraded":"2024-03-18T15:00:49.614883+0000","last_fullsized":"2024-03-18T15:00:49.614883+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616611+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:49.616611+0000","last_peered":"2024-03-18T15:00:49.616611+0000","last_clean":"2024-03-18T15:00:49.616611+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:49.616611+0000","last_undegraded":"2024-03-18T15:00:49.616611+0000","last_fullsized":"2024-03-18T15:00:49.616611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":168,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590521+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:49.590521+0000","last_peered":"2024-03-18T15:00:49.590521+0000","last_clean":"2024-03-18T15:00:49.590521+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:49.590521+0000","last_undegraded":"2024-03-18T15:00:49.590521+0000","last_fullsized":"2024-03-18T15:00:49.590521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.589875+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:49.589875+0000","last_peered":"2024-03-18T15:00:49.589875+0000","last_clean":"2024-03-18T15:00:49.589875+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:49.589875+0000","last_undegraded":"2024-03-18T15:00:49.589875+0000","last_fullsized":"2024-03-18T15:00:49.589875+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588220+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:49.588220+0000","last_peered":"2024-03-18T15:00:49.588220+0000","last_clean":"2024-03-18T15:00:49.588220+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:49.588220+0000","last_undegraded":"2024-03-18T15:00:49.588220+0000","last_fullsized":"2024-03-18T15:00:49.588220+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593049+0000","last_change":"2024-03-18T15:00:48.593049+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593049+0000","last_undegraded":"2024-03-18T15:00:48.593049+0000","last_fullsized":"2024-03-18T15:00:48.593049+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.594873+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:49.594873+0000","last_peered":"2024-03-18T15:00:49.594873+0000","last_clean":"2024-03-18T15:00:49.594873+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:49.594873+0000","last_undegraded":"2024-03-18T15:00:49.594873+0000","last_fullsized":"2024-03-18T15:00:49.594873+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608607+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:49.608607+0000","last_peered":"2024-03-18T15:00:49.608607+0000","last_clean":"2024-03-18T15:00:49.608607+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:49.608607+0000","last_undegraded":"2024-03-18T15:00:49.608607+0000","last_fullsized":"2024-03-18T15:00:49.608607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:03.350410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614800+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:49.614800+0000","last_peered":"2024-03-18T15:00:49.614800+0000","last_clean":"2024-03-18T15:00:49.614800+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:49.614800+0000","last_undegraded":"2024-03-18T15:00:49.614800+0000","last_fullsized":"2024-03-18T15:00:49.614800+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.590156+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:49.590156+0000","last_peered":"2024-03-18T15:00:49.590156+0000","last_clean":"2024-03-18T15:00:49.590156+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:49.590156+0000","last_undegraded":"2024-03-18T15:00:49.590156+0000","last_fullsized":"2024-03-18T15:00:49.590156+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621300+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.621300+0000","last_peered":"2024-03-18T15:00:50.621300+0000","last_clean":"2024-03-18T15:00:50.621300+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.621300+0000","last_undegraded":"2024-03-18T15:00:50.621300+0000","last_fullsized":"2024-03-18T15:00:50.621300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.609666+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:49.609666+0000","last_peered":"2024-03-18T15:00:49.609666+0000","last_clean":"2024-03-18T15:00:49.609666+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:49.609666+0000","last_undegraded":"2024-03-18T15:00:49.609666+0000","last_fullsized":"2024-03-18T15:00:49.609666+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.593111+0000","last_change":"2024-03-18T15:00:48.593111+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.593111+0000","last_undegraded":"2024-03-18T15:00:48.593111+0000","last_fullsized":"2024-03-18T15:00:48.593111+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":12,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.588061+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:49.588061+0000","last_peered":"2024-03-18T15:00:49.588061+0000","last_clean":"2024-03-18T15:00:49.588061+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:49.588061+0000","last_undegraded":"2024-03-18T15:00:49.588061+0000","last_fullsized":"2024-03-18T15:00:49.588061+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.608459+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:49.608459+0000","last_peered":"2024-03-18T15:00:49.608459+0000","last_clean":"2024-03-18T15:00:49.608459+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:49.608459+0000","last_undegraded":"2024-03-18T15:00:49.608459+0000","last_fullsized":"2024-03-18T15:00:49.608459+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:50.089898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.616192+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:49.616192+0000","last_peered":"2024-03-18T15:00:49.616192+0000","last_clean":"2024-03-18T15:00:49.616192+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:49.616192+0000","last_undegraded":"2024-03-18T15:00:49.616192+0000","last_fullsized":"2024-03-18T15:00:49.616192+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614175+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:49.614175+0000","last_peered":"2024-03-18T15:00:49.614175+0000","last_clean":"2024-03-18T15:00:49.614175+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:49.614175+0000","last_undegraded":"2024-03-18T15:00:49.614175+0000","last_fullsized":"2024-03-18T15:00:49.614175+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.614780+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:49.614780+0000","last_peered":"2024-03-18T15:00:49.614780+0000","last_clean":"2024-03-18T15:00:49.614780+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:49.614780+0000","last_undegraded":"2024-03-18T15:00:49.614780+0000","last_fullsized":"2024-03-18T15:00:49.614780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.615568+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:49.615568+0000","last_peered":"2024-03-18T15:00:49.615568+0000","last_clean":"2024-03-18T15:00:49.615568+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:49.615568+0000","last_undegraded":"2024-03-18T15:00:49.615568+0000","last_fullsized":"2024-03-18T15:00:49.615568+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613525+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:49.613525+0000","last_peered":"2024-03-18T15:00:49.613525+0000","last_clean":"2024-03-18T15:00:49.613525+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:49.613525+0000","last_undegraded":"2024-03-18T15:00:49.613525+0000","last_fullsized":"2024-03-18T15:00:49.613525+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:52:41.398821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":14,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-03-18T15:00:49.613781+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:49.613781+0000","last_peered":"2024-03-18T15:00:49.613781+0000","last_clean":"2024-03-18T15:00:49.613781+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:49.613781+0000","last_undegraded":"2024-03-18T15:00:49.613781+0000","last_fullsized":"2024-03-18T15:00:49.613781+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":1,"reported_epoch":20,"state":"creating+peering","last_fresh":"2024-03-18T15:00:48.594498+0000","last_change":"2024-03-18T15:00:48.594498+0000","last_active":"2024-03-18T15:00:48.576868+0000","last_peered":"2024-03-18T15:00:48.576868+0000","last_clean":"2024-03-18T15:00:48.576868+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:00:48.594498+0000","last_undegraded":"2024-03-18T15:00:48.594498+0000","last_fullsized":"2024-03-18T15:00:48.594498+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":9,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-03-18T15:00:48.611737+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:48.611737+0000","last_peered":"2024-03-18T15:00:48.611737+0000","last_clean":"2024-03-18T15:00:48.611737+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:48.611737+0000","last_undegraded":"2024-03-18T15:00:48.611737+0000","last_fullsized":"2024-03-18T15:00:48.611737+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":1794,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":37,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":4182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":32,"ondisk_log_size":32,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542150,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27808,"kb_used_data":788,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344032,"statfs":{"total":96636764160,"available":96608288768,"internally_reserved":0,"allocated":806912,"data_stored":662702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542149,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27212,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344628,"statfs":{"total":96636764160,"available":96608899072,"internally_reserved":0,"allocated":196608,"data_stored":64977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542148,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27228,"kb_used_data":208,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344612,"statfs":{"total":96636764160,"available":96608882688,"internally_reserved":0,"allocated":212992,"data_stored":71842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542149,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":71878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31940,"kb_used_data":760,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339900,"statfs":{"total":96636764160,"available":96604057600,"internally_reserved":0,"allocated":778240,"data_stored":649070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:00:57.388 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:00:57.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.489+0000 7ff97ec19640 1 Processor -- start 2024-03-18T15:00:57.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.489+0000 7ff97ec19640 1 -- start start 2024-03-18T15:00:57.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97ec19640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9781622b0 0x7ff9780d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97ec19640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff97815ea90 0x7ff97815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97ec19640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9780b3440 con 0x7ff978162690 2024-03-18T15:00:57.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97ec19640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff9780d16c0 con 0x7ff9781622b0 2024-03-18T15:00:57.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97ec19640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff9780d2660 con 0x7ff97815ea90 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97c9b5640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff9781622b0 0x7ff9780d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff96ffff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff978162690 0x7ff978162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53178/0 (socket says 172.21.15.152:53178) 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff96ffff640 1 -- 172.21.15.152:0/2027974972 learned_addr learned my addr 172.21.15.152:0/2027974972 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97d1b6640 1 --2- 172.21.15.152:0/2027974972 >> v2:172.21.15.186:3300/0 conn(0x7ff97815ea90 0x7ff97815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97c9b5640 1 -- 172.21.15.152:0/2027974972 >> v2:172.21.15.186:3300/0 conn(0x7ff97815ea90 msgr2=0x7ff97815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97c9b5640 1 --2- 172.21.15.152:0/2027974972 >> v2:172.21.15.186:3300/0 conn(0x7ff97815ea90 0x7ff97815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97c9b5640 1 -- 172.21.15.152:0/2027974972 >> v1:172.21.15.152:6789/0 conn(0x7ff978162690 legacy=0x7ff978162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.490+0000 7ff97c9b5640 1 -- 172.21.15.152:0/2027974972 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780d20a0 con 0x7ff9781622b0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff97c9b5640 1 --2- 172.21.15.152:0/2027974972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9781622b0 0x7ff9780d10d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac479f4f733c7963 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff96f7fe640 1 -- 172.21.15.152:0/2027974972 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974038070 con 0x7ff9781622b0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff96f7fe640 1 -- 172.21.15.152:0/2027974972 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff974031700 con 0x7ff9781622b0 2024-03-18T15:00:57.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff96f7fe640 1 -- 172.21.15.152:0/2027974972 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974031ad0 con 0x7ff9781622b0 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff97ec19640 1 -- 172.21.15.152:0/2027974972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9781622b0 msgr2=0x7ff9780d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.491+0000 7ff97ec19640 1 --2- 172.21.15.152:0/2027974972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9781622b0 0x7ff9780d10d0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7ff9740097a0 tx=0x7ff97402b7a0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 -- 172.21.15.152:0/2027974972 shutdown_connections 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 --2- 172.21.15.152:0/2027974972 >> v2:172.21.15.186:3300/0 conn(0x7ff97815ea90 0x7ff97815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 --2- 172.21.15.152:0/2027974972 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff9781622b0 0x7ff9780d10d0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 -- 172.21.15.152:0/2027974972 >> 172.21.15.152:0/2027974972 conn(0x7ff9780d4070 msgr2=0x7ff9780d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 -- 172.21.15.152:0/2027974972 shutdown_connections 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.492+0000 7ff97ec19640 1 -- 172.21.15.152:0/2027974972 wait complete. 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.493+0000 7ff97ec19640 1 Processor -- start 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.493+0000 7ff97ec19640 1 -- start start 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 0x7ff9781e7fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff978162690 0x7ff978154db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780cfc90 con 0x7ff97815ea90 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff9780d2ab0 con 0x7ff9781622b0 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff9780cfe10 con 0x7ff978162690 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34212/0 (socket says 172.21.15.152:34212) 2024-03-18T15:00:57.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 -- 172.21.15.152:0/1262487506 learned_addr learned my addr 172.21.15.152:0/1262487506 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97d1b6640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff978162690 0x7ff978154db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff96ffff640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 0x7ff9781e7fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 -- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff978162690 msgr2=0x7ff978154db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff978162690 0x7ff978154db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 -- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 msgr2=0x7ff9781e7fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 0x7ff9781e7fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 -- 172.21.15.152:0/1262487506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9780b4aa0 con 0x7ff97815ea90 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff96ffff640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 0x7ff9781e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97c9b5640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff974036040 tx=0x7ff9740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974042070 con 0x7ff97815ea90 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9740339b0 con 0x7ff97815ea90 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff974038040 con 0x7ff97815ea90 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9780b4d80 con 0x7ff97815ea90 2024-03-18T15:00:57.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.494+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9780b5340 con 0x7ff97815ea90 2024-03-18T15:00:57.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.496+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff97403b070 con 0x7ff97815ea90 2024-03-18T15:00:57.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.496+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff97804f5b0 con 0x7ff97815ea90 2024-03-18T15:00:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.496+0000 7ff96d7fa640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 0x7ff96406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.496+0000 7ff96ffff640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 0x7ff96406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.496+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff9740ac280 con 0x7ff97815ea90 2024-03-18T15:00:57.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.497+0000 7ff96ffff640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 0x7ff96406e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9780ce540 tx=0x7ff968009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.500+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff974030070 con 0x7ff97815ea90 2024-03-18T15:00:57.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.790+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff978068710 con 0x7ff96406bbd0 2024-03-18T15:00:57.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.795+0000 7ff96d7fa640 1 -- 172.21.15.152:0/1262487506 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251923 (secure 0 0 0) 0x7ff968001c50 con 0x7ff96406bbd0 2024-03-18T15:00:57.798 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:57.800 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:00:57.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 msgr2=0x7ff96406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 0x7ff96406e090 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7ff9780ce540 tx=0x7ff968009040 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 msgr2=0x7ff9780cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7ff974036040 tx=0x7ff9740046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 shutdown_connections 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff96406bbd0 0x7ff96406e090 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff978162690 0x7ff978154db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff9781622b0 0x7ff9781e7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.798+0000 7ff97ec19640 1 --2- 172.21.15.152:0/1262487506 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff97815ea90 0x7ff9780cbb50 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.799+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 >> 172.21.15.152:0/1262487506 conn(0x7ff9780d4070 msgr2=0x7ff9781592e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.799+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 shutdown_connections 2024-03-18T15:00:57.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.799+0000 7ff97ec19640 1 -- 172.21.15.152:0/1262487506 wait complete. 2024-03-18T15:00:57.810 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":26,"stamp":"2024-03-18T15:00:55.805748+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223280,"kb_used_data":2928,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751440,"statfs":{"total":773094113280,"available":772865474560,"internally_reserved":0,"allocated":2998272,"data_stored":1797372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.219697"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620901+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:50.620901+0000","last_peered":"2024-03-18T15:00:50.620901+0000","last_clean":"2024-03-18T15:00:50.620901+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:50.620901+0000","last_undegraded":"2024-03-18T15:00:50.620901+0000","last_fullsized":"2024-03-18T15:00:50.620901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620369+0000","last_change":"2024-03-18T15:00:49.603216+0000","last_active":"2024-03-18T15:00:50.620369+0000","last_peered":"2024-03-18T15:00:50.620369+0000","last_clean":"2024-03-18T15:00:50.620369+0000","last_became_active":"2024-03-18T15:00:49.602932+0000","last_became_peered":"2024-03-18T15:00:49.602932+0000","last_unstale":"2024-03-18T15:00:50.620369+0000","last_undegraded":"2024-03-18T15:00:50.620369+0000","last_fullsized":"2024-03-18T15:00:50.620369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604634+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:50.604634+0000","last_peered":"2024-03-18T15:00:50.604634+0000","last_clean":"2024-03-18T15:00:50.604634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.604634+0000","last_undegraded":"2024-03-18T15:00:50.604634+0000","last_fullsized":"2024-03-18T15:00:50.604634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620537+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:50.620537+0000","last_peered":"2024-03-18T15:00:50.620537+0000","last_clean":"2024-03-18T15:00:50.620537+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:50.620537+0000","last_undegraded":"2024-03-18T15:00:50.620537+0000","last_fullsized":"2024-03-18T15:00:50.620537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604133+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:50.604133+0000","last_peered":"2024-03-18T15:00:50.604133+0000","last_clean":"2024-03-18T15:00:50.604133+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:50.604133+0000","last_undegraded":"2024-03-18T15:00:50.604133+0000","last_fullsized":"2024-03-18T15:00:50.604133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620249+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:50.620249+0000","last_peered":"2024-03-18T15:00:50.620249+0000","last_clean":"2024-03-18T15:00:50.620249+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:50.620249+0000","last_undegraded":"2024-03-18T15:00:50.620249+0000","last_fullsized":"2024-03-18T15:00:50.620249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620908+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:50.620908+0000","last_peered":"2024-03-18T15:00:50.620908+0000","last_clean":"2024-03-18T15:00:50.620908+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:50.620908+0000","last_undegraded":"2024-03-18T15:00:50.620908+0000","last_fullsized":"2024-03-18T15:00:50.620908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620515+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:50.620515+0000","last_peered":"2024-03-18T15:00:50.620515+0000","last_clean":"2024-03-18T15:00:50.620515+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:50.620515+0000","last_undegraded":"2024-03-18T15:00:50.620515+0000","last_fullsized":"2024-03-18T15:00:50.620515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:36:52.555465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620200+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:50.620200+0000","last_peered":"2024-03-18T15:00:50.620200+0000","last_clean":"2024-03-18T15:00:50.620200+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:50.620200+0000","last_undegraded":"2024-03-18T15:00:50.620200+0000","last_fullsized":"2024-03-18T15:00:50.620200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603266+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:50.603266+0000","last_peered":"2024-03-18T15:00:50.603266+0000","last_clean":"2024-03-18T15:00:50.603266+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:50.603266+0000","last_undegraded":"2024-03-18T15:00:50.603266+0000","last_fullsized":"2024-03-18T15:00:50.603266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:23.089072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620271+0000","last_change":"2024-03-18T15:00:49.604557+0000","last_active":"2024-03-18T15:00:50.620271+0000","last_peered":"2024-03-18T15:00:50.620271+0000","last_clean":"2024-03-18T15:00:50.620271+0000","last_became_active":"2024-03-18T15:00:49.604266+0000","last_became_peered":"2024-03-18T15:00:49.604266+0000","last_unstale":"2024-03-18T15:00:50.620271+0000","last_undegraded":"2024-03-18T15:00:50.620271+0000","last_fullsized":"2024-03-18T15:00:50.620271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603310+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:50.603310+0000","last_peered":"2024-03-18T15:00:50.603310+0000","last_clean":"2024-03-18T15:00:50.603310+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:50.603310+0000","last_undegraded":"2024-03-18T15:00:50.603310+0000","last_fullsized":"2024-03-18T15:00:50.603310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604025+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:50.604025+0000","last_peered":"2024-03-18T15:00:50.604025+0000","last_clean":"2024-03-18T15:00:50.604025+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:50.604025+0000","last_undegraded":"2024-03-18T15:00:50.604025+0000","last_fullsized":"2024-03-18T15:00:50.604025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621040+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:50.621040+0000","last_peered":"2024-03-18T15:00:50.621040+0000","last_clean":"2024-03-18T15:00:50.621040+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:50.621040+0000","last_undegraded":"2024-03-18T15:00:50.621040+0000","last_fullsized":"2024-03-18T15:00:50.621040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:26:34.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620412+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:50.620412+0000","last_peered":"2024-03-18T15:00:50.620412+0000","last_clean":"2024-03-18T15:00:50.620412+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:50.620412+0000","last_undegraded":"2024-03-18T15:00:50.620412+0000","last_fullsized":"2024-03-18T15:00:50.620412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620636+0000","last_change":"2024-03-18T15:00:49.607455+0000","last_active":"2024-03-18T15:00:50.620636+0000","last_peered":"2024-03-18T15:00:50.620636+0000","last_clean":"2024-03-18T15:00:50.620636+0000","last_became_active":"2024-03-18T15:00:49.607104+0000","last_became_peered":"2024-03-18T15:00:49.607104+0000","last_unstale":"2024-03-18T15:00:50.620636+0000","last_undegraded":"2024-03-18T15:00:50.620636+0000","last_fullsized":"2024-03-18T15:00:50.620636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604248+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:50.604248+0000","last_peered":"2024-03-18T15:00:50.604248+0000","last_clean":"2024-03-18T15:00:50.604248+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:50.604248+0000","last_undegraded":"2024-03-18T15:00:50.604248+0000","last_fullsized":"2024-03-18T15:00:50.604248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603478+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:50.603478+0000","last_peered":"2024-03-18T15:00:50.603478+0000","last_clean":"2024-03-18T15:00:50.603478+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:50.603478+0000","last_undegraded":"2024-03-18T15:00:50.603478+0000","last_fullsized":"2024-03-18T15:00:50.603478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620664+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:50.620664+0000","last_peered":"2024-03-18T15:00:50.620664+0000","last_clean":"2024-03-18T15:00:50.620664+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:50.620664+0000","last_undegraded":"2024-03-18T15:00:50.620664+0000","last_fullsized":"2024-03-18T15:00:50.620664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:49:37.471400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620766+0000","last_change":"2024-03-18T15:00:49.612185+0000","last_active":"2024-03-18T15:00:50.620766+0000","last_peered":"2024-03-18T15:00:50.620766+0000","last_clean":"2024-03-18T15:00:50.620766+0000","last_became_active":"2024-03-18T15:00:49.611939+0000","last_became_peered":"2024-03-18T15:00:49.611939+0000","last_unstale":"2024-03-18T15:00:50.620766+0000","last_undegraded":"2024-03-18T15:00:50.620766+0000","last_fullsized":"2024-03-18T15:00:50.620766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604331+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:50.604331+0000","last_peered":"2024-03-18T15:00:50.604331+0000","last_clean":"2024-03-18T15:00:50.604331+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:50.604331+0000","last_undegraded":"2024-03-18T15:00:50.604331+0000","last_fullsized":"2024-03-18T15:00:50.604331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620097+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:50.620097+0000","last_peered":"2024-03-18T15:00:50.620097+0000","last_clean":"2024-03-18T15:00:50.620097+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:50.620097+0000","last_undegraded":"2024-03-18T15:00:50.620097+0000","last_fullsized":"2024-03-18T15:00:50.620097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604324+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:50.604324+0000","last_peered":"2024-03-18T15:00:50.604324+0000","last_clean":"2024-03-18T15:00:50.604324+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:50.604324+0000","last_undegraded":"2024-03-18T15:00:50.604324+0000","last_fullsized":"2024-03-18T15:00:50.604324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620882+0000","last_change":"2024-03-18T15:00:49.608853+0000","last_active":"2024-03-18T15:00:50.620882+0000","last_peered":"2024-03-18T15:00:50.620882+0000","last_clean":"2024-03-18T15:00:50.620882+0000","last_became_active":"2024-03-18T15:00:49.608585+0000","last_became_peered":"2024-03-18T15:00:49.608585+0000","last_unstale":"2024-03-18T15:00:50.620882+0000","last_undegraded":"2024-03-18T15:00:50.620882+0000","last_fullsized":"2024-03-18T15:00:50.620882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620169+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:50.620169+0000","last_peered":"2024-03-18T15:00:50.620169+0000","last_clean":"2024-03-18T15:00:50.620169+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:50.620169+0000","last_undegraded":"2024-03-18T15:00:50.620169+0000","last_fullsized":"2024-03-18T15:00:50.620169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603605+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:50.603605+0000","last_peered":"2024-03-18T15:00:50.603605+0000","last_clean":"2024-03-18T15:00:50.603605+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:50.603605+0000","last_undegraded":"2024-03-18T15:00:50.603605+0000","last_fullsized":"2024-03-18T15:00:50.603605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620256+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:50.620256+0000","last_peered":"2024-03-18T15:00:50.620256+0000","last_clean":"2024-03-18T15:00:50.620256+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:50.620256+0000","last_undegraded":"2024-03-18T15:00:50.620256+0000","last_fullsized":"2024-03-18T15:00:50.620256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603929+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:50.603929+0000","last_peered":"2024-03-18T15:00:50.603929+0000","last_clean":"2024-03-18T15:00:50.603929+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:50.603929+0000","last_undegraded":"2024-03-18T15:00:50.603929+0000","last_fullsized":"2024-03-18T15:00:50.603929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604039+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:50.604039+0000","last_peered":"2024-03-18T15:00:50.604039+0000","last_clean":"2024-03-18T15:00:50.604039+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:50.604039+0000","last_undegraded":"2024-03-18T15:00:50.604039+0000","last_fullsized":"2024-03-18T15:00:50.604039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621239+0000","last_change":"2024-03-18T15:00:49.616126+0000","last_active":"2024-03-18T15:00:50.621239+0000","last_peered":"2024-03-18T15:00:50.621239+0000","last_clean":"2024-03-18T15:00:50.621239+0000","last_became_active":"2024-03-18T15:00:49.615785+0000","last_became_peered":"2024-03-18T15:00:49.615785+0000","last_unstale":"2024-03-18T15:00:50.621239+0000","last_undegraded":"2024-03-18T15:00:50.621239+0000","last_fullsized":"2024-03-18T15:00:50.621239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603418+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:50.603418+0000","last_peered":"2024-03-18T15:00:50.603418+0000","last_clean":"2024-03-18T15:00:50.603418+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:50.603418+0000","last_undegraded":"2024-03-18T15:00:50.603418+0000","last_fullsized":"2024-03-18T15:00:50.603418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:08.152207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620519+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:50.620519+0000","last_peered":"2024-03-18T15:00:50.620519+0000","last_clean":"2024-03-18T15:00:50.620519+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:50.620519+0000","last_undegraded":"2024-03-18T15:00:50.620519+0000","last_fullsized":"2024-03-18T15:00:50.620519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620754+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:50.620754+0000","last_peered":"2024-03-18T15:00:50.620754+0000","last_clean":"2024-03-18T15:00:50.620754+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.620754+0000","last_undegraded":"2024-03-18T15:00:50.620754+0000","last_fullsized":"2024-03-18T15:00:50.620754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620957+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:50.620957+0000","last_peered":"2024-03-18T15:00:50.620957+0000","last_clean":"2024-03-18T15:00:50.620957+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:50.620957+0000","last_undegraded":"2024-03-18T15:00:50.620957+0000","last_fullsized":"2024-03-18T15:00:50.620957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:49.079685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620377+0000","last_change":"2024-03-18T15:00:49.607347+0000","last_active":"2024-03-18T15:00:50.620377+0000","last_peered":"2024-03-18T15:00:50.620377+0000","last_clean":"2024-03-18T15:00:50.620377+0000","last_became_active":"2024-03-18T15:00:49.607022+0000","last_became_peered":"2024-03-18T15:00:49.607022+0000","last_unstale":"2024-03-18T15:00:50.620377+0000","last_undegraded":"2024-03-18T15:00:50.620377+0000","last_fullsized":"2024-03-18T15:00:50.620377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604347+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:50.604347+0000","last_peered":"2024-03-18T15:00:50.604347+0000","last_clean":"2024-03-18T15:00:50.604347+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:50.604347+0000","last_undegraded":"2024-03-18T15:00:50.604347+0000","last_fullsized":"2024-03-18T15:00:50.604347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620710+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:50.620710+0000","last_peered":"2024-03-18T15:00:50.620710+0000","last_clean":"2024-03-18T15:00:50.620710+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:50.620710+0000","last_undegraded":"2024-03-18T15:00:50.620710+0000","last_fullsized":"2024-03-18T15:00:50.620710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620037+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:50.620037+0000","last_peered":"2024-03-18T15:00:50.620037+0000","last_clean":"2024-03-18T15:00:50.620037+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:50.620037+0000","last_undegraded":"2024-03-18T15:00:50.620037+0000","last_fullsized":"2024-03-18T15:00:50.620037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620388+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:50.620388+0000","last_peered":"2024-03-18T15:00:50.620388+0000","last_clean":"2024-03-18T15:00:50.620388+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:50.620388+0000","last_undegraded":"2024-03-18T15:00:50.620388+0000","last_fullsized":"2024-03-18T15:00:50.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620495+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:50.620495+0000","last_peered":"2024-03-18T15:00:50.620495+0000","last_clean":"2024-03-18T15:00:50.620495+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:50.620495+0000","last_undegraded":"2024-03-18T15:00:50.620495+0000","last_fullsized":"2024-03-18T15:00:50.620495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603700+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:50.603700+0000","last_peered":"2024-03-18T15:00:50.603700+0000","last_clean":"2024-03-18T15:00:50.603700+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:50.603700+0000","last_undegraded":"2024-03-18T15:00:50.603700+0000","last_fullsized":"2024-03-18T15:00:50.603700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620614+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:50.620614+0000","last_peered":"2024-03-18T15:00:50.620614+0000","last_clean":"2024-03-18T15:00:50.620614+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:50.620614+0000","last_undegraded":"2024-03-18T15:00:50.620614+0000","last_fullsized":"2024-03-18T15:00:50.620614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621073+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:50.621073+0000","last_peered":"2024-03-18T15:00:50.621073+0000","last_clean":"2024-03-18T15:00:50.621073+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:50.621073+0000","last_undegraded":"2024-03-18T15:00:50.621073+0000","last_fullsized":"2024-03-18T15:00:50.621073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:02.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604738+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:50.604738+0000","last_peered":"2024-03-18T15:00:50.604738+0000","last_clean":"2024-03-18T15:00:50.604738+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:50.604738+0000","last_undegraded":"2024-03-18T15:00:50.604738+0000","last_fullsized":"2024-03-18T15:00:50.604738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620895+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:50.620895+0000","last_peered":"2024-03-18T15:00:50.620895+0000","last_clean":"2024-03-18T15:00:50.620895+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:50.620895+0000","last_undegraded":"2024-03-18T15:00:50.620895+0000","last_fullsized":"2024-03-18T15:00:50.620895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620601+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:50.620601+0000","last_peered":"2024-03-18T15:00:50.620601+0000","last_clean":"2024-03-18T15:00:50.620601+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:50.620601+0000","last_undegraded":"2024-03-18T15:00:50.620601+0000","last_fullsized":"2024-03-18T15:00:50.620601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603786+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:50.603786+0000","last_peered":"2024-03-18T15:00:50.603786+0000","last_clean":"2024-03-18T15:00:50.603786+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:50.603786+0000","last_undegraded":"2024-03-18T15:00:50.603786+0000","last_fullsized":"2024-03-18T15:00:50.603786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619985+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:50.619985+0000","last_peered":"2024-03-18T15:00:50.619985+0000","last_clean":"2024-03-18T15:00:50.619985+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:50.619985+0000","last_undegraded":"2024-03-18T15:00:50.619985+0000","last_fullsized":"2024-03-18T15:00:50.619985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620140+0000","last_change":"2024-03-18T15:00:49.610465+0000","last_active":"2024-03-18T15:00:50.620140+0000","last_peered":"2024-03-18T15:00:50.620140+0000","last_clean":"2024-03-18T15:00:50.620140+0000","last_became_active":"2024-03-18T15:00:49.610044+0000","last_became_peered":"2024-03-18T15:00:49.610044+0000","last_unstale":"2024-03-18T15:00:50.620140+0000","last_undegraded":"2024-03-18T15:00:50.620140+0000","last_fullsized":"2024-03-18T15:00:50.620140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604433+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:50.604433+0000","last_peered":"2024-03-18T15:00:50.604433+0000","last_clean":"2024-03-18T15:00:50.604433+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:50.604433+0000","last_undegraded":"2024-03-18T15:00:50.604433+0000","last_fullsized":"2024-03-18T15:00:50.604433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604572+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:50.604572+0000","last_peered":"2024-03-18T15:00:50.604572+0000","last_clean":"2024-03-18T15:00:50.604572+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:50.604572+0000","last_undegraded":"2024-03-18T15:00:50.604572+0000","last_fullsized":"2024-03-18T15:00:50.604572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603787+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:50.603787+0000","last_peered":"2024-03-18T15:00:50.603787+0000","last_clean":"2024-03-18T15:00:50.603787+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:50.603787+0000","last_undegraded":"2024-03-18T15:00:50.603787+0000","last_fullsized":"2024-03-18T15:00:50.603787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621006+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:50.621006+0000","last_peered":"2024-03-18T15:00:50.621006+0000","last_clean":"2024-03-18T15:00:50.621006+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:50.621006+0000","last_undegraded":"2024-03-18T15:00:50.621006+0000","last_fullsized":"2024-03-18T15:00:50.621006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621300+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.621300+0000","last_peered":"2024-03-18T15:00:50.621300+0000","last_clean":"2024-03-18T15:00:50.621300+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.621300+0000","last_undegraded":"2024-03-18T15:00:50.621300+0000","last_fullsized":"2024-03-18T15:00:50.621300+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620360+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:50.620360+0000","last_peered":"2024-03-18T15:00:50.620360+0000","last_clean":"2024-03-18T15:00:50.620360+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:50.620360+0000","last_undegraded":"2024-03-18T15:00:50.620360+0000","last_fullsized":"2024-03-18T15:00:50.620360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620538+0000","last_change":"2024-03-18T15:00:49.604968+0000","last_active":"2024-03-18T15:00:50.620538+0000","last_peered":"2024-03-18T15:00:50.620538+0000","last_clean":"2024-03-18T15:00:50.620538+0000","last_became_active":"2024-03-18T15:00:49.604691+0000","last_became_peered":"2024-03-18T15:00:49.604691+0000","last_unstale":"2024-03-18T15:00:50.620538+0000","last_undegraded":"2024-03-18T15:00:50.620538+0000","last_fullsized":"2024-03-18T15:00:50.620538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.049398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619995+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:50.619995+0000","last_peered":"2024-03-18T15:00:50.619995+0000","last_clean":"2024-03-18T15:00:50.619995+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:50.619995+0000","last_undegraded":"2024-03-18T15:00:50.619995+0000","last_fullsized":"2024-03-18T15:00:50.619995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603241+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:50.603241+0000","last_peered":"2024-03-18T15:00:50.603241+0000","last_clean":"2024-03-18T15:00:50.603241+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:50.603241+0000","last_undegraded":"2024-03-18T15:00:50.603241+0000","last_fullsized":"2024-03-18T15:00:50.603241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:19.757700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620674+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:50.620674+0000","last_peered":"2024-03-18T15:00:50.620674+0000","last_clean":"2024-03-18T15:00:50.620674+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:50.620674+0000","last_undegraded":"2024-03-18T15:00:50.620674+0000","last_fullsized":"2024-03-18T15:00:50.620674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620069+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:50.620069+0000","last_peered":"2024-03-18T15:00:50.620069+0000","last_clean":"2024-03-18T15:00:50.620069+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:50.620069+0000","last_undegraded":"2024-03-18T15:00:50.620069+0000","last_fullsized":"2024-03-18T15:00:50.620069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603679+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:50.603679+0000","last_peered":"2024-03-18T15:00:50.603679+0000","last_clean":"2024-03-18T15:00:50.603679+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:50.603679+0000","last_undegraded":"2024-03-18T15:00:50.603679+0000","last_fullsized":"2024-03-18T15:00:50.603679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620575+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:50.620575+0000","last_peered":"2024-03-18T15:00:50.620575+0000","last_clean":"2024-03-18T15:00:50.620575+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:50.620575+0000","last_undegraded":"2024-03-18T15:00:50.620575+0000","last_fullsized":"2024-03-18T15:00:50.620575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604641+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:50.604641+0000","last_peered":"2024-03-18T15:00:50.604641+0000","last_clean":"2024-03-18T15:00:50.604641+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:50.604641+0000","last_undegraded":"2024-03-18T15:00:50.604641+0000","last_fullsized":"2024-03-18T15:00:50.604641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620859+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:50.620859+0000","last_peered":"2024-03-18T15:00:50.620859+0000","last_clean":"2024-03-18T15:00:50.620859+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:50.620859+0000","last_undegraded":"2024-03-18T15:00:50.620859+0000","last_fullsized":"2024-03-18T15:00:50.620859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621075+0000","last_change":"2024-03-18T15:00:49.616193+0000","last_active":"2024-03-18T15:00:50.621075+0000","last_peered":"2024-03-18T15:00:50.621075+0000","last_clean":"2024-03-18T15:00:50.621075+0000","last_became_active":"2024-03-18T15:00:49.615875+0000","last_became_peered":"2024-03-18T15:00:49.615875+0000","last_unstale":"2024-03-18T15:00:50.621075+0000","last_undegraded":"2024-03-18T15:00:50.621075+0000","last_fullsized":"2024-03-18T15:00:50.621075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621370+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:50.621370+0000","last_peered":"2024-03-18T15:00:50.621370+0000","last_clean":"2024-03-18T15:00:50.621370+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:50.621370+0000","last_undegraded":"2024-03-18T15:00:50.621370+0000","last_fullsized":"2024-03-18T15:00:50.621370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:22.506254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509446,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509447,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27224,"kb_used_data":204,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344616,"statfs":{"total":96636764160,"available":96608886784,"internally_reserved":0,"allocated":208896,"data_stored":71752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509446,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27232,"kb_used_data":212,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344608,"statfs":{"total":96636764160,"available":96608878592,"internally_reserved":0,"allocated":217088,"data_stored":71912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542150,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542149,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542150,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:00:57.813 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T15:00:57.814 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-18T15:00:57.814 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-03-18T15:00:57.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-03-18T15:00:57.815 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-03-18T15:00:57.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.965+0000 7fe9c219d640 1 Processor -- start 2024-03-18T15:00:57.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.965+0000 7fe9c219d640 1 -- start start 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9c219d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe9bc15c260 0x7fe9bc06c600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9c219d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9bc0cf840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9c219d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe9bc15fe40 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9c219d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe9bc160c00 con 0x7fe9bc15c260 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9c219d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc160120 con 0x7fe9bc0cdeb0 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9b2ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe9bc0ceeb0 0x7fe9bc0cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53194/0 (socket says 172.21.15.152:53194) 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.966+0000 7fe9b2ffd640 1 -- 172.21.15.152:0/3356554641 learned_addr learned my addr 172.21.15.152:0/3356554641 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 723204073 0 0) 0x7fe9bc15fe40 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9bc0cf840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bb7fe640 1 --2- 172.21.15.152:0/3356554641 >> v2:172.21.15.186:3300/0 conn(0x7fe9bc15c260 0x7fe9bc06c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe9a8003520 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 996674871 0 0) 0x7fe9a8003520 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 msgr2=0x7fe9bc0cf840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9bc0cf840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 >> v2:172.21.15.186:3300/0 conn(0x7fe9bc15c260 msgr2=0x7fe9bc06c600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 --2- 172.21.15.152:0/3356554641 >> v2:172.21.15.186:3300/0 conn(0x7fe9bc15c260 0x7fe9bc06c600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc160400 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fe9a4001670 con 0x7fe9bc0ceeb0 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 >> v1:172.21.15.152:6789/0 conn(0x7fe9bc0ceeb0 legacy=0x7fe9bc0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9a8003a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9a8003fa0 0x7fe9a8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a8004d40 0x7fe9a80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc160c00 con 0x7fe9a8004d40 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc160120 con 0x7fe9a8003fa0 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe9a800ba70 con 0x7fe9bc0cdeb0 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a8004d40 0x7fe9a80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bb7fe640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9a8003a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9b2ffd640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9a8003fa0 0x7fe9a8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 -- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 msgr2=0x7fe9a8003a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc0cdeb0 0x7fe9a8003a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 -- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9a8003fa0 msgr2=0x7fe9a8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:57.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9a8003fa0 0x7fe9a8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.967+0000 7fe9bbfff640 1 -- 172.21.15.152:0/3356554641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9a8003520 con 0x7fe9a8004d40 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.968+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a8004d40 0x7fe9a80051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009fc0 tx=0x7fe9a8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea4a79b5d5fd631 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.968+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4039070 con 0x7fe9a8004d40 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.968+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9b402cc20 con 0x7fe9a8004d40 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.968+0000 7fe9baffd640 1 -- 172.21.15.152:0/3356554641 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4009c10 con 0x7fe9a8004d40 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 -- 172.21.15.152:0/3356554641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a8004d40 msgr2=0x7fe9a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3356554641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9a8004d40 0x7fe9a80051c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4009fc0 tx=0x7fe9a8005830 comp rx=0 tx=0).stop 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9bbfff640 1 -- 172.21.15.152:0/3356554641 reap_dead start 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 -- 172.21.15.152:0/3356554641 shutdown_connections 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 -- 172.21.15.152:0/3356554641 >> 172.21.15.152:0/3356554641 conn(0x7fe9bc0b2ab0 msgr2=0x7fe9bc0b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:57.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 -- 172.21.15.152:0/3356554641 shutdown_connections 2024-03-18T15:00:57.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.969+0000 7fe9c219d640 1 -- 172.21.15.152:0/3356554641 wait complete. 2024-03-18T15:00:57.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.970+0000 7fe9c219d640 1 Processor -- start 2024-03-18T15:00:57.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.970+0000 7fe9c219d640 1 -- start start 2024-03-18T15:00:57.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9bc0b5100 0x7fe9bc0b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 0x7fe9bc151220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cf310 con 0x7fe9bc14c990 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe9bc0b49c0 con 0x7fe9bc0b5100 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9c219d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe9bc0cf840 con 0x7fe9bc150da0 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34234/0 (socket says 172.21.15.152:34234) 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 -- 172.21.15.152:0/3626674329 learned_addr learned my addr 172.21.15.152:0/3626674329 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 0x7fe9bc151220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9b2ffd640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9bc0b5100 0x7fe9bc0b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 -- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 msgr2=0x7fe9bc151220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 0x7fe9bc151220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 -- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9bc0b5100 msgr2=0x7fe9bc0b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9bc0b5100 0x7fe9bc0b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:57.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bb7fe640 1 -- 172.21.15.152:0/3626674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9bc152540 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.971+0000 7fe9bbfff640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 0x7fe9bc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9bb7fe640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac011aa0 tx=0x7fe9ac011f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac00fb20 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9ac00fcc0 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9bc152820 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9ac014660 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.972+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9bc152de0 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.973+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9bc0b5ac0 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.973+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe9ac012040 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.973+0000 7fe9b8ff9640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 0x7fe99c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.974+0000 7fe9b2ffd640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 0x7fe99c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.974+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe9ac08b190 con 0x7fe9bc14c990 2024-03-18T15:00:57.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.974+0000 7fe9b2ffd640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 0x7fe99c06e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc09f060 tx=0x7fe9a4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:57.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:57.978+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe9ac019030 con 0x7fe9bc14c990 2024-03-18T15:00:58.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.210+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7fe9bc04f5b0 con 0x7fe9bc14c990 2024-03-18T15:00:58.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.212+0000 7fe9b8ff9640 1 -- 172.21.15.152:0/3626674329 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+172584 (secure 0 0 0) 0x7fe9ac059c80 con 0x7fe9bc14c990 2024-03-18T15:00:58.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:58.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 msgr2=0x7fe99c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 0x7fe99c06e090 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fe9bc09f060 tx=0x7fe9a4009040 comp rx=0 tx=0).stop 2024-03-18T15:00:58.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 msgr2=0x7fe9bc1f23f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe9ac011aa0 tx=0x7fe9ac011f60 comp rx=0 tx=0).stop 2024-03-18T15:00:58.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 shutdown_connections 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe99c06bbd0 0x7fe99c06e090 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe9bc150da0 0x7fe9bc151220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe9bc0b5100 0x7fe9bc0b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 --2- 172.21.15.152:0/3626674329 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe9bc14c990 0x7fe9bc1f23f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 >> 172.21.15.152:0/3626674329 conn(0x7fe9bc0b2ab0 msgr2=0x7fe9bc0b15d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 shutdown_connections 2024-03-18T15:00:58.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.215+0000 7fe9c219d640 1 -- 172.21.15.152:0/3626674329 wait complete. 2024-03-18T15:00:58.227 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":5,"flags":0,"active_gid":4104,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6832","nonce":1694187494},{"type":"v1","addr":"172.21.15.152:6833","nonce":1694187494}]},"active_addr":"172.21.15.152:6833/1694187494","active_change":"2024-03-18T15:00:27.795488+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4100,"name":"x","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.0.0","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3231071141}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":168421518}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":488910538}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.152:0","nonce":3739283313}]}]} 2024-03-18T15:00:58.230 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-03-18T15:00:58.230 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-03-18T15:00:58.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:58.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 Processor -- start 2024-03-18T15:00:58.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 -- start start 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28415e5a0 0x7ff2840d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff2840d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff2840d3010 con 0x7ff2840d2b80 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff2840cff90 con 0x7ff28415e5a0 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.333+0000 7ff28a20b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff2840b34d0 con 0x7ff2840d1e40 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28415e5a0 0x7ff2840d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28415e5a0 0x7ff2840d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34250/0 (socket says 172.21.15.152:34250) 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 -- 172.21.15.152:0/1157131982 learned_addr learned my addr 172.21.15.152:0/1157131982 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff282ffd640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff2840d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 -- 172.21.15.152:0/1157131982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 msgr2=0x7ff2840d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff2840d2640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 -- 172.21.15.152:0/1157131982 >> v1:172.21.15.186:6789/0 conn(0x7ff2840d2b80 legacy=0x7ff2840ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.334+0000 7ff2837fe640 1 -- 172.21.15.152:0/1157131982 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2840d1200 con 0x7ff28415e5a0 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff2837fe640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28415e5a0 0x7ff2840d4b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff274009870 tx=0x7ff27402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68095263d7dc6e38 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff2827fc640 1 -- 172.21.15.152:0/1157131982 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2740317c0 con 0x7ff28415e5a0 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff2827fc640 1 -- 172.21.15.152:0/1157131982 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff274037070 con 0x7ff28415e5a0 2024-03-18T15:00:58.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff2827fc640 1 -- 172.21.15.152:0/1157131982 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff274031b80 con 0x7ff28415e5a0 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 -- 172.21.15.152:0/1157131982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28415e5a0 msgr2=0x7ff2840d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28415e5a0 0x7ff2840d4b80 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7ff274009870 tx=0x7ff27402b860 comp rx=0 tx=0).stop 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 -- 172.21.15.152:0/1157131982 shutdown_connections 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff2840d2640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 --2- 172.21.15.152:0/1157131982 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28415e5a0 0x7ff2840d4b80 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 -- 172.21.15.152:0/1157131982 >> 172.21.15.152:0/1157131982 conn(0x7ff2840d4060 msgr2=0x7ff2840d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 -- 172.21.15.152:0/1157131982 shutdown_connections 2024-03-18T15:00:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.335+0000 7ff28a20b640 1 -- 172.21.15.152:0/1157131982 wait complete. 2024-03-18T15:00:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.337+0000 7ff28a20b640 1 Processor -- start 2024-03-18T15:00:58.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.337+0000 7ff28a20b640 1 -- start start 2024-03-18T15:00:58.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff28415d2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 0x7ff2840cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff2840b4c50 con 0x7ff2840d2b80 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff2840d17c0 con 0x7ff28415e5a0 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff2840b4dd0 con 0x7ff2840d1e40 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34264/0 (socket says 172.21.15.152:34264) 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 -- 172.21.15.152:0/656858231 learned_addr learned my addr 172.21.15.152:0/656858231 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff2837fe640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff28415d2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff283fff640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 0x7ff2840cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 -- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 msgr2=0x7ff28415d2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff28415d2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 -- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 msgr2=0x7ff2840cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 0x7ff2840cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 -- 172.21.15.152:0/656858231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2841f4640 con 0x7ff2840d2b80 2024-03-18T15:00:58.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff283fff640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 0x7ff2840cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff282ffd640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c820 tx=0x7ff27800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff278015070 con 0x7ff2840d2b80 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff278004020 con 0x7ff2840d2b80 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2841f4920 con 0x7ff2840d2b80 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2780043f0 con 0x7ff2840d2b80 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.339+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2840b6c80 con 0x7ff2840d2b80 2024-03-18T15:00:58.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.340+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28404f5b0 con 0x7ff2840d2b80 2024-03-18T15:00:58.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.341+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff278007830 con 0x7ff2840d2b80 2024-03-18T15:00:58.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.341+0000 7ff26bfff640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.341+0000 7ff2837fe640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.341+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff27808a7b0 con 0x7ff2840d2b80 2024-03-18T15:00:58.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.342+0000 7ff2837fe640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff274036000 tx=0x7ff27403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.350+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff278058c50 con 0x7ff2840d2b80 2024-03-18T15:00:58.537 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.536+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2840cf8a0 con 0x7ff2840d2b80 2024-03-18T15:00:58.538 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.538+0000 7ff26bfff640 1 -- 172.21.15.152:0/656858231 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7ff27805ccf0 con 0x7ff2840d2b80 2024-03-18T15:00:58.538 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:58.538 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 msgr2=0x7ff27006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ff274036000 tx=0x7ff27403d040 comp rx=0 tx=0).stop 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 msgr2=0x7ff2841f3c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7ff27800c820 tx=0x7ff27800cce0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 shutdown_connections 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28415e5a0 0x7ff2840cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff2840d2b80 0x7ff2841f3c80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.541 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 --2- 172.21.15.152:0/656858231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff2840d1e40 0x7ff28415d2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 >> 172.21.15.152:0/656858231 conn(0x7ff2840d4060 msgr2=0x7ff2840ceb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:58.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 shutdown_connections 2024-03-18T15:00:58.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.540+0000 7ff28a20b640 1 -- 172.21.15.152:0/656858231 wait complete. 2024-03-18T15:00:58.555 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-03-18T15:00:58.555 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:00:58.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.657+0000 7f3ac9c63640 1 Processor -- start 2024-03-18T15:00:58.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 -- start start 2024-03-18T15:00:58.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ac40b30e0 0x7f3ac40d0270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 0x7f3ac40d07b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3ac40d2070 con 0x7f3ac415c250 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3ac415c630 con 0x7f3ac40b30e0 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.658+0000 7f3ac9c63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac40b3570 con 0x7f3ac40c5990 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ac40b30e0 0x7f3ac40d0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac3fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 0x7f3ac40d07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3ac40b30e0 0x7f3ac40d0270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50588/0 (socket says 172.21.15.152:50588) 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 -- 172.21.15.152:0/4064589935 learned_addr learned my addr 172.21.15.152:0/4064589935 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac37fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3ac415c250 0x7f3ac40b29d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:43044/0 (socket says 172.21.15.152:43044) 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 -- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 msgr2=0x7f3ac40d07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 0x7f3ac40d07b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 -- 172.21.15.152:0/4064589935 >> v1:172.21.15.186:6789/0 conn(0x7f3ac415c250 legacy=0x7f3ac40b29d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac2ffd640 1 -- 172.21.15.152:0/4064589935 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40cca10 con 0x7f3ac40b30e0 2024-03-18T15:00:58.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.659+0000 7f3ac3fff640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 0x7f3ac40d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:58.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.660+0000 7f3ac2ffd640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac40b30e0 0x7f3ac40d0270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009870 tx=0x7f3ab802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb8a98ee8256042f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.660+0000 7f3ac27fc640 1 -- 172.21.15.152:0/4064589935 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab802f840 con 0x7f3ac40b30e0 2024-03-18T15:00:58.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.660+0000 7f3ac27fc640 1 -- 172.21.15.152:0/4064589935 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab802f9e0 con 0x7f3ac40b30e0 2024-03-18T15:00:58.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.660+0000 7f3ac27fc640 1 -- 172.21.15.152:0/4064589935 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab802fdb0 con 0x7f3ac40b30e0 2024-03-18T15:00:58.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 -- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac40b30e0 msgr2=0x7f3ac40d0270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac40b30e0 0x7f3ac40d0270 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8009870 tx=0x7f3ab802ba20 comp rx=0 tx=0).stop 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 -- 172.21.15.152:0/4064589935 shutdown_connections 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac40c5990 0x7f3ac40d07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/4064589935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac40b30e0 0x7f3ac40d0270 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 -- 172.21.15.152:0/4064589935 >> 172.21.15.152:0/4064589935 conn(0x7f3ac409aa50 msgr2=0x7f3ac409ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 -- 172.21.15.152:0/4064589935 shutdown_connections 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.661+0000 7f3ac9c63640 1 -- 172.21.15.152:0/4064589935 wait complete. 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.662+0000 7f3ac9c63640 1 Processor -- start 2024-03-18T15:00:58.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.662+0000 7f3ac9c63640 1 -- start start 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac415c250 0x7f3ac406d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac41549e0 0x7f3ac406cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40cd2b0 con 0x7f3ac40c5990 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac40ccfd0 con 0x7f3ac415c250 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac4165cf0 con 0x7f3ac41549e0 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34270/0 (socket says 172.21.15.152:34270) 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 -- 172.21.15.152:0/819311377 learned_addr learned my addr 172.21.15.152:0/819311377 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac2ffd640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac415c250 0x7f3ac406d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac3fff640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac41549e0 0x7f3ac406cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 -- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac41549e0 msgr2=0x7f3ac406cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac41549e0 0x7f3ac406cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 -- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac415c250 msgr2=0x7f3ac406d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac415c250 0x7f3ac406d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 -- 172.21.15.152:0/819311377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac406e2d0 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac37fe640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c3f0 tx=0x7f3ab400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40074e0 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ab4007680 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac406dd10 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.663+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4004a00 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.664+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac406c400 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.665+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3ab401a020 con 0x7f3ac40c5990 2024-03-18T15:00:58.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.665+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac404f5b0 con 0x7f3ac40c5990 2024-03-18T15:00:58.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.665+0000 7f3aabfff640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 0x7f3ab006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:58.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.665+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3ab408a060 con 0x7f3ac40c5990 2024-03-18T15:00:58.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.665+0000 7f3ac2ffd640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 0x7f3ab006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:58.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.666+0000 7f3ac2ffd640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 0x7f3ab006e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8036000 tx=0x7f3ab8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:58.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.670+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3ab4058b60 con 0x7f3ac40c5990 2024-03-18T15:00:58.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.850+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3ac40c7fa0 con 0x7f3ac40c5990 2024-03-18T15:00:58.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.851+0000 7f3aabfff640 1 -- 172.21.15.152:0/819311377 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f3ab4058460 con 0x7f3ac40c5990 2024-03-18T15:00:58.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:00:58.852 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 msgr2=0x7f3ab006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 0x7f3ab006e0c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f3ab8036000 tx=0x7f3ab8008030 comp rx=0 tx=0).stop 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 msgr2=0x7f3ac41508a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400c3f0 tx=0x7f3ab400c7f0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 shutdown_connections 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3ab006bc00 0x7f3ab006e0c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3ac41549e0 0x7f3ac406cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3ac415c250 0x7f3ac406d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 --2- 172.21.15.152:0/819311377 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3ac40c5990 0x7f3ac41508a0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 >> 172.21.15.152:0/819311377 conn(0x7f3ac409aa50 msgr2=0x7f3ac40ce030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 shutdown_connections 2024-03-18T15:00:58.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:58.854+0000 7f3ac9c63640 1 -- 172.21.15.152:0/819311377 wait complete. 2024-03-18T15:00:58.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-03-18T15:00:58.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-03-18T15:00:58.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-03-18T15:00:58.867 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-03-18T15:00:58.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-03-18T15:00:58.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-03-18T15:00:58.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-03-18T15:00:58.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-03-18T15:00:59.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.041+0000 7f7a4caf1640 1 Processor -- start 2024-03-18T15:00:59.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.041+0000 7f7a4caf1640 1 -- start start 2024-03-18T15:00:59.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.042+0000 7f7a4caf1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 0x7f7a48071fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.042+0000 7f7a4caf1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480b3920 con 0x7f7a480b49c0 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.042+0000 7f7a4caf1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a480b3c00 con 0x7f7a48140670 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.042+0000 7f7a4caf1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7a48072510 con 0x7f7a48071b70 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a46d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7a480b49c0 0x7f7a480b4e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53198/0 (socket says 172.21.15.152:53198) 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1475128425 learned_addr learned my addr 172.21.15.152:0/1475128425 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1475128425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 0x7f7a48071fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a45d9b640 1 -- 172.21.15.152:0/1475128425 >> v1:172.21.15.186:6789/0 conn(0x7f7a48140670 legacy=0x7f7a4806d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a45d9b640 1 -- 172.21.15.152:0/1475128425 >> v1:172.21.15.152:6789/0 conn(0x7f7a480b49c0 legacy=0x7f7a480b4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7f7a45d9b640 1 -- 172.21.15.152:0/1475128425 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a480b3ee0 con 0x7f7a48071b70 2024-03-18T15:00:59.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7fca4ef72640 1 Processor -- start 2024-03-18T15:00:59.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.043+0000 7fca4ef72640 1 -- start start 2024-03-18T15:00:59.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.044+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1475128425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 0x7f7a48071fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009dc0 tx=0x7f7a4002bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=63738ca8e0629076 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4df70640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fca480b3140 0x7fca480cc8b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53212/0 (socket says 172.21.15.152:53212) 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4df70640 1 -- 172.21.15.152:0/3235452741 learned_addr learned my addr 172.21.15.152:0/3235452741 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4ef72640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3520 0x7fca480b3960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4ef72640 1 --2- 172.21.15.152:0/3235452741 >> v2:172.21.15.186:3300/0 conn(0x7fca48069050 0x7fca4806d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca48071180 con 0x7fca480b3140 2024-03-18T15:00:59.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7f7a4559a640 1 -- 172.21.15.152:0/1475128425 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40039070 con 0x7f7a48071b70 2024-03-18T15:00:59.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4e771640 1 --2- 172.21.15.152:0/3235452741 >> v2:172.21.15.186:3300/0 conn(0x7fca48069050 0x7fca4806d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4d76f640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3520 0x7fca480b3960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fca480724a0 con 0x7fca48069050 2024-03-18T15:00:59.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.045+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fca480718d0 con 0x7fca480b3520 2024-03-18T15:00:59.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7f7a4559a640 1 -- 172.21.15.152:0/1475128425 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a4002cd00 con 0x7f7a48071b70 2024-03-18T15:00:59.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4cf6e640 1 -- 172.21.15.152:0/3235452741 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 592009537 0 0) 0x7fca44001110 con 0x7fca480b3140 2024-03-18T15:00:59.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4cf6e640 1 -- 172.21.15.152:0/3235452741 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fca34003520 con 0x7fca480b3140 2024-03-18T15:00:59.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4e771640 1 -- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3520 msgr2=0x7fca480b3960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4e771640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3520 0x7fca480b3960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4e771640 1 -- 172.21.15.152:0/3235452741 >> v1:172.21.15.152:6789/0 conn(0x7fca480b3140 legacy=0x7fca480cc8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.046+0000 7fca4e771640 1 -- 172.21.15.152:0/3235452741 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4815a370 con 0x7fca48069050 2024-03-18T15:00:59.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.047+0000 7fca4e771640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4806d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca3800dbc0 tx=0x7fca3802fc50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb96fb2e7c313b25 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.047+0000 7f7a4559a640 1 -- 172.21.15.152:0/1475128425 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a40034660 con 0x7f7a48071b70 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.048+0000 7fca4cf6e640 1 -- 172.21.15.152:0/3235452741 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca380307f0 con 0x7fca48069050 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.048+0000 7fca4cf6e640 1 -- 172.21.15.152:0/3235452741 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca38030990 con 0x7fca48069050 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.048+0000 7fca4cf6e640 1 -- 172.21.15.152:0/3235452741 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca38030d40 con 0x7fca48069050 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 msgr2=0x7fca4806d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4806d960 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fca3800dbc0 tx=0x7fca3802fc50 comp rx=0 tx=0).stop 2024-03-18T15:00:59.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 shutdown_connections 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4806d960 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 --2- 172.21.15.152:0/3235452741 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3520 0x7fca480b3960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.049+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 >> 172.21.15.152:0/3235452741 conn(0x7fca480b1bd0 msgr2=0x7fca480b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.051+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1475128425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 msgr2=0x7f7a48071fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.051+0000 7f7a4caf1640 1 --2- 172.21.15.152:0/1475128425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 0x7f7a48071fd0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7a40009dc0 tx=0x7f7a4002bf50 comp rx=0 tx=0).stop 2024-03-18T15:00:59.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.051+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 shutdown_connections 2024-03-18T15:00:59.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.051+0000 7fca4ef72640 1 -- 172.21.15.152:0/3235452741 wait complete. 2024-03-18T15:00:59.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fdc81c27640 1 Processor -- start 2024-03-18T15:00:59.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fdc81c27640 1 -- start start 2024-03-18T15:00:59.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fca4ef72640 1 Processor -- start 2024-03-18T15:00:59.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fca4ef72640 1 -- start start 2024-03-18T15:00:59.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1475128425 shutdown_connections 2024-03-18T15:00:59.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7f7a4caf1640 1 --2- 172.21.15.152:0/1475128425 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48071b70 0x7f7a48071fd0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1475128425 >> 172.21.15.152:0/1475128425 conn(0x7f7a480b2680 msgr2=0x7f7a480b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fd019937640 1 Processor -- start 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.052+0000 7fd019937640 1 -- start start 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fd019937640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd0140b0940 0x7fd01406c470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fd019937640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd01406c9b0 0x7fd0140c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdc7c15ad80 0x7fdc7c0cba00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c0cee20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7c0cbf40 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fdc7c0cf700 con 0x7fdc7c15ad80 2024-03-18T15:00:59.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.053+0000 7fdc81c27640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c0cf9e0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd019937640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd0140b3660 con 0x7fd0140c53b0 2024-03-18T15:00:59.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4ef72640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd019937640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd0140c5800 con 0x7fd0140b0940 2024-03-18T15:00:59.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd019937640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd0140b31d0 con 0x7fd01406c9b0 2024-03-18T15:00:59.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd0137fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd0140c53b0 0x7fd014166400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53222/0 (socket says 172.21.15.152:53222) 2024-03-18T15:00:59.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd0137fe640 1 -- 172.21.15.152:0/1285986423 learned_addr learned my addr 172.21.15.152:0/1285986423 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34278/0 (socket says 172.21.15.152:34278) 2024-03-18T15:00:59.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 -- 172.21.15.152:0/695959918 learned_addr learned my addr 172.21.15.152:0/695959918 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4ef72640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3140 0x7fca48141750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd0127fc640 1 --2- 172.21.15.152:0/1285986423 >> v2:172.21.15.186:3300/0 conn(0x7fd01406c9b0 0x7fd0140c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4df70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4df70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4814c870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50626/0 (socket says 172.21.15.152:50626) 2024-03-18T15:00:59.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4df70640 1 -- 172.21.15.152:0/593728687 learned_addr learned my addr 172.21.15.152:0/593728687 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4d76f640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3140 0x7fca48141750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 -- 172.21.15.152:0/695959918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 msgr2=0x7fdc7c0cee20 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/695959918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c0cee20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 -- 172.21.15.152:0/695959918 >> v2:172.21.15.186:3300/0 conn(0x7fdc7c15ad80 msgr2=0x7fdc7c0cba00 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fca4ef72640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480b3520 0x7fca48141c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/695959918 >> v2:172.21.15.186:3300/0 conn(0x7fdc7c15ad80 0x7fdc7c0cba00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fdc7bfff640 1 -- 172.21.15.152:0/695959918 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c0cfcc0 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.054+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3414100427 0 0) 0x7fd0140b3660 con 0x7fd0140c53b0 2024-03-18T15:00:59.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fcffc003520 con 0x7fd0140c53b0 2024-03-18T15:00:59.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1475128425 shutdown_connections 2024-03-18T15:00:59.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4ef72640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca48072130 con 0x7fca480b3520 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4ef72640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fca48071e50 con 0x7fca48069050 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4ef72640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fca480ccfc0 con 0x7fca480b3140 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4e771640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480b3520 0x7fca48141c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4df70640 1 -- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3140 msgr2=0x7fca48141750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4df70640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca480b3140 0x7fca48141750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4df70640 1 -- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480b3520 msgr2=0x7fca48141c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4df70640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca480b3520 0x7fca48141c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fca4df70640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca4814ee40 con 0x7fca48069050 2024-03-18T15:00:59.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2014742777 0 0) 0x7fcffc003520 con 0x7fd0140c53b0 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 >> v2:172.21.15.186:3300/0 conn(0x7fd01406c9b0 msgr2=0x7fd0140c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 --2- 172.21.15.152:0/1285986423 >> v2:172.21.15.186:3300/0 conn(0x7fd01406c9b0 0x7fd0140c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 >> v2:172.21.15.152:3300/0 conn(0x7fd0140b0940 msgr2=0x7fd01406c470 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 --2- 172.21.15.152:0/1285986423 >> v2:172.21.15.152:3300/0 conn(0x7fd0140b0940 0x7fd01406c470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd014162cf0 con 0x7fd0140c53b0 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fd00c0019f0 con 0x7fd0140c53b0 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 >> v1:172.21.15.152:6789/0 conn(0x7fd0140c53b0 legacy=0x7fd014166400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcffc003a70 0x7fcffc003e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 0x7fcffc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd0140c5800 con 0x7fcffc005210 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd0140b31d0 con 0x7fcffc004800 2024-03-18T15:00:59.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcffc00c1c0 con 0x7fcffc003a70 2024-03-18T15:00:59.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fca4df70640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4814c870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c4d0 tx=0x7fca4400c990 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/695959918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b39e0 tx=0x7fdc7402e120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c53ffe32c39c0f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 0x7fcffc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fdc7a7fc640 1 -- 172.21.15.152:0/695959918 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400b0d0 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44016020 con 0x7fca48069050 2024-03-18T15:00:59.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fdc7a7fc640 1 -- 172.21.15.152:0/695959918 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b270 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca44012830 con 0x7fca48069050 2024-03-18T15:00:59.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fdc7a7fc640 1 -- 172.21.15.152:0/695959918 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74009600 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca44012c20 con 0x7fca48069050 2024-03-18T15:00:59.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fca4ef72640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca4814f120 con 0x7fca48069050 2024-03-18T15:00:59.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fca4ef72640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca48142580 con 0x7fca48069050 2024-03-18T15:00:59.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fdc81c27640 1 -- 172.21.15.152:0/695959918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 msgr2=0x7fdc7c0cdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fdc81c27640 1 --2- 172.21.15.152:0/695959918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b39e0 tx=0x7fdc7402e120 comp rx=0 tx=0).stop 2024-03-18T15:00:59.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fdc81c27640 1 -- 172.21.15.152:0/695959918 shutdown_connections 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fd0137fe640 1 -- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcffc003a70 msgr2=0x7fcffc003e90 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcffc003a70 0x7fcffc003e90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fd0137fe640 1 -- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc004800 msgr2=0x7fcffc004c80 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.056+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc004800 0x7fcffc004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fd0137fe640 1 -- 172.21.15.152:0/1285986423 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcffc003520 con 0x7fcffc005210 2024-03-18T15:00:59.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.057+0000 7fd0137fe640 1 -- 172.21.15.152:0/1285986423 reap_dead start 2024-03-18T15:00:59.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fdc81c27640 1 --2- 172.21.15.152:0/695959918 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdc30 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fdc81c27640 1 --2- 172.21.15.152:0/695959918 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c0cee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fdc81c27640 1 --2- 172.21.15.152:0/695959918 >> v2:172.21.15.186:3300/0 conn(0x7fdc7c15ad80 0x7fdc7c0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fdc81c27640 1 -- 172.21.15.152:0/695959918 >> 172.21.15.152:0/695959918 conn(0x7fdc7c0b2a40 msgr2=0x7fdc7c0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 0x7fcffc00b9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00a7f0 tx=0x7fcffc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5a4786a2b2d1c64 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.055+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1475128425 wait complete. 2024-03-18T15:00:59.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c00a410 con 0x7fcffc005210 2024-03-18T15:00:59.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00c034630 con 0x7fcffc005210 2024-03-18T15:00:59.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.058+0000 7fd011ffb640 1 -- 172.21.15.152:0/1285986423 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00c034a00 con 0x7fcffc005210 2024-03-18T15:00:59.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.059+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fca44019020 con 0x7fca48069050 2024-03-18T15:00:59.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.059+0000 7fd019937640 1 -- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 msgr2=0x7fcffc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.059+0000 7fd019937640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 0x7fcffc00b9c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd00c00a7f0 tx=0x7fcffc005830 comp rx=0 tx=0).stop 2024-03-18T15:00:59.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.059+0000 7fca3e7fc640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca2c06bc20 0x7fca2c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fd019937640 1 -- 172.21.15.152:0/1285986423 shutdown_connections 2024-03-18T15:00:59.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fd019937640 1 --2- 172.21.15.152:0/1285986423 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcffc005210 0x7fcffc00b9c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fd019937640 1 -- 172.21.15.152:0/1285986423 >> 172.21.15.152:0/1285986423 conn(0x7fd0140d1ea0 msgr2=0x7fd0140d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.059+0000 7fdc81c27640 1 -- 172.21.15.152:0/695959918 shutdown_connections 2024-03-18T15:00:59.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fdc81c27640 1 -- 172.21.15.152:0/695959918 wait complete. 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca4814ebf0 con 0x7fca48069050 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca4d76f640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca2c06bc20 0x7fca2c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca4408a9a0 con 0x7fca48069050 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7f3bf5287640 1 Processor -- start 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7f3bf5287640 1 -- start start 2024-03-18T15:00:59.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fd019937640 1 -- 172.21.15.152:0/1285986423 shutdown_connections 2024-03-18T15:00:59.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca3e7fc640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fca2c073dc0 0x7fca2c0761e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca2c076890 con 0x7fca2c073dc0 2024-03-18T15:00:59.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.060+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fca44055160 con 0x7fca48069050 2024-03-18T15:00:59.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7fca4e771640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fca2c073dc0 0x7fca2c0761e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7fca4d76f640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca2c06bc20 0x7fca2c06e0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca4806dbb0 tx=0x7fca400077b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3b1e01f640 1 Processor -- start 2024-03-18T15:00:59.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7fca4e771640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fca2c073dc0 0x7fca2c0761e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3bf5287640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 0x7f3bf00cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3bf5287640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 0x7f3bf006d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3bf5287640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3bf00b2d30 0x7f3bf00b3150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3bf5287640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf00d0610 con 0x7f3bf00b4ca0 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3bf5287640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3bf016b310 con 0x7f3bf00b2d30 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bf5287640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf00b3690 con 0x7f3bf016ae90 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3beeffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 0x7f3bf00cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3beeffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 0x7f3bf00cf9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34308/0 (socket says 172.21.15.152:34308) 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3beeffd640 1 -- 172.21.15.152:0/2627792894 learned_addr learned my addr 172.21.15.152:0/2627792894 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/2627792894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 0x7f3bf006d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 -- 172.21.15.152:0/2627792894 >> v2:172.21.15.186:3300/0 conn(0x7f3bf00b2d30 msgr2=0x7f3bf00b3150 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/2627792894 >> v2:172.21.15.186:3300/0 conn(0x7f3bf00b2d30 0x7f3bf00b3150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 -- 172.21.15.152:0/2627792894 >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 msgr2=0x7f3bf00cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/2627792894 >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 0x7f3bf00cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7f3bee7fc640 1 -- 172.21.15.152:0/2627792894 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf006dc50 con 0x7f3bf016ae90 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== osd.3 v2:172.21.15.152:6824/602992539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca2c076890 con 0x7fca2c073dc0 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.061+0000 7f3b1e01f640 1 -- start start 2024-03-18T15:00:59.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7fdc81c27640 1 Processor -- start 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1e01f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3b180d0620 0x7f3b18070c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1e01f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b18166440 con 0x7f3b18072c80 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1e01f640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b18166720 con 0x7f3b18163460 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1e01f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3b18166a00 con 0x7f3b180d0620 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1d01d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3b18072c80 0x7f3b180cff10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53238/0 (socket says 172.21.15.152:53238) 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1d01d640 1 -- 172.21.15.152:0/1590997222 learned_addr learned my addr 172.21.15.152:0/1590997222 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.063+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/1590997222 >> v2:172.21.15.152:3300/0 conn(0x7f3b180d0620 0x7f3b18070c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.062+0000 7fd019937640 1 -- 172.21.15.152:0/1285986423 wait complete. 2024-03-18T15:00:59.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7fd019937640 1 Processor -- start 2024-03-18T15:00:59.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7fdc81c27640 1 -- start start 2024-03-18T15:00:59.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/2627792894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 0x7f3bf006d710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b53f0 tx=0x7f3be402b860 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1d4d041ce18bcae server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3b1c81c640 1 -- 172.21.15.152:0/1590997222 >> v1:172.21.15.186:6789/0 conn(0x7f3b18163460 legacy=0x7f3b180b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3b1c81c640 1 -- 172.21.15.152:0/1590997222 >> v1:172.21.15.152:6789/0 conn(0x7f3b18072c80 legacy=0x7f3b180cff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3bedffb640 1 -- 172.21.15.152:0/2627792894 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be40317c0 con 0x7f3bf016ae90 2024-03-18T15:00:59.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3bedffb640 1 -- 172.21.15.152:0/2627792894 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be4037070 con 0x7f3bf016ae90 2024-03-18T15:00:59.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3bedffb640 1 -- 172.21.15.152:0/2627792894 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be40317c0 con 0x7f3bf016ae90 2024-03-18T15:00:59.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7f3b1c81c640 1 -- 172.21.15.152:0/1590997222 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b18166ce0 con 0x7f3b180d0620 2024-03-18T15:00:59.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc7c15ad80 0x7fdc7c0ce0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c15b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c15b160 con 0x7fdc7c0cd7a0 2024-03-18T15:00:59.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.064+0000 7fd019937640 1 -- start start 2024-03-18T15:00:59.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdc7c06eb20 con 0x7fdc7c15ad80 2024-03-18T15:00:59.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc81c27640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc7c0cf360 con 0x7fdc7c15ea30 2024-03-18T15:00:59.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 0x7fd014163d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0140c6470 0x7fd0141600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0140c68f0 0x7fd0141605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd0140b2b80 con 0x7fd0140c68f0 2024-03-18T15:00:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc7affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc7c15ad80 0x7fdc7c0ce0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fdc7bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c15b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7affd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc7c15ad80 0x7fdc7c0ce0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50674/0 (socket says 172.21.15.152:50674) 2024-03-18T15:00:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7affd640 1 -- 172.21.15.152:0/541916902 learned_addr learned my addr 172.21.15.152:0/541916902 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7b7fe640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/1590997222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18070c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a75032366706c54 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 -- 172.21.15.152:0/541916902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc7c15ad80 msgr2=0x7fdc7c0ce0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc7c15ad80 0x7fdc7c0ce0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 -- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 msgr2=0x7fdc7c0cdb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc7c0cd7a0 0x7fdc7c0cdb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 -- 172.21.15.152:0/2627792894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 msgr2=0x7f3bf006d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 --2- 172.21.15.152:0/2627792894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 0x7f3bf006d710 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b53f0 tx=0x7f3be402b860 comp rx=0 tx=0).stop 2024-03-18T15:00:59.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 -- 172.21.15.152:0/2627792894 shutdown_connections 2024-03-18T15:00:59.086 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 --2- 172.21.15.152:0/2627792894 >> v2:172.21.15.186:3300/0 conn(0x7f3bf00b2d30 0x7f3bf00b3150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 --2- 172.21.15.152:0/2627792894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf016ae90 0x7f3bf006d710 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 --2- 172.21.15.152:0/2627792894 >> v2:172.21.15.152:3300/0 conn(0x7f3bf00b4ca0 0x7f3bf00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3bf5287640 1 -- 172.21.15.152:0/2627792894 >> 172.21.15.152:0/2627792894 conn(0x7f3bf006b1c0 msgr2=0x7f3bf006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7c144500 con 0x7fdc7c15ea30 2024-03-18T15:00:59.087 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd0140b28a0 con 0x7fcffc005210 2024-03-18T15:00:59.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fdc7bfff640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c15b590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b3b00 tx=0x7fdc74004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd019937640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd0140b2e60 con 0x7fd0140c6470 2024-03-18T15:00:59.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7f3b0ffff640 1 -- 172.21.15.152:0/1590997222 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08037070 con 0x7f3b180d0620 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 0x7fd014163d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd0127fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0140c6470 0x7fd0141600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd012ffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 0x7fd014163d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50662/0 (socket says 172.21.15.152:50662) 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.065+0000 7fd012ffd640 1 -- 172.21.15.152:0/1956097290 learned_addr learned my addr 172.21.15.152:0/1956097290 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 -- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 msgr2=0x7fd014163d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 0x7fd014163d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 -- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0140c68f0 msgr2=0x7fd0141605f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd0140c68f0 0x7fd0141605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd014201ad0 con 0x7fd0140c6470 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd012ffd640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcffc005210 0x7fd014163d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fd0127fc640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0140c6470 0x7fd0141600b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e770 tx=0x7fd00400eb70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.066+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd004017070 con 0x7fd0140c6470 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd00400c730 con 0x7fd0140c6470 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f3b0ffff640 1 -- 172.21.15.152:0/1590997222 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b08030710 con 0x7f3b180d0620 2024-03-18T15:00:59.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f3b0ffff640 1 -- 172.21.15.152:0/1590997222 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b08030ae0 con 0x7f3b180d0620 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f3bf5287640 1 -- 172.21.15.152:0/2627792894 shutdown_connections 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f3bf5287640 1 -- 172.21.15.152:0/2627792894 wait complete. 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc74045020 con 0x7fdc7c15ea30 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc7400b700 con 0x7fdc7c15ea30 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc7400b0d0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7c1447e0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7c144da0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd00400cb00 con 0x7fd0140c6470 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fd019937640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0140b6160 con 0x7fd0140c6470 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7fd019937640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd014200d30 con 0x7fd0140c6470 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f7a4caf1640 1 Processor -- start 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.067+0000 7f7a4caf1640 1 -- start start 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a48071b70 0x7f7a481347c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a480b49c0 0x7f7a480cdf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 0x7f7a481363b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a4806de60 con 0x7f7a480b49c0 2024-03-18T15:00:59.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a480b44a0 con 0x7f7a48071b70 2024-03-18T15:00:59.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f7a4caf1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7a4815b720 con 0x7f7a48140670 2024-03-18T15:00:59.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f3b1e01f640 1 -- 172.21.15.152:0/1590997222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 msgr2=0x7f3b18070c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f3b1e01f640 1 --2- 172.21.15.152:0/1590997222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18070c90 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3b080097a0 tx=0x7f3b0802b710 comp rx=0 tx=0).stop 2024-03-18T15:00:59.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f3b1e01f640 1 -- 172.21.15.152:0/1590997222 shutdown_connections 2024-03-18T15:00:59.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f3b1e01f640 1 --2- 172.21.15.152:0/1590997222 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18070c90 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7f3b1e01f640 1 -- 172.21.15.152:0/1590997222 >> 172.21.15.152:0/1590997222 conn(0x7f3b1806b5e0 msgr2=0x7f3b1806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd0140b6820 con 0x7fd0140c6470 2024-03-18T15:00:59.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f7a46d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 0x7f7a481363b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f3b1e01f640 1 -- 172.21.15.152:0/1590997222 shutdown_connections 2024-03-18T15:00:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f7a46d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 0x7f7a481363b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43542/0 (socket says 172.21.15.152:43542) 2024-03-18T15:00:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1158606876 learned_addr learned my addr 172.21.15.152:0/1158606876 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7feafe8b5640 1 Processor -- start 2024-03-18T15:00:59.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.068+0000 7feafe8b5640 1 -- start start 2024-03-18T15:00:59.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f3bf5287640 1 Processor -- start 2024-03-18T15:00:59.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f3bf5287640 1 -- start start 2024-03-18T15:00:59.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdc5c001030 con 0x7fdc7c15ea30 2024-03-18T15:00:59.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f3b1e01f640 1 -- 172.21.15.152:0/1590997222 wait complete. 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafe8b5640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feaf80d08c0 0x7feaf815a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafe8b5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafe8b5640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feaf8071900 con 0x7feaf806efe0 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafe8b5640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7feaf8072480 con 0x7feaf80d08c0 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafe8b5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7feaf8073240 con 0x7feaf8072810 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a480b49c0 0x7f7a480cdf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.069+0000 7f7a4659c640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a48071b70 0x7f7a481347c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a48071b70 msgr2=0x7f7a481347c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a46d9d640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a48071b70 0x7f7a481347c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a480b49c0 msgr2=0x7f7a480cdf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a46d9d640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a480b49c0 0x7f7a480cdf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feaf77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feaf80d08c0 0x7feaf815a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafce52640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafce52640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50698/0 (socket says 172.21.15.152:50698) 2024-03-18T15:00:59.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feaf77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7feaf80d08c0 0x7feaf815a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34334/0 (socket says 172.21.15.152:34334) 2024-03-18T15:00:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7feafce52640 1 -- 172.21.15.152:0/1363989707 learned_addr learned my addr 172.21.15.152:0/1363989707 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a48135310 con 0x7f7a48140670 2024-03-18T15:00:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a480b49c0 0x7f7a480cdf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:59.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7feaf77fe640 1 -- 172.21.15.152:0/1363989707 >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 msgr2=0x7feaf8071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7feaf77fe640 1 --2- 172.21.15.152:0/1363989707 >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7feaf77fe640 1 -- 172.21.15.152:0/1363989707 >> v1:172.21.15.186:6789/0 conn(0x7feaf806efe0 legacy=0x7feaf80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f3bf5287640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 0x7f3bf016ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f3bf5287640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf00b4ca0 0x7f3bf016f110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.070+0000 7f3bf5287640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf016ae90 0x7f3bf016ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bf5287640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0071530 con 0x7f3bf00b2d30 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 0x7f3bf016ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 0x7f3bf016ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34340/0 (socket says 172.21.15.152:34340) 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 -- 172.21.15.152:0/4291980074 learned_addr learned my addr 172.21.15.152:0/4291980074 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bf5287640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3bf0172cf0 con 0x7f3bf016ae90 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bf5287640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3bf0071810 con 0x7f3bf00b4ca0 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bef7fe640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf016ae90 0x7f3bf016ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf00b4ca0 0x7f3bf016f110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7feaf77fe640 1 -- 172.21.15.152:0/1363989707 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8071be0 con 0x7feaf80d08c0 2024-03-18T15:00:59.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3b1e01f640 1 Processor -- start 2024-03-18T15:00:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdc74048020 con 0x7fdc7c15ea30 2024-03-18T15:00:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3b1e01f640 1 -- start start 2024-03-18T15:00:59.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7fdc63fff640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc6806bca0 0x7fdc6806e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 -- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf00b4ca0 msgr2=0x7f3bf016f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3bf00b4ca0 0x7f3bf016f110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 -- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf016ae90 msgr2=0x7f3bf016ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3bf016ae90 0x7f3bf016ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bf009c550 con 0x7f3bf00b2d30 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3beeffd640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 0x7f3bf016ebd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009fd0 tx=0x7f3be000ed40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be0017070 con 0x7f3bf00b2d30 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3be000c940 con 0x7f3bf00b2d30 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3be000ccf0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.071+0000 7f3bf5287640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bf01614e0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdc740afaf0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7fdc63fff640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7fdc68073f20 0x7fdc68076340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdc7400b270 con 0x7fdc68073f20 2024-03-18T15:00:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fdc740afee0 con 0x7fdc7c15ea30 2024-03-18T15:00:59.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7feafce52640 1 --2- 172.21.15.152:0/1363989707 >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7feaf77fe640 1 --2- 172.21.15.152:0/1363989707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf80d08c0 0x7feaf815a280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b2f70 tx=0x7feaec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb304689f01062cd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7fdc7b7fe640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc6806bca0 0x7fdc6806e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd00401a070 con 0x7fd0140c6470 2024-03-18T15:00:59.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7fdc7affd640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7fdc68073f20 0x7fdc68076340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.072+0000 7f3bf5287640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bf01617c0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bf004f5b0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 0x7f3b1815ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18156f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b18163460 0x7f3b18147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b180ced70 con 0x7f3b180d0620 2024-03-18T15:00:59.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b181638b0 con 0x7f3b18163460 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f3b1e01f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3b18165fd0 con 0x7f3b18072c80 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7feaf6ffd640 1 -- 172.21.15.152:0/1363989707 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec0317c0 con 0x7feaf80d08c0 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7feaf6ffd640 1 -- 172.21.15.152:0/1363989707 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec037070 con 0x7feaf80d08c0 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7feaf6ffd640 1 -- 172.21.15.152:0/1363989707 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec031bc0 con 0x7feaf80d08c0 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3b1d01d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 0x7f3b1815ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3b1d01d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 0x7f3b1815ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43558/0 (socket says 172.21.15.152:43558) 2024-03-18T15:00:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3b1d01d640 1 -- 172.21.15.152:0/2114540371 learned_addr learned my addr 172.21.15.152:0/2114540371 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fdc7affd640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7fdc68073f20 0x7fdc68076340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fcffbfff640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd00006bc00 0x7fd00006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7f7a46d9d640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 0x7f7a481363b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c400 tx=0x7f7a3c00c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c017070 con 0x7f7a48140670 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a3c005ce0 con 0x7f7a48140670 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a3c0072d0 con 0x7f7a48140670 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a481355f0 con 0x7f7a48140670 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a48135bb0 con 0x7f7a48140670 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7feafe8b5640 1 -- 172.21.15.152:0/1363989707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf80d08c0 msgr2=0x7feaf815a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7feafe8b5640 1 --2- 172.21.15.152:0/1363989707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf80d08c0 0x7feaf815a280 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7feaf80b2f70 tx=0x7feaec02b860 comp rx=0 tx=0).stop 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7feafe8b5640 1 -- 172.21.15.152:0/1363989707 shutdown_connections 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7feafe8b5640 1 --2- 172.21.15.152:0/1363989707 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf80d08c0 0x7feaf815a280 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7feafe8b5640 1 --2- 172.21.15.152:0/1363989707 >> v2:172.21.15.186:3300/0 conn(0x7feaf8072810 0x7feaf8071240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7feafe8b5640 1 -- 172.21.15.152:0/1363989707 >> 172.21.15.152:0/1363989707 conn(0x7feaf806b5e0 msgr2=0x7feaf806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.073+0000 7fdc7b7fe640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc6806bca0 0x7fdc6806e160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006fd0 tx=0x7fdc6c0090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== osd.2 v2:172.21.15.152:6812/2040307032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdc7400b270 con 0x7fdc68073f20 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3be001a070 con 0x7f3bf00b2d30 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3bd77fe640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3bdc06bbd0 0x7f3bdc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3be008aae0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3bd77fe640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f3bdc073d70 0x7f3bdc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3be0022e50 con 0x7f3bdc073d70 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3bdc06bbd0 0x7f3bdc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3bef7fe640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f3bdc073d70 0x7f3bdc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3be00550d0 con 0x7f3bf00b2d30 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3b1d81e640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b18163460 0x7f3b18147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3b1d01d640 1 -- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b18163460 msgr2=0x7f3b18147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18156f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3b1d01d640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b18163460 0x7f3b18147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.111 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7f3b1d01d640 1 -- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 msgr2=0x7f3b18156f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd00408aeb0 con 0x7fd0140c6470 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fcffbfff640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7fd000073e20 0x7fd000076240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd004013e50 con 0x7fd000073e20 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.074+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fd00408b2a0 con 0x7fd0140c6470 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7fd012ffd640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd00006bc00 0x7fd00006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.075+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7fd000073e20 0x7fd000076240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7a4804f5b0 con 0x7f7a48140670 2024-03-18T15:00:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b1d01d640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18156f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b1d01d640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b181579c0 con 0x7f3b18072c80 2024-03-18T15:00:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b180d0620 0x7f3b18156f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:59.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f25e04b5640 1 Processor -- start 2024-03-18T15:00:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7fd0137fe640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7fd000073e20 0x7fd000076240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f25e04b5640 1 -- start start 2024-03-18T15:00:59.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7fd012ffd640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd00006bc00 0x7fd00006e0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd014163ad0 tx=0x7fd0080090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3bee7fc640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3bdc06bbd0 0x7f3bdc06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b53f0 tx=0x7f3be4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b1d01d640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 0x7f3b1815ad20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000caf0 tx=0x7f3b10002120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3bef7fe640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f3bdc073d70 0x7f3bdc076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7feafe8b5640 1 -- 172.21.15.152:0/1363989707 shutdown_connections 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7feafe8b5640 1 -- 172.21.15.152:0/1363989707 wait complete. 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b10018070 con 0x7f3b18072c80 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.076+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1000a760 con 0x7f3b18072c80 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b18157ca0 con 0x7f3b18072c80 2024-03-18T15:00:59.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1000ab90 con 0x7f3b18072c80 2024-03-18T15:00:59.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7a3c01a070 con 0x7f7a48140670 2024-03-18T15:00:59.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== osd.7 v2:172.21.15.186:6816/2838791468 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd004013e50 con 0x7fd000073e20 2024-03-18T15:00:59.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f7a36ffd640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2806bc20 0x7f7a2806e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7a3c089d60 con 0x7f7a48140670 2024-03-18T15:00:59.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f7a36ffd640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7f7a28073e20 0x7f7a28076240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7a280768f0 con 0x7f7a28073e20 2024-03-18T15:00:59.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== osd.4 v2:172.21.15.186:6800/4143159879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3be0022e50 con 0x7f3bdc073d70 2024-03-18T15:00:59.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b18158260 con 0x7f3b18072c80 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f25e04b5640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f25d80cfd60 0x7f25d80cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.077+0000 7f25e04b5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f25d806d650 0x7f25d806dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25e04b5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25d806e000 con 0x7f25d80c4e30 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25e04b5640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f25d806c2d0 con 0x7f25d80cfd60 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25e04b5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f25d806c5b0 con 0x7f25d806d650 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25de251640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f25d80c4e30 0x7f25d80c5210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53244/0 (socket says 172.21.15.152:53244) 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25de251640 1 -- 172.21.15.152:0/2312169430 learned_addr learned my addr 172.21.15.152:0/2312169430 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25dda50640 1 --2- 172.21.15.152:0/2312169430 >> v2:172.21.15.152:3300/0 conn(0x7f25d80cfd60 0x7f25d80cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f7a3c054480 con 0x7f7a48140670 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7f7a28073e20 0x7f7a28076240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7feafe8b5640 1 Processor -- start 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7feafe8b5640 1 -- start start 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25dda50640 1 -- 172.21.15.152:0/2312169430 >> v2:172.21.15.186:3300/0 conn(0x7f25d806d650 msgr2=0x7f25d806dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25dda50640 1 --2- 172.21.15.152:0/2312169430 >> v2:172.21.15.186:3300/0 conn(0x7f25d806d650 0x7f25d806dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25dda50640 1 -- 172.21.15.152:0/2312169430 >> v1:172.21.15.152:6789/0 conn(0x7f25d80c4e30 legacy=0x7f25d80c5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.078+0000 7f25dda50640 1 -- 172.21.15.152:0/2312169430 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d806c890 con 0x7f25d80cfd60 2024-03-18T15:00:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f7a4659c640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2806bc20 0x7f7a2806e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f25dda50640 1 --2- 172.21.15.152:0/2312169430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d80cfd60 0x7f25d80cc4b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25d806ef70 tx=0x7f25c802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdf5ccbd30d4f752 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3b100070d0 con 0x7f3b18072c80 2024-03-18T15:00:59.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.079+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3b1804f540 con 0x7f3b18072c80 2024-03-18T15:00:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf806efe0 0x7feaf81f7800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 0x7feaf8155300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f7a45d9b640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7f7a28073e20 0x7f7a28076240 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf80d08c0 0x7feaf80ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f25dd24f640 1 -- 172.21.15.152:0/2312169430 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80315a0 con 0x7f25d80cfd60 2024-03-18T15:00:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 0x7feaf8155300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 0x7feaf8155300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43562/0 (socket says 172.21.15.152:43562) 2024-03-18T15:00:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feaf77fe640 1 -- 172.21.15.152:0/966302061 learned_addr learned my addr 172.21.15.152:0/966302061 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f25dd24f640 1 -- 172.21.15.152:0/2312169430 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25c8037070 con 0x7f25d80cfd60 2024-03-18T15:00:59.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b0dffb640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3afc06bc00 0x7f3afc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f25dd24f640 1 -- 172.21.15.152:0/2312169430 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c80315a0 con 0x7f25d80cfd60 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafce52640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf80d08c0 0x7feaf80ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feaf80ae230 con 0x7feaf806efe0 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feaf80721a0 con 0x7feaf80d08c0 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3afc06bc00 0x7f3afc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b1008a2c0 con 0x7f3b18072c80 2024-03-18T15:00:59.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feaf80ae3b0 con 0x7feaf8072810 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b0dffb640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f3afc073e20 0x7f3afc076240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3afc0768f0 con 0x7f3afc073e20 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f3b10091050 con 0x7f3b18072c80 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 -- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf80d08c0 msgr2=0x7feaf80ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feaf80d08c0 0x7feaf80ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 -- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf806efe0 msgr2=0x7feaf81f7800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7f25e04b5640 1 -- 172.21.15.152:0/2312169430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d80cfd60 msgr2=0x7f25d80cc4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7f25e04b5640 1 --2- 172.21.15.152:0/2312169430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d80cfd60 0x7f25d80cc4b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f25d806ef70 tx=0x7f25c802b840 comp rx=0 tx=0).stop 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.080+0000 7f7a4659c640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2806bc20 0x7f7a2806e0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f60 tx=0x7f7a38009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== osd.0 v2:172.21.15.152:6804/3028176000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7a280768f0 con 0x7f7a28073e20 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf7fff640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf806efe0 0x7feaf81f7800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf806efe0 0x7feaf81f7800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8155ce0 con 0x7feaf8072810 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf7fff640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feaf806efe0 0x7feaf81f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7f3b1c81c640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3afc06bc00 0x7f3afc06e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b08034000 tx=0x7f3b08008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf77fe640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 0x7feaf8155300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feaec009890 tx=0x7feaec0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.081+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec049070 con 0x7feaf8072810 2024-03-18T15:00:59.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.082+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feaec031ea0 con 0x7feaf8072810 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.082+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf8155fc0 con 0x7feaf8072810 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.082+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec032860 con 0x7feaf8072810 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.082+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf81f72e0 con 0x7feaf8072810 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.082+0000 7f3b1d81e640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f3afc073e20 0x7f3afc076240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 -- 172.21.15.152:0/2312169430 shutdown_connections 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 --2- 172.21.15.152:0/2312169430 >> v2:172.21.15.186:3300/0 conn(0x7f25d806d650 0x7f25d806dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 --2- 172.21.15.152:0/2312169430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d80cfd60 0x7f25d80cc4b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 -- 172.21.15.152:0/2312169430 >> 172.21.15.152:0/2312169430 conn(0x7f25d80d1e60 msgr2=0x7f25d80d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 -- 172.21.15.152:0/2312169430 shutdown_connections 2024-03-18T15:00:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f25e04b5640 1 -- 172.21.15.152:0/2312169430 wait complete. 2024-03-18T15:00:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fead8001030 con 0x7feaf8072810 2024-03-18T15:00:59.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.083+0000 7f3b1d81e640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f3afc073e20 0x7f3afc076240 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.084+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feaec032a00 con 0x7feaf8072810 2024-03-18T15:00:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.085+0000 7feaf4ff9640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feae406bbd0 0x7feae406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.085+0000 7f25e04b5640 1 Processor -- start 2024-03-18T15:00:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.085+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feaec0ac460 con 0x7feaf8072810 2024-03-18T15:00:59.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.085+0000 7feaf7fff640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feae406bbd0 0x7feae406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== osd.5 v2:172.21.15.186:6824/1793138665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3afc0768f0 con 0x7f3afc073e20 2024-03-18T15:00:59.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.085+0000 7f25e04b5640 1 -- start start 2024-03-18T15:00:59.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7feaf4ff9640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7feae4073d70 0x7feae4076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.132 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7f25e04b5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 0x7f25d80c7ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7feafce52640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7feae4073d70 0x7feae4076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7f25e04b5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25d80c4e30 0x7f25d80c5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7f25de251640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 0x7f25d80c7ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.086+0000 7f25de251640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 0x7f25d80c7ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34372/0 (socket says 172.21.15.152:34372) 2024-03-18T15:00:59.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25e04b5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 0x7f25d81585f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7feaec030e50 con 0x7feae4073d70 2024-03-18T15:00:59.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7feaec0b3050 con 0x7feaf8072810 2024-03-18T15:00:59.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7feaf7fff640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feae406bbd0 0x7feae406e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feaf0004570 tx=0x7feaf0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25dda50640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25d80c4e30 0x7f25d80c5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25dea52640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 0x7f25d81585f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25dea52640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 0x7f25d81585f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43568/0 (socket says 172.21.15.152:43568) 2024-03-18T15:00:59.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25dda50640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25d80c4e30 0x7f25d80c5960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50750/0 (socket says 172.21.15.152:50750) 2024-03-18T15:00:59.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7feafce52640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7feae4073d70 0x7feae4076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25e04b5640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f25d80d2b10 con 0x7f25d806d650 2024-03-18T15:00:59.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== osd.1 v2:172.21.15.152:6800/1305469316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7feaec030e50 con 0x7feae4073d70 2024-03-18T15:00:59.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25e04b5640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25d806ce50 con 0x7f25d80c4e30 2024-03-18T15:00:59.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25e04b5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f25d80d2c90 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.087+0000 7f25de251640 1 -- 172.21.15.152:0/1317364571 learned_addr learned my addr 172.21.15.152:0/1317364571 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 -- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25d80c4e30 msgr2=0x7f25d80c5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25d80c4e30 0x7f25d80c5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 -- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 msgr2=0x7f25d80c7ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 0x7f25d80c7ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d80c5f80 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25de251640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25d806d650 0x7f25d80c7ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25dea52640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 0x7f25d81585f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009f80 tx=0x7f25d000be60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.088+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d002a070 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.089+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25d0025440 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.090+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25d0025830 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.090+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d80c6260 con 0x7f25d80cfd60 2024-03-18T15:00:59.138 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.090+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d80c6820 con 0x7f25d80cfd60 2024-03-18T15:00:59.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.095+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 --> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca4814ebf0 con 0x7fca2c073dc0 2024-03-18T15:00:59.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.096+0000 7fca3e7fc640 1 -- 172.21.15.152:0/593728687 <== osd.3 v2:172.21.15.152:6824/602992539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fca4814ebf0 con 0x7fca2c073dc0 2024-03-18T15:00:59.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fca2c073dc0 msgr2=0x7fca2c0761e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7fca33fff640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fca2c073dc0 0x7fca2c0761e0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f25d002d070 con 0x7f25d80cfd60 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7f25ceffd640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25bc06bbd0 0x7f25bc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f25d804f5b0 con 0x7f25d80cfd60 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.097+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f25d009b9b0 con 0x7f25d80cfd60 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.098+0000 7f25ceffd640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f25bc073d70 0x7f25bc076190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.098+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f25d0025440 con 0x7f25bc073d70 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.098+0000 7f25de251640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25bc06bbd0 0x7f25bc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.098+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7f25d00660e0 con 0x7f25d80cfd60 2024-03-18T15:00:59.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.098+0000 7f25dda50640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f25bc073d70 0x7f25bc076190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca2c06bc20 msgr2=0x7fca2c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca2c06bc20 0x7fca2c06e0e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fca4806dbb0 tx=0x7fca400077b0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 msgr2=0x7fca4814c870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 --2- 172.21.15.152:0/593728687 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca48069050 0x7fca4814c870 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fca4400c4d0 tx=0x7fca4400c990 comp rx=0 tx=0).stop 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca4e771640 1 -- 172.21.15.152:0/593728687 reap_dead start 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 shutdown_connections 2024-03-18T15:00:59.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 >> 172.21.15.152:0/593728687 conn(0x7fca480b1bd0 msgr2=0x7fca480d03b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.099+0000 7f25dda50640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f25bc073d70 0x7f25bc076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.100+0000 7f25de251640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25bc06bbd0 0x7f25bc06e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25d4007d50 tx=0x7f25d4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.101+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 shutdown_connections 2024-03-18T15:00:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.101+0000 7fca33fff640 1 -- 172.21.15.152:0/593728687 wait complete. 2024-03-18T15:00:59.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.101+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== osd.6 v2:172.21.15.186:6808/2621081910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f25d0025440 con 0x7f25bc073d70 2024-03-18T15:00:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.108+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 --> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdc5c002dd0 con 0x7fdc68073f20 2024-03-18T15:00:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.108+0000 7fdc63fff640 1 -- 172.21.15.152:0/541916902 <== osd.2 v2:172.21.15.152:6812/2040307032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdc5c002dd0 con 0x7fdc68073f20 2024-03-18T15:00:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 --> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3b18161f80 con 0x7f3afc073e20 2024-03-18T15:00:59.143 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 --> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd014201240 con 0x7fd000073e20 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7fdc68073f20 msgr2=0x7fdc68076340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7fdc68073f20 0x7fdc68076340 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc6806bca0 msgr2=0x7fdc6806e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc6806bca0 0x7fdc6806e160 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c006fd0 tx=0x7fdc6c0090e0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 msgr2=0x7fdc7c15b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fdc81c27640 1 --2- 172.21.15.152:0/541916902 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc7c15ea30 0x7fdc7c15b590 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdc7c0b3b00 tx=0x7fdc74004a40 comp rx=0 tx=0).stop 2024-03-18T15:00:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 --> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7a4806c840 con 0x7f7a28073e20 2024-03-18T15:00:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.109+0000 7fcffbfff640 1 -- 172.21.15.152:0/1956097290 <== osd.7 v2:172.21.15.186:6816/2838791468 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd014201240 con 0x7fd000073e20 2024-03-18T15:00:59.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7f7a36ffd640 1 -- 172.21.15.152:0/1158606876 <== osd.0 v2:172.21.15.152:6804/3028176000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7a4806c840 con 0x7f7a28073e20 2024-03-18T15:00:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fdc7bfff640 1 -- 172.21.15.152:0/541916902 reap_dead start 2024-03-18T15:00:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 shutdown_connections 2024-03-18T15:00:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 >> 172.21.15.152:0/541916902 conn(0x7fdc7c0b2a40 msgr2=0x7fdc7c0b2e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7fd000073e20 msgr2=0x7fd000076240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.146 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7fd000073e20 0x7fd000076240 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7f7a28073e20 msgr2=0x7f7a28076240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7f7a4caf1640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7f7a28073e20 0x7f7a28076240 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd00006bc00 msgr2=0x7fd00006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd00006bc00 0x7fd00006e0c0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fd014163ad0 tx=0x7fd0080090e0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0140c6470 msgr2=0x7fd0141600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fcff9ffb640 1 --2- 172.21.15.152:0/1956097290 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd0140c6470 0x7fd0141600b0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd00400e770 tx=0x7fd00400eb70 comp rx=0 tx=0).stop 2024-03-18T15:00:59.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fd0137fe640 1 -- 172.21.15.152:0/1956097290 reap_dead start 2024-03-18T15:00:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 shutdown_connections 2024-03-18T15:00:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2806bc20 msgr2=0x7f7a2806e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.110+0000 7f7a4caf1640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2806bc20 0x7f7a2806e0e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7a38000f60 tx=0x7f7a38009040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 msgr2=0x7f7a481363b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 --2- 172.21.15.152:0/1158606876 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a48140670 0x7f7a481363b0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7a3c00c400 tx=0x7f7a3c00c8c0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7fdc81c27640 1 -- 172.21.15.152:0/541916902 wait complete. 2024-03-18T15:00:59.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 shutdown_connections 2024-03-18T15:00:59.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 >> 172.21.15.152:0/1956097290 conn(0x7fd0140d1ea0 msgr2=0x7fd0140d2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.149 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 shutdown_connections 2024-03-18T15:00:59.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7fcff9ffb640 1 -- 172.21.15.152:0/1956097290 wait complete. 2024-03-18T15:00:59.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a46d9d640 1 -- 172.21.15.152:0/1158606876 reap_dead start 2024-03-18T15:00:59.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 shutdown_connections 2024-03-18T15:00:59.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 >> 172.21.15.152:0/1158606876 conn(0x7f7a480b2680 msgr2=0x7f7a480b4e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 shutdown_connections 2024-03-18T15:00:59.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.111+0000 7f7a4caf1640 1 -- 172.21.15.152:0/1158606876 wait complete. 2024-03-18T15:00:59.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.115+0000 7f3b0dffb640 1 -- 172.21.15.152:0/2114540371 <== osd.5 v2:172.21.15.186:6824/1793138665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3b18161f80 con 0x7f3afc073e20 2024-03-18T15:00:59.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.115+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 --> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bf009cc20 con 0x7f3bdc073d70 2024-03-18T15:00:59.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.116+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f3afc073e20 msgr2=0x7f3afc076240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.116+0000 7f3b1e01f640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f3afc073e20 0x7f3afc076240 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3afc06bc00 msgr2=0x7f3afc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3afc06bc00 0x7f3afc06e0c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3b08034000 tx=0x7f3b08008030 comp rx=0 tx=0).stop 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 msgr2=0x7f3b1815ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 --2- 172.21.15.152:0/2114540371 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b18072c80 0x7f3b1815ad20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b1000caf0 tx=0x7f3b10002120 comp rx=0 tx=0).stop 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1d81e640 1 -- 172.21.15.152:0/2114540371 reap_dead start 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 shutdown_connections 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 >> 172.21.15.152:0/2114540371 conn(0x7f3b1806b5e0 msgr2=0x7f3b1806b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.117+0000 7f3bd77fe640 1 -- 172.21.15.152:0/4291980074 <== osd.4 v2:172.21.15.186:6800/4143159879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bf009cc20 con 0x7f3bdc073d70 2024-03-18T15:00:59.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.119+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 shutdown_connections 2024-03-18T15:00:59.154 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.119+0000 7f3b1e01f640 1 -- 172.21.15.152:0/2114540371 wait complete. 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.119+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f3bdc073d70 msgr2=0x7f3bdc076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.119+0000 7f3bd57fa640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f3bdc073d70 0x7f3bdc076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3bdc06bbd0 msgr2=0x7f3bdc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3bdc06bbd0 0x7f3bdc06e090 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3bf00b53f0 tx=0x7f3be4008030 comp rx=0 tx=0).stop 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 msgr2=0x7f3bf016ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 --2- 172.21.15.152:0/4291980074 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3bf00b2d30 0x7f3bf016ebd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3be0009fd0 tx=0x7f3be000ed40 comp rx=0 tx=0).stop 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bef7fe640 1 -- 172.21.15.152:0/4291980074 reap_dead start 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 shutdown_connections 2024-03-18T15:00:59.155 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.120+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 >> 172.21.15.152:0/4291980074 conn(0x7f3bf006b1c0 msgr2=0x7f3bf00af130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.156 INFO:teuthology.orchestra.run.smithi152.stdout:64424509448 2024-03-18T15:00:59.157 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T15:00:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.121+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 shutdown_connections 2024-03-18T15:00:59.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.121+0000 7f3bd57fa640 1 -- 172.21.15.152:0/4291980074 wait complete. 2024-03-18T15:00:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.121+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 --> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fead8002dd0 con 0x7feae4073d70 2024-03-18T15:00:59.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.122+0000 7feaf4ff9640 1 -- 172.21.15.152:0/966302061 <== osd.1 v2:172.21.15.152:6800/1305469316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fead8002dd0 con 0x7feae4073d70 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.123+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7feae4073d70 msgr2=0x7feae4076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7feae4073d70 0x7feae4076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feae406bbd0 msgr2=0x7feae406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feae406bbd0 0x7feae406e090 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7feaf0004570 tx=0x7feaf0009040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 msgr2=0x7feaf8155300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 --2- 172.21.15.152:0/966302061 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feaf8072810 0x7feaf8155300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7feaec009890 tx=0x7feaec0046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafce52640 1 -- 172.21.15.152:0/966302061 reap_dead start 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 shutdown_connections 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.124+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 >> 172.21.15.152:0/966302061 conn(0x7feaf806b5e0 msgr2=0x7feaf80b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.126+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 shutdown_connections 2024-03-18T15:00:59.160 INFO:teuthology.orchestra.run.smithi152.stdout:60129542152 2024-03-18T15:00:59.160 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-18T15:00:59.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.130+0000 7feafe8b5640 1 -- 172.21.15.152:0/966302061 wait complete. 2024-03-18T15:00:59.161 INFO:teuthology.orchestra.run.smithi152.stdout:55834574856 2024-03-18T15:00:59.162 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T15:00:59.162 INFO:teuthology.orchestra.run.smithi152.stdout:64424509449 2024-03-18T15:00:59.163 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T15:00:59.163 INFO:teuthology.orchestra.run.smithi152.stdout:60129542151 2024-03-18T15:00:59.164 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-18T15:00:59.165 INFO:teuthology.orchestra.run.smithi152.stdout:60129542150 2024-03-18T15:00:59.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-18T15:00:59.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.143+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 --> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f25d80b27b0 con 0x7f25bc073d70 2024-03-18T15:00:59.166 INFO:teuthology.orchestra.run.smithi152.stdout:64424509448 2024-03-18T15:00:59.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T15:00:59.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25ceffd640 1 -- 172.21.15.152:0/1317364571 <== osd.6 v2:172.21.15.186:6808/2621081910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f25d80b27b0 con 0x7f25bc073d70 2024-03-18T15:00:59.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f25bc073d70 msgr2=0x7f25bc076190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f25bc073d70 0x7f25bc076190 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25bc06bbd0 msgr2=0x7f25bc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25bc06bbd0 0x7f25bc06e090 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f25d4007d50 tx=0x7f25d4009040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 msgr2=0x7f25d81585f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 --2- 172.21.15.152:0/1317364571 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25d80cfd60 0x7f25d81585f0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f25d0009f80 tx=0x7f25d000be60 comp rx=0 tx=0).stop 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25dea52640 1 -- 172.21.15.152:0/1317364571 reap_dead start 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 shutdown_connections 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 >> 172.21.15.152:0/1317364571 conn(0x7f25d80d1e60 msgr2=0x7f25d80cd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 shutdown_connections 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.144+0000 7f25e04b5640 1 -- 172.21.15.152:0/1317364571 wait complete. 2024-03-18T15:00:59.169 INFO:teuthology.orchestra.run.smithi152.stdout:60129542151 2024-03-18T15:00:59.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-18T15:00:59.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.372+0000 7f0586052640 1 Processor -- start 2024-03-18T15:00:59.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.372+0000 7f0586052640 1 -- start start 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.372+0000 7fd214427640 1 Processor -- start 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.372+0000 7fd214427640 1 -- start start 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7fd2121c3640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd20c16ad10 0x7fd20c08b370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53260/0 (socket says 172.21.15.152:53260) 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7fd2121c3640 1 -- 172.21.15.152:0/2075688365 learned_addr learned my addr 172.21.15.152:0/2075688365 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fd214427640 1 --2- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 0x7fd20c0ca7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fd214427640 1 --2- 172.21.15.152:0/2075688365 >> v2:172.21.15.186:3300/0 conn(0x7fd20c0cad20 0x7fd20c0cdfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fd2119c2640 1 --2- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 0x7fd20c0ca7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd20c06cc50 con 0x7fd20c16ad10 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f69a51f4640 1 Processor -- start 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f69a51f4640 1 -- start start 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f69a51f4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f69a008b9e0 0x7f69a00b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f69a51f4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a008bdc0 con 0x7f69a00b3440 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f69a51f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69a006d230 con 0x7f69a006cc70 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f69a51f4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f69a006d510 con 0x7f69a008b9e0 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f699f59e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f69a00b3440 0x7f69a0071890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:53268/0 (socket says 172.21.15.152:53268) 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f699f59e640 1 -- 172.21.15.152:0/1205750503 learned_addr learned my addr 172.21.15.152:0/1205750503 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f699ed9d640 1 --2- 172.21.15.152:0/1205750503 >> v2:172.21.15.186:3300/0 conn(0x7f69a008b9e0 0x7f69a00b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f058014c220 0x7f058006b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0580070530 0x7f058006b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f05800b5e40 con 0x7f0580070530 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f05800b4ac0 con 0x7f058014c220 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7f0586052640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f05800b4da0 con 0x7f05800b3ba0 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0580070530 0x7f058006b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0580070530 0x7f058006b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34384/0 (socket says 172.21.15.152:34384) 2024-03-18T15:00:59.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 -- 172.21.15.152:0/399060319 learned_addr learned my addr 172.21.15.152:0/399060319 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 -- 172.21.15.152:0/399060319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 msgr2=0x7f058006de40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 --2- 172.21.15.152:0/399060319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058006de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 -- 172.21.15.152:0/399060319 >> v2:172.21.15.186:3300/0 conn(0x7f058014c220 msgr2=0x7f058006b1c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 --2- 172.21.15.152:0/399060319 >> v2:172.21.15.186:3300/0 conn(0x7f058014c220 0x7f058006b1c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.374+0000 7f057effd640 1 -- 172.21.15.152:0/399060319 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05800b5080 con 0x7f0580070530 2024-03-18T15:00:59.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7f057effd640 1 --2- 172.21.15.152:0/399060319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0580070530 0x7f058006b700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f058006dc20 tx=0x7f057802c170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48d42a219ee6f26 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2129c4640 1 --2- 172.21.15.152:0/2075688365 >> v2:172.21.15.186:3300/0 conn(0x7fd20c0cad20 0x7fd20c0cdfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd20c0cb530 con 0x7fd20c0cad20 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2111c1640 1 -- 172.21.15.152:0/2075688365 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2243061933 0 0) 0x7fd20c06cc50 con 0x7fd20c16ad10 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0cb810 con 0x7fd20c08ba80 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7f057e7fc640 1 -- 172.21.15.152:0/399060319 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f057802cb10 con 0x7f0580070530 2024-03-18T15:00:59.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7f699ed9d640 1 -- 172.21.15.152:0/1205750503 >> v1:172.21.15.186:6789/0 conn(0x7f69a006cc70 legacy=0x7f69a00b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7f699ed9d640 1 -- 172.21.15.152:0/1205750503 >> v1:172.21.15.152:6789/0 conn(0x7f69a00b3440 legacy=0x7f69a0071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7f699ed9d640 1 -- 172.21.15.152:0/1205750503 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a006d7f0 con 0x7f69a008b9e0 2024-03-18T15:00:59.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7f057e7fc640 1 -- 172.21.15.152:0/399060319 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f057802ccb0 con 0x7f0580070530 2024-03-18T15:00:59.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2111c1640 1 -- 172.21.15.152:0/2075688365 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd1f8004630 con 0x7fd20c16ad10 2024-03-18T15:00:59.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f699ed9d640 1 --2- 172.21.15.152:0/1205750503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a008b9e0 0x7f69a00b4ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6990009640 tx=0x7f699002c7b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=882e5aa595cb3b92 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2119c2640 1 -- 172.21.15.152:0/2075688365 >> v2:172.21.15.186:3300/0 conn(0x7fd20c0cad20 msgr2=0x7fd20c0cdfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 -- 172.21.15.152:0/399060319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0580070530 msgr2=0x7f058006b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 --2- 172.21.15.152:0/399060319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0580070530 0x7f058006b700 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f058006dc20 tx=0x7f057802c170 comp rx=0 tx=0).stop 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2119c2640 1 --2- 172.21.15.152:0/2075688365 >> v2:172.21.15.186:3300/0 conn(0x7fd20c0cad20 0x7fd20c0cdfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7fa3b145d640 1 Processor -- start 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.373+0000 7fa3b145d640 1 -- start start 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3b145d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa3a40dfef0 0x7fa3a40085d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3b145d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa3a40e02d0 0x7fa3a40e3bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3b145d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a40e4510 con 0x7fa3a40e4100 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3b145d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a40094b0 con 0x7fa3a40dfef0 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3b145d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a4056590 con 0x7fa3a40e02d0 2024-03-18T15:00:59.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3abfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa3a40dfef0 0x7fa3a40085d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3abfff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa3a40dfef0 0x7fa3a40085d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34398/0 (socket says 172.21.15.152:34398) 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3abfff640 1 -- 172.21.15.152:0/3404877236 learned_addr learned my addr 172.21.15.152:0/3404877236 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.375+0000 7fa3ab7fe640 1 --2- 172.21.15.152:0/3404877236 >> v2:172.21.15.186:3300/0 conn(0x7fa3a40e02d0 0x7fa3a40e3bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fa3abfff640 1 -- 172.21.15.152:0/3404877236 >> v2:172.21.15.186:3300/0 conn(0x7fa3a40e02d0 msgr2=0x7fa3a40e3bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fa3abfff640 1 --2- 172.21.15.152:0/3404877236 >> v2:172.21.15.186:3300/0 conn(0x7fa3a40e02d0 0x7fa3a40e3bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fa3abfff640 1 -- 172.21.15.152:0/3404877236 >> v1:172.21.15.186:6789/0 conn(0x7fa3a40e4100 legacy=0x7fa3a403a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fa3abfff640 1 -- 172.21.15.152:0/3404877236 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4056870 con 0x7fa3a40dfef0 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7fa3abfff640 1 --2- 172.21.15.152:0/3404877236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40dfef0 0x7fa3a40085d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400eaf0 tx=0x7fa3a002ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410b31100758a7f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2119c2640 1 -- 172.21.15.152:0/2075688365 >> v1:172.21.15.152:6789/0 conn(0x7fd20c16ad10 legacy=0x7fd20c08b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.376+0000 7fd2119c2640 1 -- 172.21.15.152:0/2075688365 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c0cd7c0 con 0x7fd20c08ba80 2024-03-18T15:00:59.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f699dd9b640 1 -- 172.21.15.152:0/1205750503 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990039070 con 0x7f69a008b9e0 2024-03-18T15:00:59.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 -- 172.21.15.152:0/399060319 shutdown_connections 2024-03-18T15:00:59.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 --2- 172.21.15.152:0/399060319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 --2- 172.21.15.152:0/399060319 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0580070530 0x7f058006b700 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.385 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 --2- 172.21.15.152:0/399060319 >> v2:172.21.15.186:3300/0 conn(0x7f058014c220 0x7f058006b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f0586052640 1 -- 172.21.15.152:0/399060319 >> 172.21.15.152:0/399060319 conn(0x7f05800d0d30 msgr2=0x7f05800d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f699dd9b640 1 -- 172.21.15.152:0/1205750503 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6990007690 con 0x7f69a008b9e0 2024-03-18T15:00:59.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.377+0000 7f699dd9b640 1 -- 172.21.15.152:0/1205750503 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990007a60 con 0x7f69a008b9e0 2024-03-18T15:00:59.386 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fd2119c2640 1 --2- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 0x7fd20c0ca7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097a0 tx=0x7fd1fc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a312de0fcb18d371 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7f0586052640 1 -- 172.21.15.152:0/399060319 shutdown_connections 2024-03-18T15:00:59.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7f0586052640 1 -- 172.21.15.152:0/399060319 wait complete. 2024-03-18T15:00:59.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fd2111c1640 1 -- 172.21.15.152:0/2075688365 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc035020 con 0x7fd20c08ba80 2024-03-18T15:00:59.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7f69a51f4640 1 -- 172.21.15.152:0/1205750503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a008b9e0 msgr2=0x7f69a00b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7f69a51f4640 1 --2- 172.21.15.152:0/1205750503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a008b9e0 0x7f69a00b4ca0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6990009640 tx=0x7f699002c7b0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f69a51f4640 1 -- 172.21.15.152:0/1205750503 shutdown_connections 2024-03-18T15:00:59.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f69a51f4640 1 --2- 172.21.15.152:0/1205750503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a008b9e0 0x7f69a00b4ca0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f69a51f4640 1 -- 172.21.15.152:0/1205750503 >> 172.21.15.152:0/1205750503 conn(0x7f69a006b1c0 msgr2=0x7f69a006b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fd2111c1640 1 -- 172.21.15.152:0/2075688365 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd1fc031830 con 0x7fd20c08ba80 2024-03-18T15:00:59.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fd2111c1640 1 -- 172.21.15.152:0/2075688365 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1fc031c40 con 0x7fd20c08ba80 2024-03-18T15:00:59.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 msgr2=0x7fd20c0ca7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fd214427640 1 --2- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 0x7fd20c0ca7e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc0097a0 tx=0x7fd1fc02b8d0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fa3aaffd640 1 -- 172.21.15.152:0/3404877236 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a002f870 con 0x7fa3a40dfef0 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.378+0000 7fa3aaffd640 1 -- 172.21.15.152:0/3404877236 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a002fa10 con 0x7fa3a40dfef0 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 -- 172.21.15.152:0/3404877236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40dfef0 msgr2=0x7fa3a40085d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 --2- 172.21.15.152:0/3404877236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40dfef0 0x7fa3a40085d0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400eaf0 tx=0x7fa3a002ba50 comp rx=0 tx=0).stop 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 -- 172.21.15.152:0/3404877236 shutdown_connections 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 --2- 172.21.15.152:0/3404877236 >> v2:172.21.15.186:3300/0 conn(0x7fa3a40e02d0 0x7fa3a40e3bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 --2- 172.21.15.152:0/3404877236 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40dfef0 0x7fa3a40085d0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 -- 172.21.15.152:0/3404877236 >> 172.21.15.152:0/3404877236 conn(0x7fa3a401ef40 msgr2=0x7fa3a4055c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 -- 172.21.15.152:0/3404877236 shutdown_connections 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7fa3b145d640 1 -- 172.21.15.152:0/3404877236 wait complete. 2024-03-18T15:00:59.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f0586052640 1 Processor -- start 2024-03-18T15:00:59.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.380+0000 7f0586052640 1 -- start start 2024-03-18T15:00:59.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f69a51f4640 1 -- 172.21.15.152:0/1205750503 shutdown_connections 2024-03-18T15:00:59.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.379+0000 7f69a51f4640 1 -- 172.21.15.152:0/1205750503 wait complete. 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.380+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 shutdown_connections 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.380+0000 7fd214427640 1 --2- 172.21.15.152:0/2075688365 >> v2:172.21.15.186:3300/0 conn(0x7fd20c0cad20 0x7fd20c0cdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.380+0000 7fd214427640 1 --2- 172.21.15.152:0/2075688365 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c08ba80 0x7fd20c0ca7e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.380+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 >> 172.21.15.152:0/2075688365 conn(0x7fd20c0cfa50 msgr2=0x7fd20c0cfe60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 shutdown_connections 2024-03-18T15:00:59.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7fd214427640 1 -- 172.21.15.152:0/2075688365 wait complete. 2024-03-18T15:00:59.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f0586052640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f0586052640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058013ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f69a51f4640 1 Processor -- start 2024-03-18T15:00:59.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f69a51f4640 1 -- start start 2024-03-18T15:00:59.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f0586052640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 0x7f05800cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f057f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f057f7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50782/0 (socket says 172.21.15.152:50782) 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f057f7fe640 1 -- 172.21.15.152:0/2866403693 learned_addr learned my addr 172.21.15.152:0/2866403693 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f057ffff640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 0x7f05800cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f057effd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058013ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.382+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f05800b5920 con 0x7f058014c220 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.382+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f05800b5640 con 0x7f0580070530 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.382+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f058006f070 con 0x7f05800b3ba0 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7fa3b145d640 1 Processor -- start 2024-03-18T15:00:59.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7fa3b145d640 1 -- start start 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f69a51f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 0x7f69a009d260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.382+0000 7fa3b145d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b145d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 0x7fa3a40e0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3abfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3abfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43602/0 (socket says 172.21.15.152:43602) 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3abfff640 1 -- 172.21.15.152:0/1306173336 learned_addr learned my addr 172.21.15.152:0/1306173336 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b145d640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3a4051d00 0x7fa3a4052190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4056b50 con 0x7fa3a40e06c0 2024-03-18T15:00:59.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a4009140 con 0x7fa3a4051d00 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa3a4008b10 con 0x7fa3a40e4100 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fd214427640 1 Processor -- start 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f4ec2c6c640 1 Processor -- start 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.381+0000 7f4ec2c6c640 1 -- start start 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec2c6c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 0x7f4ebc1635f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec2c6c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc06d6b0 con 0x7f4ebc163210 2024-03-18T15:00:59.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec2c6c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ebc06d990 con 0x7f4ebc06f010 2024-03-18T15:00:59.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec2c6c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4ebc0b58c0 con 0x7f4ebc0b3c70 2024-03-18T15:00:59.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec1209640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f4ebc06f010 0x7f4ebc06b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:43098/0 (socket says 172.21.15.152:43098) 2024-03-18T15:00:59.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ec1209640 1 -- 172.21.15.152:0/2367278535 learned_addr learned my addr 172.21.15.152:0/2367278535 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fd214427640 1 -- start start 2024-03-18T15:00:59.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7fa3b0c5c640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3a4051d00 0x7fa3a4052190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ebbfff640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 0x7f4ebc1635f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1570673833 0 0) 0x7f4ebc06d990 con 0x7f4ebc06f010 2024-03-18T15:00:59.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ea4003520 con 0x7f4ebc06f010 2024-03-18T15:00:59.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f057f7fe640 1 -- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 msgr2=0x7f058013ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3233700007 0 0) 0x7f4ebc06d6b0 con 0x7f4ebc163210 2024-03-18T15:00:59.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4ebc06d990 con 0x7f4ebc163210 2024-03-18T15:00:59.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f057f7fe640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058013ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7fa3ab7fe640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 0x7fa3a40e0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1595237769 0 0) 0x7f4ea4003520 con 0x7f4ebc06f010 2024-03-18T15:00:59.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 msgr2=0x7f4ebc1635f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 0x7f4ebc1635f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 >> v1:172.21.15.152:6789/0 conn(0x7f4ebc163210 legacy=0x7f4ebc0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc06dc70 con 0x7f4ebc06f010 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f4eb40019f0 con 0x7f4ebc06f010 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 >> v1:172.21.15.186:6789/0 conn(0x7f4ebc06f010 legacy=0x7f4ebc06b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ea4003bb0 0x7f4ea4003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f69a51f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f69a51f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a00b3440 0x7f69a009aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f69a51f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69a0071fa0 con 0x7f69a008b9e0 2024-03-18T15:00:59.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f69a51f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f69a00d04f0 con 0x7f69a00b3440 2024-03-18T15:00:59.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f69a51f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f69a0072120 con 0x7f69a006cc70 2024-03-18T15:00:59.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.383+0000 7f057f7fe640 1 -- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 msgr2=0x7f05800cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 0x7f4ea4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ea4004d40 0x7f4ea40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc0b58c0 con 0x7f4ea4004d40 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ea400bb50 con 0x7f4ea4003bb0 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ea4003bb0 0x7f4ea4003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4ea400bd20 con 0x7f4ebc0b3c70 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec1209640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ea4004d40 0x7f4ea40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7fd214427640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34444/0 (socket says 172.21.15.152:34444) 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd214427640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c0cad20 0x7fd20c168490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 -- 172.21.15.152:0/646598935 learned_addr learned my addr 172.21.15.152:0/646598935 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd214427640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd20c16ad10 0x7fd20c1689d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c0cb1d0 con 0x7fd20c08ba80 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f057f7fe640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 0x7f05800cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f057f7fe640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05800ce200 con 0x7f0580070530 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7f057effd640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:59.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7f057ffff640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 0x7f05800cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:00:59.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2119c2640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c0cad20 0x7fd20c168490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c16b0f0 con 0x7fd20c16ad10 2024-03-18T15:00:59.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd20c0ce500 con 0x7fd20c0cad20 2024-03-18T15:00:59.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 -- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 msgr2=0x7f4ea4004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc0b3c70 0x7f4ea4004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 -- 172.21.15.152:0/2367278535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ea4004d40 msgr2=0x7f4ea40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ea4004d40 0x7f4ea40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.384+0000 7f4ec0a08640 1 -- 172.21.15.152:0/2367278535 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc06dc70 con 0x7f4ea4003bb0 2024-03-18T15:00:59.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7f057f7fe640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f057000b480 tx=0x7f057000b940 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 -- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c0cad20 msgr2=0x7fd20c168490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c0cad20 0x7fd20c168490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 -- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd20c16ad10 msgr2=0x7fd20c1689d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd20c16ad10 0x7fd20c1689d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fd2121c3640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c16cbe0 con 0x7fd20c08ba80 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3abfff640 1 -- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3a4051d00 msgr2=0x7fa3a4052190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3abfff640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3a4051d00 0x7fa3a4052190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3abfff640 1 -- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 msgr2=0x7fa3a40e0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ea4003bb0 0x7f4ea4003fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0018a0 tx=0x7f4ea4005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fd6d9efeda1048cd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f699ed9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 0x7f69a009d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f699e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f699e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34454/0 (socket says 172.21.15.152:34454) 2024-03-18T15:00:59.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f699e59c640 1 -- 172.21.15.152:0/3784452018 learned_addr learned my addr 172.21.15.152:0/3784452018 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3abfff640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 0x7fa3a40e0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3abfff640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a4052bf0 con 0x7fa3a40e4100 2024-03-18T15:00:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.385+0000 7fa3ab7fe640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 0x7fa3a40e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7fa3abfff640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00090b0 tx=0x7fa3a00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac037070 con 0x7f4ea4003bb0 2024-03-18T15:00:59.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eac0050d0 con 0x7f4ea4003bb0 2024-03-18T15:00:59.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570014070 con 0x7f0580070530 2024-03-18T15:00:59.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0003a20 con 0x7fa3a40e4100 2024-03-18T15:00:59.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a4032ec0 con 0x7fa3a40e4100 2024-03-18T15:00:59.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f4ebb7fe640 1 -- 172.21.15.152:0/2367278535 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eac0014f0 con 0x7f4ea4003bb0 2024-03-18T15:00:59.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f699ed9d640 1 -- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a00b3440 msgr2=0x7f69a009aa50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T15:00:59.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f699ed9d640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a00b3440 0x7f69a009aa50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7fd2121c3640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd20800c400 tx=0x7fd20800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f699ed9d640 1 -- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 msgr2=0x7f69a01635d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f699ed9d640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f699ed9d640 1 -- 172.21.15.152:0/3784452018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69a0163b10 con 0x7f69a006cc70 2024-03-18T15:00:59.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05800ce4e0 con 0x7f0580070530 2024-03-18T15:00:59.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05801dd760 con 0x7f0580070530 2024-03-18T15:00:59.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd208017070 con 0x7fd20c08ba80 2024-03-18T15:00:59.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c16c060 con 0x7fd20c08ba80 2024-03-18T15:00:59.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c16c620 con 0x7fd20c08ba80 2024-03-18T15:00:59.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f699e59c640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:59.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0570010890 con 0x7f0580070530 2024-03-18T15:00:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570010c80 con 0x7f0580070530 2024-03-18T15:00:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ea4003bb0 msgr2=0x7f4ea4003fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/2367278535 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ea4003bb0 0x7f4ea4003fb0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4eac0018a0 tx=0x7f4ea4005830 comp rx=0 tx=0).stop 2024-03-18T15:00:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f4ec1209640 1 -- 172.21.15.152:0/2367278535 reap_dead start 2024-03-18T15:00:59.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/2367278535 shutdown_connections 2024-03-18T15:00:59.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/2367278535 >> 172.21.15.152:0/2367278535 conn(0x7f4ebc0d04d0 msgr2=0x7f4ebc0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd208005ce0 con 0x7fd20c08ba80 2024-03-18T15:00:59.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.386+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a4033480 con 0x7fa3a40e4100 2024-03-18T15:00:59.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.388+0000 7f699ed9d640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 0x7f69a009d260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69a00d0c50 tx=0x7f69900046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.387+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2080072f0 con 0x7fd20c08ba80 2024-03-18T15:00:59.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.388+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a0046070 con 0x7fa3a40e4100 2024-03-18T15:00:59.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.388+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0003dc0 con 0x7fa3a40e4100 2024-03-18T15:00:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.389+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990039050 con 0x7f69a006cc70 2024-03-18T15:00:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69a009d8d0 con 0x7f69a006cc70 2024-03-18T15:00:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.389+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0570017070 con 0x7f0580070530 2024-03-18T15:00:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f0567fff640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 0x7f056c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/2367278535 shutdown_connections 2024-03-18T15:00:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f69a016bed0 con 0x7f69a006cc70 2024-03-18T15:00:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa38c005290 con 0x7fa3a40e4100 2024-03-18T15:00:59.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f057008a970 con 0x7f0580070530 2024-03-18T15:00:59.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.389+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd20801a070 con 0x7fd20c08ba80 2024-03-18T15:00:59.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7fd202ffd640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 0x7fd1f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f057effd640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 0x7f056c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd208089e30 con 0x7fd20c08ba80 2024-03-18T15:00:59.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.391+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6990043070 con 0x7f69a006cc70 2024-03-18T15:00:59.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.391+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6990034be0 con 0x7f69a006cc70 2024-03-18T15:00:59.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.391+0000 7f057effd640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 0x7f056c06e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0578035000 tx=0x7f0578030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.391+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa3a002fbc0 con 0x7fa3a40e4100 2024-03-18T15:00:59.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6990048460 con 0x7f69a006cc70 2024-03-18T15:00:59.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7fa3a8ff9640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 0x7fa39006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.390+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/2367278535 wait complete. 2024-03-18T15:00:59.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7f4ec2c6c640 1 Processor -- start 2024-03-18T15:00:59.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7f4ec2c6c640 1 -- start start 2024-03-18T15:00:59.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7f69877fe640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 0x7f698c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa3a00ad3e0 con 0x7fa3a40e4100 2024-03-18T15:00:59.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.393+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f69900ac1f0 con 0x7f69a006cc70 2024-03-18T15:00:59.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.391+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1f4005290 con 0x7fd20c08ba80 2024-03-18T15:00:59.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7fd2119c2640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 0x7fd1f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.392+0000 7fd2119c2640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 0x7fd1f006e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc036000 tx=0x7fd1fc03e040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.393+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6980005290 con 0x7f69a006cc70 2024-03-18T15:00:59.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.393+0000 7fa3ab7fe640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 0x7fa39006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.393+0000 7f699e59c640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 0x7f698c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 0x7f4ebc15e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7fa3ab7fe640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 0x7fa39006e160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac069da0 tx=0x7fa3ac068fa0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc15d8b0 0x7f4ebc161580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 0x7f4ebc163a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc06e750 con 0x7f4ebc15e3c0 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ebc06e230 con 0x7f4ebc06c210 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec2c6c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4ebc1635f0 con 0x7f4ebc15d8b0 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec0a08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 0x7f4ebc15e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec0a08640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 0x7f4ebc15e7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34456/0 (socket says 172.21.15.152:34456) 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec0a08640 1 -- 172.21.15.152:0/3605142793 learned_addr learned my addr 172.21.15.152:0/3605142793 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 0x7f4ebc163a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ebbfff640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc15d8b0 0x7f4ebc161580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 -- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc15d8b0 msgr2=0x7f4ebc161580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc15d8b0 0x7f4ebc161580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 -- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 msgr2=0x7f4ebc15e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 0x7f4ebc15e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.394+0000 7f4ec1209640 1 -- 172.21.15.152:0/3605142793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ebc15ece0 con 0x7f4ebc06c210 2024-03-18T15:00:59.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f699e59c640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 0x7f698c06e160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69a016a330 tx=0x7f6998009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4ec1209640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 0x7f4ebc163a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0727a0 tx=0x7f4eb4007b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05800b1ea0 con 0x7f0580070530 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb400eb40 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb400ece0 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb40146a0 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ebc161ac0 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.395+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ebc160aa0 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.396+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ebc04f5b0 con 0x7f4ebc06c210 2024-03-18T15:00:59.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.397+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa3a0033030 con 0x7fa3a40e4100 2024-03-18T15:00:59.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.400+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd208058230 con 0x7fd20c08ba80 2024-03-18T15:00:59.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.400+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4eb401b060 con 0x7f4ebc06c210 2024-03-18T15:00:59.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.401+0000 7f4eb97fa640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 0x7f4ea806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.401+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4eb4056520 con 0x7f4ebc06c210 2024-03-18T15:00:59.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.401+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 0x7f4ea806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.401+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f05800b1ea0 con 0x7f0580070530 2024-03-18T15:00:59.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.403+0000 7f4ec0a08640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 0x7f4ea806e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007b60 tx=0x7f4eac031000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.403+0000 7f1f2f35b640 1 Processor -- start 2024-03-18T15:00:59.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.403+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f699007ad90 con 0x7f69a006cc70 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.404+0000 7f1f2f35b640 1 -- start start 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2f35b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 0x7f1f280d2af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2f35b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f280d19c0 con 0x7f1f280d1f70 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2f35b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f280cec80 con 0x7f1f280d0c20 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2f35b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f280cfca0 con 0x7f1f280b8640 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2d0f7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f1f280d0c20 0x7f1f280d1000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:43108/0 (socket says 172.21.15.152:43108) 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.405+0000 7f1f2d0f7640 1 -- 172.21.15.152:0/1193154819 learned_addr learned my addr 172.21.15.152:0/1193154819 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.406+0000 7f1f2d8f8640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 0x7f1f280d2af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.406+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4001392047 0 0) 0x7f1f280cec80 con 0x7f1f280d0c20 2024-03-18T15:00:59.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.406+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f14003520 con 0x7f1f280d0c20 2024-03-18T15:00:59.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.407+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1384488515 0 0) 0x7f1f18001040 con 0x7f1f280d1f70 2024-03-18T15:00:59.433 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.406+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4eb4010240 con 0x7f4ebc06c210 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.407+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1f280cec80 con 0x7f1f280d1f70 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.407+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 57532215 0 0) 0x7f1f14003520 con 0x7f1f280d0c20 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 msgr2=0x7f1f280d2af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 0x7f1f280d2af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 >> v1:172.21.15.152:6789/0 conn(0x7f1f280d1f70 legacy=0x7f1f280d23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.434 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> v1:172.21.15.186:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f280cef20 con 0x7f1f280d0c20 2024-03-18T15:00:59.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f8430b25640 1 Processor -- start 2024-03-18T15:00:59.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f8430b25640 1 -- start start 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.1 v1:172.21.15.186:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f1f24001670 con 0x7f1f280d0c20 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 >> v1:172.21.15.186:6789/0 conn(0x7f1f280d0c20 legacy=0x7f1f280d1000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.408+0000 7f1f1ffff640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f14003be0 0x7f1f14003fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f14003be0 0x7f1f14003fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f1ffff640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 0x7f1f14004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f1ffff640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f14004d90 0x7f1f14005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f280cfca0 con 0x7f1f14003be0 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1f1400bca0 con 0x7f1f14004d90 2024-03-18T15:00:59.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f1400bea0 con 0x7f1f280b8640 2024-03-18T15:00:59.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84240e12d0 0x7f8424034bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 0x7f8424035db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240362f0 0x7f842403a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8424050b10 con 0x7f8424035310 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f1f2d0f7640 1 -- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 msgr2=0x7f1f14004800 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8424035b90 con 0x7f84240e12d0 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.409+0000 7f8430b25640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8424035130 con 0x7f84240362f0 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84240e12d0 0x7f8424034bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84240e12d0 0x7f8424034bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50850/0 (socket says 172.21.15.152:50850) 2024-03-18T15:00:59.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 -- 172.21.15.152:0/3298335736 learned_addr learned my addr 172.21.15.152:0/3298335736 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f280b8640 0x7f1f14004800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842affd640 1 --2- 172.21.15.152:0/3298335736 >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 0x7f8424035db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f1f2d0f7640 1 -- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f14004d90 msgr2=0x7f1f14005210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:00:59.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f14004d90 0x7f1f14005210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f1f2d0f7640 1 -- 172.21.15.152:0/1193154819 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f14003520 con 0x7f1f14003be0 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 -- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240362f0 msgr2=0x7f842403a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 --2- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240362f0 0x7f842403a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 -- 172.21.15.152:0/3298335736 >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 msgr2=0x7f8424035db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 --2- 172.21.15.152:0/3298335736 >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 0x7f8424035db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.410+0000 7f842b7fe640 1 -- 172.21.15.152:0/3298335736 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240358b0 con 0x7f84240e12d0 2024-03-18T15:00:59.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f842affd640 1 --2- 172.21.15.152:0/3298335736 >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 0x7f8424035db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:00:59.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f842b7fe640 1 --2- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240e12d0 0x7f8424034bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84240552c0 tx=0x7f842002b910 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bcf3197704630a7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f14003be0 0x7f1f14003fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c340 tx=0x7f1f14005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d9583f80fc0af55 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f842a7fc640 1 -- 172.21.15.152:0/3298335736 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420035020 con 0x7f84240e12d0 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f842a7fc640 1 -- 172.21.15.152:0/3298335736 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8420031870 con 0x7f84240e12d0 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.411+0000 7f842a7fc640 1 -- 172.21.15.152:0/3298335736 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8420031c40 con 0x7f84240e12d0 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f8430b25640 1 -- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240e12d0 msgr2=0x7f8424034bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f8430b25640 1 --2- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240e12d0 0x7f8424034bf0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84240552c0 tx=0x7f842002b910 comp rx=0 tx=0).stop 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f8430b25640 1 -- 172.21.15.152:0/3298335736 shutdown_connections 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f8430b25640 1 --2- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240362f0 0x7f842403a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.413+0000 7f8430b25640 1 --2- 172.21.15.152:0/3298335736 >> v2:172.21.15.152:3300/0 conn(0x7f8424035310 0x7f8424035db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.413+0000 7f8430b25640 1 --2- 172.21.15.152:0/3298335736 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240e12d0 0x7f8424034bf0 secure :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84240552c0 tx=0x7f842002b910 comp rx=0 tx=0).stop 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.413+0000 7f8430b25640 1 -- 172.21.15.152:0/3298335736 >> 172.21.15.152:0/3298335736 conn(0x7f842401e6c0 msgr2=0x7f84240553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.413+0000 7f8430b25640 1 -- 172.21.15.152:0/3298335736 shutdown_connections 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.413+0000 7f8430b25640 1 -- 172.21.15.152:0/3298335736 wait complete. 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f24007be0 con 0x7f1f14003be0 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f24030070 con 0x7f1f14003be0 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.412+0000 7f1f1ffff640 1 -- 172.21.15.152:0/1193154819 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f240058d0 con 0x7f1f14003be0 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1193154819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f14003be0 msgr2=0x7f1f14003fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1193154819 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f14003be0 0x7f1f14003fc0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1f2400c340 tx=0x7f1f14005830 comp rx=0 tx=0).stop 2024-03-18T15:00:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f8430b25640 1 Processor -- start 2024-03-18T15:00:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f8430b25640 1 -- start start 2024-03-18T15:00:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f1f2d8f8640 1 -- 172.21.15.152:0/1193154819 reap_dead start 2024-03-18T15:00:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1193154819 shutdown_connections 2024-03-18T15:00:59.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.415+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1193154819 >> 172.21.15.152:0/1193154819 conn(0x7f1f280d4070 msgr2=0x7f1f280d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.416+0000 7f8430b25640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 0x7f84240dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.416+0000 7f8430b25640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 0x7f84240d0710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.416+0000 7f842b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 0x7f84240dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f842b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 0x7f84240dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34486/0 (socket says 172.21.15.152:34486) 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f8430b25640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240d9be0 0x7f84240d1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f8430b25640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8424051020 con 0x7f8424035310 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f8430b25640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8424036720 con 0x7f84240362f0 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f8430b25640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8424051300 con 0x7f84240d9be0 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f842b7fe640 1 -- 172.21.15.152:0/290007670 learned_addr learned my addr 172.21.15.152:0/290007670 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f842affd640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 0x7f84240d0710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f842bfff640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240d9be0 0x7f84240d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1193154819 shutdown_connections 2024-03-18T15:00:59.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.417+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1193154819 wait complete. 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.418+0000 7f842affd640 1 -- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240d9be0 msgr2=0x7f84240d1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.418+0000 7f842affd640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240d9be0 0x7f84240d1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.418+0000 7f842affd640 1 -- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 msgr2=0x7f84240dfc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.418+0000 7f842affd640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 0x7f84240dfc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.418+0000 7f842affd640 1 -- 172.21.15.152:0/290007670 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84240489e0 con 0x7f84240362f0 2024-03-18T15:00:59.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.419+0000 7f1f2f35b640 1 Processor -- start 2024-03-18T15:00:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.419+0000 7f842affd640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 0x7f84240d0710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7f0 tx=0x7f841800ccb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7f1f2f35b640 1 -- start start 2024-03-18T15:00:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7fea2404b640 1 Processor -- start 2024-03-18T15:00:59.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7fea2404b640 1 -- start start 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.421+0000 7f1f2f35b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f281e7620 0x7f1f280ca760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418015070 con 0x7f84240362f0 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8418004220 con 0x7f84240362f0 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.420+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8418007620 con 0x7f84240362f0 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.421+0000 7f8430b25640 1 -- 172.21.15.152:0/290007670 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8424048cc0 con 0x7f84240362f0 2024-03-18T15:00:59.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.421+0000 7f8430b25640 1 -- 172.21.15.152:0/290007670 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f842404e130 con 0x7f84240362f0 2024-03-18T15:00:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.421+0000 7f1f2f35b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.421+0000 7f1f2f35b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 0x7f1f281ec7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea2404b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea2404b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fea1c06e4a0 0x7fea1c158410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea2404b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea1c06f710 con 0x7fea1c0d1750 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea2404b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fea1c06e010 con 0x7fea1c06e4a0 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea2404b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c06f9f0 con 0x7fea1c0d1370 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43678/0 (socket says 172.21.15.152:43678) 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 -- 172.21.15.152:0/4195005701 learned_addr learned my addr 172.21.15.152:0/4195005701 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2c8f6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea225e8640 1 --2- 172.21.15.152:0/4195005701 >> v2:172.21.15.186:3300/0 conn(0x7fea1c06e4a0 0x7fea1c158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8404005290 con 0x7f84240362f0 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2c8f6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43668/0 (socket says 172.21.15.152:43668) 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2c8f6640 1 -- 172.21.15.152:0/1848075139 learned_addr learned my addr 172.21.15.152:0/1848075139 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2d8f8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 0x7f1f281ec7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f280d1710 con 0x7f1f280cc8c0 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1f280b6ec0 con 0x7f1f281e7620 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f280b7110 con 0x7f1f28205000 2024-03-18T15:00:59.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 -- 172.21.15.152:0/4195005701 >> v2:172.21.15.186:3300/0 conn(0x7fea1c06e4a0 msgr2=0x7fea1c158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 --2- 172.21.15.152:0/4195005701 >> v2:172.21.15.186:3300/0 conn(0x7fea1c06e4a0 0x7fea1c158410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 -- 172.21.15.152:0/4195005701 >> v1:172.21.15.152:6789/0 conn(0x7fea1c0d1750 legacy=0x7fea1c06ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:00:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.422+0000 7fea21de7640 1 -- 172.21.15.152:0/4195005701 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c06fcd0 con 0x7fea1c0d1370 2024-03-18T15:00:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2c8f6640 1 -- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f281e7620 msgr2=0x7f1f280ca760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2c8f6640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f281e7620 0x7f1f280ca760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2c8f6640 1 -- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 msgr2=0x7f1f281ec7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2c8f6640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 0x7f1f281ec7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2c8f6640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f282055a0 con 0x7f1f28205000 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.423+0000 7f1f2d8f8640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 0x7f1f281ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.424+0000 7fea21de7640 1 --2- 172.21.15.152:0/4195005701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea14009e50 tx=0x7fea1402bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b8ed81e0fe43dc7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.424+0000 7f1f2c8f6640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c4a0 tx=0x7f1f1800c960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.424+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f84180079d0 con 0x7f84240362f0 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f8417fff640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 0x7f841006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f842b7fe640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 0x7f841006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f842b7fe640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 0x7f841006e160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84200090b0 tx=0x7f842003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.424+0000 7fea20de5640 1 -- 172.21.15.152:0/4195005701 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea1402ca70 con 0x7fea1c0d1370 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.424+0000 7fea20de5640 1 -- 172.21.15.152:0/4195005701 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea1402cc10 con 0x7fea1c0d1370 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7fea2404b640 1 -- 172.21.15.152:0/4195005701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 msgr2=0x7fea1c0b5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7fea2404b640 1 --2- 172.21.15.152:0/4195005701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fea14009e50 tx=0x7fea1402bed0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f841808aed0 con 0x7f84240362f0 2024-03-18T15:00:59.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 -- 172.21.15.152:0/4195005701 shutdown_connections 2024-03-18T15:00:59.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 --2- 172.21.15.152:0/4195005701 >> v2:172.21.15.186:3300/0 conn(0x7fea1c06e4a0 0x7fea1c158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 --2- 172.21.15.152:0/4195005701 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c0b5f20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 -- 172.21.15.152:0/4195005701 >> 172.21.15.152:0/4195005701 conn(0x7fea1c06c4b0 msgr2=0x7fea1c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f18017070 con 0x7f1f28205000 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f28205880 con 0x7f1f28205000 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f28205e40 con 0x7f1f28205000 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f180035f0 con 0x7f1f28205000 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.425+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f180039c0 con 0x7f1f28205000 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 -- 172.21.15.152:0/4195005701 shutdown_connections 2024-03-18T15:00:59.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.427+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f08005290 con 0x7f1f28205000 2024-03-18T15:00:59.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.426+0000 7fea2404b640 1 -- 172.21.15.152:0/4195005701 wait complete. 2024-03-18T15:00:59.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.428+0000 7fea2404b640 1 Processor -- start 2024-03-18T15:00:59.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.428+0000 7fea2404b640 1 -- start start 2024-03-18T15:00:59.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f84180593e0 con 0x7f84240362f0 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 0x7fea1c08b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c1fecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 0x7fea1c208650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c06eab0 con 0x7fea1c06e4a0 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fea1c06e930 con 0x7fea1c0d1750 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.429+0000 7fea2404b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fea1c158950 con 0x7fea1c0d1370 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea225e8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 0x7fea1c208650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea225e8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 0x7fea1c208650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50886/0 (socket says 172.21.15.152:50886) 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea225e8640 1 -- 172.21.15.152:0/70755030 learned_addr learned my addr 172.21.15.152:0/70755030 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 0x7fea1c08b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 -- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 msgr2=0x7fea1c1fecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c1fecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 -- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 msgr2=0x7fea1c208650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 0x7fea1c208650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.430+0000 7fea21de7640 1 -- 172.21.15.152:0/70755030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea1c1601b0 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea21de7640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 0x7fea1c08b950 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea14032000 tx=0x7fea14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14054070 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fea14050650 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea14050a40 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea1c15f630 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.431+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea1c15fbf0 con 0x7fea1c06e4a0 2024-03-18T15:00:59.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.435+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1f1801a070 con 0x7f1f28205000 2024-03-18T15:00:59.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.434+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fea14057070 con 0x7fea1c06e4a0 2024-03-18T15:00:59.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.434+0000 7fea127fc640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 0x7fea0006e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.434+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fea140be410 con 0x7fea1c06e4a0 2024-03-18T15:00:59.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.436+0000 7fea215e6640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 0x7fea0006e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.436+0000 7f1f1dffb640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 0x7f1f0c06e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.436+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f1f1808a640 con 0x7f1f28205000 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.436+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 0x7f1f0c06e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.436+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1f280d19c0 con 0x7f1f28205000 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.437+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea04005290 con 0x7fea1c06e4a0 2024-03-18T15:00:59.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.438+0000 7fea215e6640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 0x7fea0006e190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006fd0 tx=0x7fea0c006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.438+0000 7f1f2d0f7640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 0x7f1f0c06e190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f24034000 tx=0x7f1f2402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:00:59.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.448+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fea1408d090 con 0x7fea1c06e4a0 2024-03-18T15:00:59.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.801+0000 7fd214427640 1 -- 172.21.15.152:0/646598935 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fd1f4005580 con 0x7fd20c08ba80 2024-03-18T15:00:59.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.802+0000 7fd202ffd640 1 -- 172.21.15.152:0/646598935 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd20805c2d0 con 0x7fd20c08ba80 2024-03-18T15:00:59.802 INFO:teuthology.orchestra.run.smithi152.stdout:64424509448 2024-03-18T15:00:59.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.805+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 msgr2=0x7fd1f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.805+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 0x7fd1f006e090 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd1fc036000 tx=0x7fd1fc03e040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.805+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 msgr2=0x7fd20c164400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.805+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fd20800c400 tx=0x7fd20800c8c0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 shutdown_connections 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd20c16ad10 0x7fd20c1689d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd1f006bbd0 0x7fd1f006e090 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd20c0cad20 0x7fd20c168490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 --2- 172.21.15.152:0/646598935 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd20c08ba80 0x7fd20c164400 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 >> 172.21.15.152:0/646598935 conn(0x7fd20c0cfa50 msgr2=0x7fd20c074240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 shutdown_connections 2024-03-18T15:00:59.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.806+0000 7fd200ff9640 1 -- 172.21.15.152:0/646598935 wait complete. 2024-03-18T15:00:59.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.814+0000 7fa3b145d640 1 -- 172.21.15.152:0/1306173336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa38c005580 con 0x7fa3a40e4100 2024-03-18T15:00:59.823 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509448 for osd.2 2024-03-18T15:00:59.823 INFO:teuthology.orchestra.run.smithi152.stdout:60129542151 2024-03-18T15:00:59.823 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.822+0000 7fa3a8ff9640 1 -- 172.21.15.152:0/1306173336 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa3a007bf40 con 0x7fa3a40e4100 2024-03-18T15:00:59.826 INFO:teuthology.orchestra.run.smithi152.stdout:60129542149 2024-03-18T15:00:59.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 msgr2=0x7fa39006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 0x7fa39006e160 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac069da0 tx=0x7fa3ac068fa0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 msgr2=0x7fa3a40d5cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa3a00090b0 tx=0x7fa3a00046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 shutdown_connections 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa3a4051d00 0x7fa3a4052190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa3a40e06c0 0x7fa3a40e0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa39006bca0 0x7fa39006e160 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 --2- 172.21.15.152:0/1306173336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa3a40e4100 0x7fa3a40d5cc0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 >> 172.21.15.152:0/1306173336 conn(0x7fa3a401ef40 msgr2=0x7fa3a400b6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.827+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 shutdown_connections 2024-03-18T15:00:59.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.827+0000 7fa3967fc640 1 -- 172.21.15.152:0/1306173336 wait complete. 2024-03-18T15:00:59.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.828+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f4ebc067050 con 0x7f4ebc06c210 2024-03-18T15:00:59.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.828+0000 7f4eb97fa640 1 -- 172.21.15.152:0/3605142793 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f4eb4010240 con 0x7f4ebc06c210 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.822+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f058006f2b0 con 0x7f0580070530 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.822+0000 7f0567fff640 1 -- 172.21.15.152:0/2866403693 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f058006f2b0 con 0x7f0580070530 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 msgr2=0x7f056c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 0x7f056c06e090 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f0578035000 tx=0x7f0578030000 comp rx=0 tx=0).stop 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 msgr2=0x7f05800cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f057000b480 tx=0x7f057000b940 comp rx=0 tx=0).stop 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 shutdown_connections 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f058014c220 0x7f05800cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f056c06bbd0 0x7f056c06e090 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f05800b3ba0 0x7f058013ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 --2- 172.21.15.152:0/2866403693 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0580070530 0x7f05800cfd40 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.826+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 >> 172.21.15.152:0/2866403693 conn(0x7f05800d0d30 msgr2=0x7f05800b1790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.827+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 shutdown_connections 2024-03-18T15:00:59.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.827+0000 7f0586052640 1 -- 172.21.15.152:0/2866403693 wait complete. 2024-03-18T15:00:59.832 INFO:teuthology.orchestra.run.smithi152.stdout:55834574854 2024-03-18T15:00:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.832+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 msgr2=0x7f4ea806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.832+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 0x7f4ea806e0c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f4eac007b60 tx=0x7f4eac031000 comp rx=0 tx=0).stop 2024-03-18T15:00:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.832+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 msgr2=0x7f4ebc163a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.832+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 0x7f4ebc163a20 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f4ebc0727a0 tx=0x7f4eb4007b80 comp rx=0 tx=0).stop 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 shutdown_connections 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ebc06c210 0x7f4ebc163a20 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea806bc00 0x7f4ea806e0c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ebc15d8b0 0x7f4ebc161580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 --2- 172.21.15.152:0/3605142793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ebc15e3c0 0x7f4ebc15e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 >> 172.21.15.152:0/3605142793 conn(0x7f4ebc0d04d0 msgr2=0x7f4ebc149810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 shutdown_connections 2024-03-18T15:00:59.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.833+0000 7f4ec2c6c640 1 -- 172.21.15.152:0/3605142793 wait complete. 2024-03-18T15:00:59.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.842+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f8404005850 con 0x7f84240362f0 2024-03-18T15:00:59.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.843+0000 7f8417fff640 1 -- 172.21.15.152:0/290007670 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f841805d480 con 0x7f84240362f0 2024-03-18T15:00:59.843 INFO:teuthology.orchestra.run.smithi152.stdout:64424509447 2024-03-18T15:00:59.845 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542151 for osd.7 2024-03-18T15:00:59.846 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542149 for osd.5 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.846+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 msgr2=0x7f841006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.846+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 0x7f841006e160 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f84200090b0 tx=0x7f842003c040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.846+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 msgr2=0x7f84240d0710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.846+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 0x7f84240d0710 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f841800c7f0 tx=0x7f841800ccb0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 shutdown_connections 2024-03-18T15:00:59.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f841006bca0 0x7f841006e160 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84240d9be0 0x7f84240d1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84240362f0 0x7f84240d0710 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 --2- 172.21.15.152:0/290007670 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8424035310 0x7f84240dfc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 >> 172.21.15.152:0/290007670 conn(0x7f842401e6c0 msgr2=0x7f842400a900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 shutdown_connections 2024-03-18T15:00:59.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.847+0000 7f8415ffb640 1 -- 172.21.15.152:0/290007670 wait complete. 2024-03-18T15:00:59.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574854 for osd.0 2024-03-18T15:00:59.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.853+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6980005580 con 0x7f69a006cc70 2024-03-18T15:00:59.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.854+0000 7f69877fe640 1 -- 172.21.15.152:0/3784452018 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f699007a690 con 0x7f69a006cc70 2024-03-18T15:00:59.854 INFO:teuthology.orchestra.run.smithi152.stdout:60129542150 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 msgr2=0x7f698c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 0x7f698c06e160 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f69a016a330 tx=0x7f6998009040 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 msgr2=0x7f69a009d260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 0x7f69a009d260 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f69a00d0c50 tx=0x7f69900046c0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 shutdown_connections 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f69a00b3440 0x7f69a009aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f69a008b9e0 0x7f69a01635d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f698c06bca0 0x7f698c06e160 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 --2- 172.21.15.152:0/3784452018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69a006cc70 0x7f69a009d260 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 >> 172.21.15.152:0/3784452018 conn(0x7f69a006b1c0 msgr2=0x7f69a00b2af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 shutdown_connections 2024-03-18T15:00:59.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.856+0000 7f69a51f4640 1 -- 172.21.15.152:0/3784452018 wait complete. 2024-03-18T15:00:59.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.859+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fea04005580 con 0x7fea1c06e4a0 2024-03-18T15:00:59.860 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.860+0000 7fea127fc640 1 -- 172.21.15.152:0/70755030 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fea1408c990 con 0x7fea1c06e4a0 2024-03-18T15:00:59.860 INFO:teuthology.orchestra.run.smithi152.stdout:60129542150 2024-03-18T15:00:59.861 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.1 2024-03-18T15:00:59.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 msgr2=0x7fea0006e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 0x7fea0006e190 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fea0c006fd0 tx=0x7fea0c006bc0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 msgr2=0x7fea1c08b950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 0x7fea1c08b950 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fea14032000 tx=0x7fea14004a40 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 shutdown_connections 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fea1c0d1750 0x7fea1c208650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fea0006bcd0 0x7fea0006e190 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fea1c0d1370 0x7fea1c1fecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 --2- 172.21.15.152:0/70755030 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fea1c06e4a0 0x7fea1c08b950 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 >> 172.21.15.152:0/70755030 conn(0x7fea1c06c4b0 msgr2=0x7fea1c0b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 shutdown_connections 2024-03-18T15:00:59.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:00:59.863+0000 7fea2404b640 1 -- 172.21.15.152:0/70755030 wait complete. 2024-03-18T15:00:59.869 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.4 2024-03-18T15:00:59.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.6 2024-03-18T15:01:00.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.002+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f1f08005850 con 0x7f1f28205000 2024-03-18T15:01:00.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.002+0000 7f1f1dffb640 1 -- 172.21.15.152:0/1848075139 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1f18058ac0 con 0x7f1f28205000 2024-03-18T15:01:00.003 INFO:teuthology.orchestra.run.smithi152.stdout:64424509447 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 msgr2=0x7f1f0c06e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 0x7f1f0c06e190 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f1f24034000 tx=0x7f1f2402e000 comp rx=0 tx=0).stop 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 msgr2=0x7f1f280cc380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1f1800c4a0 tx=0x7f1f1800c960 comp rx=0 tx=0).stop 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 shutdown_connections 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f280cc8c0 0x7f1f281ec7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f0c06bcd0 0x7f1f0c06e190 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f28205000 0x7f1f280cc380 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 --2- 172.21.15.152:0/1848075139 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f281e7620 0x7f1f280ca760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 >> 172.21.15.152:0/1848075139 conn(0x7f1f280d4070 msgr2=0x7f1f2806c030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:00.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 shutdown_connections 2024-03-18T15:01:00.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.004+0000 7f1f2f35b640 1 -- 172.21.15.152:0/1848075139 wait complete. 2024-03-18T15:01:00.015 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509447 for osd.3 2024-03-18T15:01:00.824 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-03-18T15:01:00.846 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-03-18T15:01:00.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-03-18T15:01:00.851 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-03-18T15:01:00.862 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-03-18T15:01:00.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-03-18T15:01:00.875 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-03-18T15:01:00.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.963+0000 7fdda759e640 1 Processor -- start 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.963+0000 7fdda759e640 1 -- start start 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda0051060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda759e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdda0039c00 0x7fdda003a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda759e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdda00090f0 con 0x7fdda00e3810 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda759e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdda00515a0 con 0x7fdda0039c00 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00093d0 con 0x7fdda0050be0 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.964+0000 7fdda659c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdda00e3810 0x7fdda0008580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:43962/0 (socket says 172.21.15.152:43962) 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.965+0000 7fdda659c640 1 -- 172.21.15.152:0/2476518220 learned_addr learned my addr 172.21.15.152:0/2476518220 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.965+0000 7fdda6d9d640 1 --2- 172.21.15.152:0/2476518220 >> v2:172.21.15.152:3300/0 conn(0x7fdda0039c00 0x7fdda003a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.965+0000 7fdda5d9b640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda0051060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.966+0000 7fdda6d9d640 1 -- 172.21.15.152:0/2476518220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 msgr2=0x7fdda0051060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:00.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.966+0000 7fdda6d9d640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda0051060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.966+0000 7fdda6d9d640 1 -- 172.21.15.152:0/2476518220 >> v1:172.21.15.152:6789/0 conn(0x7fdda00e3810 legacy=0x7fdda0008580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.966+0000 7fdda6d9d640 1 -- 172.21.15.152:0/2476518220 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda0039400 con 0x7fdda0039c00 2024-03-18T15:01:00.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.967+0000 7fdda6d9d640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda0039c00 0x7fdda003a050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdda802d740 tx=0x7fdda8068fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd905bc82ae319d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:00.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.969+0000 7fdda559a640 1 -- 172.21.15.152:0/2476518220 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80b3070 con 0x7fdda0039c00 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.969+0000 7fdda559a640 1 -- 172.21.15.152:0/2476518220 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdda80ae400 con 0x7fdda0039c00 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.969+0000 7fdda559a640 1 -- 172.21.15.152:0/2476518220 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdda80ae870 con 0x7fdda0039c00 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 -- 172.21.15.152:0/2476518220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda0039c00 msgr2=0x7fdda003a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda0039c00 0x7fdda003a050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fdda802d740 tx=0x7fdda8068fa0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 -- 172.21.15.152:0/2476518220 shutdown_connections 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda0051060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 --2- 172.21.15.152:0/2476518220 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda0039c00 0x7fdda003a050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.970+0000 7fdda759e640 1 -- 172.21.15.152:0/2476518220 >> 172.21.15.152:0/2476518220 conn(0x7fdda0055bc0 msgr2=0x7fdda0055fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:00.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.971+0000 7fdda759e640 1 -- 172.21.15.152:0/2476518220 shutdown_connections 2024-03-18T15:01:00.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.971+0000 7fdda759e640 1 -- 172.21.15.152:0/2476518220 wait complete. 2024-03-18T15:01:00.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.973+0000 7fdda759e640 1 Processor -- start 2024-03-18T15:01:00.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.973+0000 7fdda759e640 1 -- start start 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda004ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 0x7fdda004f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0039040 con 0x7fdda00e3810 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdda0050960 con 0x7fdda0039c00 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.974+0000 7fdda759e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdda00391c0 con 0x7fdda0050be0 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.975+0000 7fdda659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.975+0000 7fdda659c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50486/0 (socket says 172.21.15.152:50486) 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.975+0000 7fdda659c640 1 -- 172.21.15.152:0/2123683003 learned_addr learned my addr 172.21.15.152:0/2123683003 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:00.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.975+0000 7fdda5d9b640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda004ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.975+0000 7fdda6d9d640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 0x7fdda004f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda659c640 1 -- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 msgr2=0x7fdda004ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda659c640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda004ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda659c640 1 -- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 msgr2=0x7fdda004f360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda659c640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 0x7fdda004f360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda659c640 1 -- 172.21.15.152:0/2123683003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdda004a950 con 0x7fdda0039c00 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda5d9b640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda004ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.976+0000 7fdda6d9d640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 0x7fdda004f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.977+0000 7fdda659c640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c780 tx=0x7fdd9c00cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.978+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c018070 con 0x7fdda0039c00 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.978+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdda004ac30 con 0x7fdda0039c00 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.978+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdda004b1f0 con 0x7fdda0039c00 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.978+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdd9c0072d0 con 0x7fdda0039c00 2024-03-18T15:01:00.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.978+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd9c0047e0 con 0x7fdda0039c00 2024-03-18T15:01:00.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.987+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdd9c01b070 con 0x7fdda0039c00 2024-03-18T15:01:00.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.987+0000 7fdd96ffd640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 0x7fdd8806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:00.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.987+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdd9c089d70 con 0x7fdda0039c00 2024-03-18T15:01:00.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.988+0000 7fdda5d9b640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 0x7fdd8806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:00.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.992+0000 7fdda5d9b640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 0x7fdd8806e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdda0054860 tx=0x7fdd98009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:00.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:00.995+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdd8c005290 con 0x7fdda0039c00 2024-03-18T15:01:01.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.003+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdd9c058340 con 0x7fdda0039c00 2024-03-18T15:01:01.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.004+0000 7fab894ac640 1 Processor -- start 2024-03-18T15:01:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.005+0000 7fab894ac640 1 -- start start 2024-03-18T15:01:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab894ac640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab894ac640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fab840aea80 0x7fab840b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab894ac640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fab840ad9e0 con 0x7fab840d00e0 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab894ac640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fab840ad790 con 0x7fab840aea80 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab894ac640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fab840adcc0 con 0x7fab8414bdf0 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:38924/0 (socket says 172.21.15.152:38924) 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab82ffd640 1 -- 172.21.15.152:0/2161334018 learned_addr learned my addr 172.21.15.152:0/2161334018 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.006+0000 7fab827fc640 1 --2- 172.21.15.152:0/2161334018 >> v2:172.21.15.186:3300/0 conn(0x7fab840aea80 0x7fab840b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.007+0000 7fab82ffd640 1 -- 172.21.15.152:0/2161334018 >> v2:172.21.15.186:3300/0 conn(0x7fab840aea80 msgr2=0x7fab840b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.007+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2161334018 >> v2:172.21.15.186:3300/0 conn(0x7fab840aea80 0x7fab840b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.007+0000 7fab82ffd640 1 -- 172.21.15.152:0/2161334018 >> v1:172.21.15.152:6789/0 conn(0x7fab840d00e0 legacy=0x7fab8406cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.007+0000 7fab82ffd640 1 -- 172.21.15.152:0/2161334018 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab840adfa0 con 0x7fab8414bdf0 2024-03-18T15:01:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.008+0000 7fab82ffd640 1 --2- 172.21.15.152:0/2161334018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402b910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e43fe4d4ac949f30 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.008+0000 7fab81ffb640 1 -- 172.21.15.152:0/2161334018 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74035020 con 0x7fab8414bdf0 2024-03-18T15:01:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.008+0000 7fab81ffb640 1 -- 172.21.15.152:0/2161334018 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74031870 con 0x7fab8414bdf0 2024-03-18T15:01:01.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.008+0000 7fab81ffb640 1 -- 172.21.15.152:0/2161334018 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74031c40 con 0x7fab8414bdf0 2024-03-18T15:01:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.010+0000 7fab894ac640 1 -- 172.21.15.152:0/2161334018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 msgr2=0x7fab840b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.010+0000 7fab894ac640 1 --2- 172.21.15.152:0/2161334018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab7402b910 comp rx=0 tx=0).stop 2024-03-18T15:01:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.011+0000 7fab894ac640 1 -- 172.21.15.152:0/2161334018 shutdown_connections 2024-03-18T15:01:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.011+0000 7fab894ac640 1 --2- 172.21.15.152:0/2161334018 >> v2:172.21.15.186:3300/0 conn(0x7fab840aea80 0x7fab840b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.011+0000 7fab894ac640 1 --2- 172.21.15.152:0/2161334018 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab840b2fa0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.011+0000 7fab894ac640 1 -- 172.21.15.152:0/2161334018 >> 172.21.15.152:0/2161334018 conn(0x7fab8406b5e0 msgr2=0x7fab8406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.012+0000 7fab894ac640 1 -- 172.21.15.152:0/2161334018 shutdown_connections 2024-03-18T15:01:01.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.013+0000 7fab894ac640 1 -- 172.21.15.152:0/2161334018 wait complete. 2024-03-18T15:01:01.016 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.015+0000 7fab894ac640 1 Processor -- start 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.015+0000 7fab894ac640 1 -- start start 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab82ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59490/0 (socket says 172.21.15.152:59490) 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab82ffd640 1 -- 172.21.15.152:0/1780841939 learned_addr learned my addr 172.21.15.152:0/1780841939 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab841f5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 0x7fab841fb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fab8414c1d0 con 0x7fab840d00e0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fab840ae560 con 0x7fab84143c20 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fab8414c350 con 0x7fab8414bdf0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab837fe640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 0x7fab841fb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.016+0000 7fab827fc640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab841f5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.017+0000 7fab82ffd640 1 -- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 msgr2=0x7fab841f5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.017+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab841f5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.017+0000 7fab82ffd640 1 -- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 msgr2=0x7fab841fb500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.017+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 0x7fab841fb500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.017+0000 7fab82ffd640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab841f8e60 con 0x7fab840d00e0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.018+0000 7fab82ffd640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.018+0000 7fab837fe640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 0x7fab841fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:01.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.020+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab740443f0 con 0x7fab840d00e0 2024-03-18T15:01:01.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.020+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab84145210 con 0x7fab840d00e0 2024-03-18T15:01:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.020+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab84144450 con 0x7fab840d00e0 2024-03-18T15:01:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.022+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab74044590 con 0x7fab840d00e0 2024-03-18T15:01:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.022+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab74044940 con 0x7fab840d00e0 2024-03-18T15:01:01.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fab7404b060 con 0x7fab840d00e0 2024-03-18T15:01:01.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.024+0000 7f0f0d353640 1 Processor -- start 2024-03-18T15:01:01.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.024+0000 7f0f0d353640 1 -- start start 2024-03-18T15:01:01.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7fab6b7fe640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 0x7fab7006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.024+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fab740ace20 con 0x7fab840d00e0 2024-03-18T15:01:01.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.024+0000 7fab827fc640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 0x7fab7006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7fab827fc640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 0x7fab7006e160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab840b5280 tx=0x7fab78008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f0d353640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f0806bd50 0x7f0f08072760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f0d353640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f080713c0 con 0x7f0f080d01a0 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f0d353640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f080716a0 con 0x7f0f08072f20 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f0d353640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0f08160d20 con 0x7f0f0806bd50 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f06ffd640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f0f08072f20 0x7f0f0815d1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:48892/0 (socket says 172.21.15.152:48892) 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.025+0000 7f0f06ffd640 1 -- 172.21.15.152:0/2612073685 learned_addr learned my addr 172.21.15.152:0/2612073685 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.026+0000 7f0f067fc640 1 --2- 172.21.15.152:0/2612073685 >> v2:172.21.15.186:3300/0 conn(0x7f0f0806bd50 0x7f0f08072760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.026+0000 7f0f067fc640 1 -- 172.21.15.152:0/2612073685 >> v1:172.21.15.186:6789/0 conn(0x7f0f08072f20 legacy=0x7f0f0815d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.026+0000 7f0f067fc640 1 -- 172.21.15.152:0/2612073685 >> v1:172.21.15.152:6789/0 conn(0x7f0f080d01a0 legacy=0x7f0f080acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.026+0000 7f0f067fc640 1 -- 172.21.15.152:0/2612073685 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f08071980 con 0x7f0f0806bd50 2024-03-18T15:01:01.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.026+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab64005290 con 0x7fab840d00e0 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.022+0000 7f65be2d1640 1 Processor -- start 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.022+0000 7f65be2d1640 1 -- start start 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65be2d1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f65b808b9e0 0x7f65b80b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65be2d1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b808bdc0 con 0x7f65b80b3440 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65be2d1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65b806d230 con 0x7f65b806cc70 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65be2d1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f65b806d510 con 0x7f65b808b9e0 2024-03-18T15:01:01.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65b7fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f65b808b9e0 0x7f65b80b4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65b7fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f65b808b9e0 0x7f65b80b4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50518/0 (socket says 172.21.15.152:50518) 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.023+0000 7f65b7fff640 1 -- 172.21.15.152:0/977019087 learned_addr learned my addr 172.21.15.152:0/977019087 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.024+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3102667356 0 0) 0x7f65b806d230 con 0x7f65b806cc70 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65a0003500 con 0x7f65b806cc70 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2244175610 0 0) 0x7f65b808bdc0 con 0x7f65b80b3440 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65b806d230 con 0x7f65b80b3440 2024-03-18T15:01:01.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f0f067fc640 1 --2- 172.21.15.152:0/2612073685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f08072760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009d90 tx=0x7f0f0002bc70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c496231ba79295 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.028+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2612073685 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00039070 con 0x7f0f0806bd50 2024-03-18T15:01:01.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b7fff640 1 -- 172.21.15.152:0/977019087 >> v1:172.21.15.186:6789/0 conn(0x7f65b806cc70 legacy=0x7f65b80b2d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b7fff640 1 -- 172.21.15.152:0/977019087 >> v1:172.21.15.152:6789/0 conn(0x7f65b80b3440 legacy=0x7f65b8071890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.027+0000 7f65b7fff640 1 -- 172.21.15.152:0/977019087 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b806d7f0 con 0x7f65b808b9e0 2024-03-18T15:01:01.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.029+0000 7f65b7fff640 1 --2- 172.21.15.152:0/977019087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80b4ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ee0 tx=0x7f65a8030440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4085fdf1b7af4517 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.029+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2612073685 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0002c920 con 0x7f0f0806bd50 2024-03-18T15:01:01.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.030+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2612073685 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0002ccf0 con 0x7f0f0806bd50 2024-03-18T15:01:01.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.031+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a803c070 con 0x7f65b808b9e0 2024-03-18T15:01:01.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.031+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65a80094e0 con 0x7f65b808b9e0 2024-03-18T15:01:01.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.031+0000 7f65b6ffd640 1 -- 172.21.15.152:0/977019087 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65a8007a60 con 0x7f65b808b9e0 2024-03-18T15:01:01.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.032+0000 7f0f0d353640 1 -- 172.21.15.152:0/2612073685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 msgr2=0x7f0f08072760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.032+0000 7f0f0d353640 1 --2- 172.21.15.152:0/2612073685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f08072760 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0f00009d90 tx=0x7f0f0002bc70 comp rx=0 tx=0).stop 2024-03-18T15:01:01.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.033+0000 7f0f0d353640 1 -- 172.21.15.152:0/2612073685 shutdown_connections 2024-03-18T15:01:01.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.033+0000 7f0f0d353640 1 --2- 172.21.15.152:0/2612073685 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f08072760 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.033+0000 7f0f0d353640 1 -- 172.21.15.152:0/2612073685 >> 172.21.15.152:0/2612073685 conn(0x7f0f0806b1c0 msgr2=0x7f0f0806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.033+0000 7f0f0d353640 1 -- 172.21.15.152:0/2612073685 shutdown_connections 2024-03-18T15:01:01.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.033+0000 7f0f0d353640 1 -- 172.21.15.152:0/2612073685 wait complete. 2024-03-18T15:01:01.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.035+0000 7f0f0d353640 1 Processor -- start 2024-03-18T15:01:01.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.036+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fab841f8e60 con 0x7fab840d00e0 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.035+0000 7f0f0d353640 1 -- start start 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f0814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 0x7f0f080cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0815d8b0 con 0x7f0f080d01a0 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f08071f40 con 0x7f0f0806bd50 2024-03-18T15:01:01.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f0d353640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0815da30 con 0x7f0f08072f20 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f067fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f077fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 0x7f0f080cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f067fc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:38938/0 (socket says 172.21.15.152:38938) 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f067fc640 1 -- 172.21.15.152:0/3170057408 learned_addr learned my addr 172.21.15.152:0/3170057408 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f06ffd640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f0814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f067fc640 1 -- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 msgr2=0x7f0f0814c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.037+0000 7f0f067fc640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f0814c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0f067fc640 1 -- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 msgr2=0x7f0f080cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0f067fc640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 0x7f0f080cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0f067fc640 1 -- 172.21.15.152:0/3170057408 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f080cc300 con 0x7f0f08072f20 2024-03-18T15:01:01.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0f077fe640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 0x7f0f080cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:01.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0f067fc640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f0002c1b0 tx=0x7f0f00004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f65be2d1640 1 -- 172.21.15.152:0/977019087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 msgr2=0x7f65b80b4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f65be2d1640 1 --2- 172.21.15.152:0/977019087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80b4ca0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ee0 tx=0x7f65a8030440 comp rx=0 tx=0).stop 2024-03-18T15:01:01.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00044020 con 0x7f0f08072f20 2024-03-18T15:01:01.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0003a040 con 0x7f0f08072f20 2024-03-18T15:01:01.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.038+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00039070 con 0x7f0f08072f20 2024-03-18T15:01:01.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.039+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f080cc5e0 con 0x7f0f08072f20 2024-03-18T15:01:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.039+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f080ccba0 con 0x7f0f08072f20 2024-03-18T15:01:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.041+0000 7f65be2d1640 1 -- 172.21.15.152:0/977019087 shutdown_connections 2024-03-18T15:01:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.041+0000 7f65be2d1640 1 --2- 172.21.15.152:0/977019087 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80b4ca0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.041+0000 7f65be2d1640 1 -- 172.21.15.152:0/977019087 >> 172.21.15.152:0/977019087 conn(0x7f65b806b1c0 msgr2=0x7f65b806b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.041+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0804f5b0 con 0x7f0f08072f20 2024-03-18T15:01:01.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.041+0000 7fd4c79f4640 1 Processor -- start 2024-03-18T15:01:01.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.042+0000 7fd4c79f4640 1 -- start start 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.042+0000 7f65be2d1640 1 -- 172.21.15.152:0/977019087 shutdown_connections 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7f65be2d1640 1 -- 172.21.15.152:0/977019087 wait complete. 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.042+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0f00047020 con 0x7f0f08072f20 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7f0eef7fe640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 0x7f0ef406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f000ad000 con 0x7f0f08072f20 2024-03-18T15:01:01.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.044+0000 7f0f06ffd640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 0x7f0ef406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c79f4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4c01598e0 0x7fd4c00b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c79f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c0159cc0 0x7fd4c00d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c79f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4c015fc70 con 0x7fd4c006cc70 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c79f4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd4c00b3c80 con 0x7fd4c01598e0 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c79f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c015ff50 con 0x7fd4c0159cc0 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c5790640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4c01598e0 0x7fd4c00b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c5790640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4c01598e0 0x7fd4c00b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59506/0 (socket says 172.21.15.152:59506) 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.043+0000 7fd4c5790640 1 -- 172.21.15.152:0/2345333933 learned_addr learned my addr 172.21.15.152:0/2345333933 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.044+0000 7fd4c5790640 1 -- 172.21.15.152:0/2345333933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c0159cc0 msgr2=0x7fd4c00d00e0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T15:01:01.046 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.044+0000 7fd4c5790640 1 --2- 172.21.15.152:0/2345333933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c0159cc0 0x7fd4c00d00e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.044+0000 7fd4c5790640 1 -- 172.21.15.152:0/2345333933 >> v1:172.21.15.186:6789/0 conn(0x7fd4c006cc70 legacy=0x7fd4c015c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.044+0000 7fd4c5790640 1 -- 172.21.15.152:0/2345333933 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c0160230 con 0x7fd4c01598e0 2024-03-18T15:01:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.045+0000 7f0f06ffd640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 0x7f0ef406e190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0efc000f60 tx=0x7f0efc007c40 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.045+0000 7f65be2d1640 1 Processor -- start 2024-03-18T15:01:01.047 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.045+0000 7f65be2d1640 1 -- start start 2024-03-18T15:01:01.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.045+0000 7fd4c5790640 1 --2- 172.21.15.152:0/2345333933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c01598e0 0x7fd4c00b3740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1ccd0d9147855 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7fd4b7fff640 1 -- 172.21.15.152:0/2345333933 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc034070 con 0x7fd4c01598e0 2024-03-18T15:01:01.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7fd4b7fff640 1 -- 172.21.15.152:0/2345333933 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4bc030860 con 0x7fd4c01598e0 2024-03-18T15:01:01.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7fd4b7fff640 1 -- 172.21.15.152:0/2345333933 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc030c30 con 0x7fd4c01598e0 2024-03-18T15:01:01.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7f65be2d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 0x7f65b8208c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7f65be2d1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80ce930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7f65b7fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 0x7f65b8208c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.046+0000 7f65b7fff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 0x7f65b8208c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:38950/0 (socket says 172.21.15.152:38950) 2024-03-18T15:01:01.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7f65b77fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80ce930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7f65b77fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80ce930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50540/0 (socket says 172.21.15.152:50540) 2024-03-18T15:01:01.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7f65be2d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 -- 172.21.15.152:0/2345333933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c01598e0 msgr2=0x7fd4c00b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/2345333933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c01598e0 0x7fd4c00b3740 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc009870 tx=0x7fd4bc02b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 -- 172.21.15.152:0/2345333933 shutdown_connections 2024-03-18T15:01:01.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/2345333933 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c0159cc0 0x7fd4c00d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/2345333933 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c01598e0 0x7fd4c00b3740 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 -- 172.21.15.152:0/2345333933 >> 172.21.15.152:0/2345333933 conn(0x7fd4c006b5e0 msgr2=0x7fd4c006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.048+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0f0004e030 con 0x7f0f08072f20 2024-03-18T15:01:01.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 -- 172.21.15.152:0/2345333933 shutdown_connections 2024-03-18T15:01:01.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7fd4c79f4640 1 -- 172.21.15.152:0/2345333933 wait complete. 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.049+0000 7fd4c79f4640 1 Processor -- start 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.050+0000 7fd4c79f4640 1 -- start start 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c006cc70 0x7fd4c0156310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 0x7fd4c009bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c00acd80 con 0x7fd4c0159cc0 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd4c01607f0 con 0x7fd4c01598e0 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c79f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd4c00acf00 con 0x7fd4c006cc70 2024-03-18T15:01:01.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.047+0000 7f65bc86e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c4f8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7f65bc86e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59520/0 (socket says 172.21.15.152:59520) 2024-03-18T15:01:01.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65b7fff640 1 -- 172.21.15.152:0/3333490430 learned_addr learned my addr 172.21.15.152:0/3333490430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65be2d1640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f65b8071fa0 con 0x7f65b80b3440 2024-03-18T15:01:01.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65be2d1640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f65b80d04f0 con 0x7f65b808b9e0 2024-03-18T15:01:01.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65be2d1640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f65b8072120 con 0x7f65b806cc70 2024-03-18T15:01:01.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.051+0000 7fd4c5f91640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 0x7fd4c009bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c4f8f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50552/0 (socket says 172.21.15.152:50552) 2024-03-18T15:01:01.056 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c5f91640 1 -- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c006cc70 msgr2=0x7fd4c0156310 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c5f91640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c006cc70 0x7fd4c0156310 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c5f91640 1 -- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 msgr2=0x7fd4c01548b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c5f91640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c5f91640 1 -- 172.21.15.152:0/1739831593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4c015d4f0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7fd4c5f91640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 0x7fd4c009bd70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c520 tx=0x7fd4b000c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00052d0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4c0201480 con 0x7fd4c0159cc0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4c015da50 con 0x7fd4c0159cc0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b0005470 con 0x7fd4c0159cc0 2024-03-18T15:01:01.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.054+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00052d0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65bc86e640 1 -- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 msgr2=0x7f65b8208c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7fd4c4f8f640 1 -- 172.21.15.152:0/1739831593 learned_addr learned my addr 172.21.15.152:0/1739831593 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.054+0000 7fd4c4f8f640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-03-18T15:01:01.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65bc86e640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 0x7f65b8208c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65bc86e640 1 -- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 msgr2=0x7f65b80ce930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65bc86e640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80ce930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.052+0000 7f65bc86e640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65b809cd50 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7f65bc86e640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c780 tx=0x7f65ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac0050d0 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.053+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65ac005270 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.055+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ac00a860 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.055+0000 7f65be2d1640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65b80cd890 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.056+0000 7f65be2d1640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65b80cde50 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.058+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f65ac00aa00 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.059+0000 7f65b4ff9640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 0x7f65a407f0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.059+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65b804f5b0 con 0x7f65b80b3440 2024-03-18T15:01:01.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.059+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f65ac08a580 con 0x7f65b80b3440 2024-03-18T15:01:01.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.060+0000 7f65b7fff640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 0x7f65a407f0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.059+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd4b0007020 con 0x7fd4c0159cc0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.060+0000 7fd4b5ffb640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 0x7fd4a406e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.060+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd4b00050d0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.060+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4a0005290 con 0x7fd4c0159cc0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.061+0000 7fd4c5790640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 0x7fd4a406e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.061+0000 7fd4c5790640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 0x7fd4a406e490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc036000 tx=0x7fd4bc03b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.062+0000 7f65b7fff640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 0x7f65a407f0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ca0 tx=0x7f65a8009000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.070+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f65b809cd50 con 0x7f65b80b3440 2024-03-18T15:01:01.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.077+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd4c015d4f0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.088 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.082+0000 7f54cffc6640 1 Processor -- start 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.083+0000 7f54cffc6640 1 -- start start 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f54c80b4070 0x7f54c806c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4450 0x7f54c806e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f54c806eb80 0x7f54c815bd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f54c806c140 con 0x7f54c80b4070 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f54c80b0000 con 0x7f54c806eb80 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54cffc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f54c806cb10 con 0x7f54c80b4450 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54ce563640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f54c806eb80 0x7f54c815bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54ce563640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f54c806eb80 0x7f54c815bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50554/0 (socket says 172.21.15.152:50554) 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.084+0000 7f54ce563640 1 -- 172.21.15.152:0/1796276898 learned_addr learned my addr 172.21.15.152:0/1796276898 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54cd561640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4450 0x7f54c806e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.089 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54cdd62640 1 --2- 172.21.15.152:0/1796276898 >> v2:172.21.15.152:3300/0 conn(0x7f54c80b4070 0x7f54c806c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54ce563640 1 -- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4450 msgr2=0x7f54c806e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54ce563640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4450 0x7f54c806e640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54ce563640 1 -- 172.21.15.152:0/1796276898 >> v2:172.21.15.152:3300/0 conn(0x7f54c80b4070 msgr2=0x7f54c806c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54ce563640 1 --2- 172.21.15.152:0/1796276898 >> v2:172.21.15.152:3300/0 conn(0x7f54c80b4070 0x7f54c806c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.085+0000 7f54ce563640 1 -- 172.21.15.152:0/1796276898 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c806b530 con 0x7f54c806eb80 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.087+0000 7f54ce563640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c806eb80 0x7f54c815bd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54c8073080 tx=0x7f54c004df30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa13ca06ea1dcdad server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.088+0000 7f54ccd60640 1 -- 172.21.15.152:0/1796276898 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c004ead0 con 0x7f54c806eb80 2024-03-18T15:01:01.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.088+0000 7f54ccd60640 1 -- 172.21.15.152:0/1796276898 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54c004ec70 con 0x7f54c806eb80 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54ccd60640 1 -- 172.21.15.152:0/1796276898 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54c004ee60 con 0x7f54c806eb80 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 -- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c806eb80 msgr2=0x7f54c815bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c806eb80 0x7f54c815bd60 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f54c8073080 tx=0x7f54c004df30 comp rx=0 tx=0).stop 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 -- 172.21.15.152:0/1796276898 shutdown_connections 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c806eb80 0x7f54c815bd60 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1796276898 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4450 0x7f54c806e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1796276898 >> v2:172.21.15.152:3300/0 conn(0x7f54c80b4070 0x7f54c806c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 -- 172.21.15.152:0/1796276898 >> 172.21.15.152:0/1796276898 conn(0x7f54c80d04d0 msgr2=0x7f54c80d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 -- 172.21.15.152:0/1796276898 shutdown_connections 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.089+0000 7f54cffc6640 1 -- 172.21.15.152:0/1796276898 wait complete. 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.090+0000 7fe2b0b22640 1 Processor -- start 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.090+0000 7fe2b0b22640 1 -- start start 2024-03-18T15:01:01.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe2ac165c80 0x7fe2ac073080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 0x7fe2ac166760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac0acfb0 con 0x7fe2ac1662d0 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe2ac166060 con 0x7fe2ac165c80 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7fe2b0b22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac09e070 con 0x7fe2ac166ca0 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.091+0000 7f54cffc6640 1 Processor -- start 2024-03-18T15:01:01.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe2ac165c80 0x7fe2ac073080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe2ac165c80 0x7fe2ac073080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50568/0 (socket says 172.21.15.152:50568) 2024-03-18T15:01:01.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 -- 172.21.15.152:0/1557080486 learned_addr learned my addr 172.21.15.152:0/1557080486 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.091+0000 7f54cffc6640 1 -- start start 2024-03-18T15:01:01.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7f54cffc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.092+0000 7f54cffc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4070 0x7f54c80a94b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2a9d9b640 1 --2- 172.21.15.152:0/1557080486 >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 0x7fe2ac166760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cdd62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 -- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 msgr2=0x7fe2ac06d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 -- 172.21.15.152:0/1557080486 >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 msgr2=0x7fe2ac166760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/1557080486 >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 0x7fe2ac166760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2aa59c640 1 -- 172.21.15.152:0/1557080486 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac06e480 con 0x7fe2ac165c80 2024-03-18T15:01:01.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7fe2a9d9b640 1 --2- 172.21.15.152:0/1557080486 >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 0x7fe2ac166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cdd62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59534/0 (socket says 172.21.15.152:59534) 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cffc6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c80b4450 0x7f54c80a99f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cffc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f54c806bdd0 con 0x7f54c806eb80 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cffc6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f54c806baf0 con 0x7f54c80b4450 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cffc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f54c806b1c0 con 0x7f54c80b4070 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cdd62640 1 -- 172.21.15.152:0/1570138910 learned_addr learned my addr 172.21.15.152:0/1570138910 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54ce563640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c80b4450 0x7f54c80a99f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac073080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b2d90 tx=0x7fe29c02b890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42f531de53664f73 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.093+0000 7f54cd561640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4070 0x7f54c80a94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7f54cdd62640 1 -- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4070 msgr2=0x7f54c80a94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7f54cdd62640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4070 0x7f54c80a94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7f54cdd62640 1 -- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c80b4450 msgr2=0x7f54c80a99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7f54cdd62640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c80b4450 0x7f54c80a99f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.095+0000 7fe2a959a640 1 -- 172.21.15.152:0/1557080486 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c0317f0 con 0x7fe2ac165c80 2024-03-18T15:01:01.099 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.094+0000 7f54cdd62640 1 -- 172.21.15.152:0/1570138910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f54c814e5d0 con 0x7f54c806eb80 2024-03-18T15:01:01.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.095+0000 7fe2a959a640 1 -- 172.21.15.152:0/1557080486 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c037070 con 0x7fe2ac165c80 2024-03-18T15:01:01.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.095+0000 7f54cdd62640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54b800ebb0 tx=0x7f54b800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.095+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b8028070 con 0x7f54c806eb80 2024-03-18T15:01:01.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.096+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54b800ed60 con 0x7f54c806eb80 2024-03-18T15:01:01.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.096+0000 7fe2b0b22640 1 -- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 msgr2=0x7fe2ac073080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.096+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac073080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b2d90 tx=0x7fe29c02b890 comp rx=0 tx=0).stop 2024-03-18T15:01:01.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.096+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f54c80ab5d0 con 0x7f54c806eb80 2024-03-18T15:01:01.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.096+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54c8147560 con 0x7f54c806eb80 2024-03-18T15:01:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.098+0000 7fe2b0b22640 1 -- 172.21.15.152:0/1557080486 shutdown_connections 2024-03-18T15:01:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.098+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac06d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.098+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/1557080486 >> v2:172.21.15.152:3300/0 conn(0x7fe2ac1662d0 0x7fe2ac166760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.098+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/1557080486 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac073080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.098+0000 7fe2b0b22640 1 -- 172.21.15.152:0/1557080486 >> 172.21.15.152:0/1557080486 conn(0x7fe2ac0b1cd0 msgr2=0x7fe2ac0b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.097+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54b800ce50 con 0x7f54c806eb80 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.099+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f54b0005290 con 0x7f54c806eb80 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.099+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f54b802b070 con 0x7f54c806eb80 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.099+0000 7f54be7fc640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 0x7f54ac06e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.099+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f54b809ba10 con 0x7f54c806eb80 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.100+0000 7f54cd561640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 0x7f54ac06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.101+0000 7f54cd561640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 0x7f54ac06e300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54c815b4b0 tx=0x7f54c4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.101+0000 7fe2b0b22640 1 -- 172.21.15.152:0/1557080486 shutdown_connections 2024-03-18T15:01:01.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.101+0000 7fe2b0b22640 1 -- 172.21.15.152:0/1557080486 wait complete. 2024-03-18T15:01:01.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.103+0000 7fe2b0b22640 1 Processor -- start 2024-03-18T15:01:01.104 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.103+0000 7fe2b0b22640 1 -- start start 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac13f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 0x7fe2ac140bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac142eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac1670f0 con 0x7fe2ac1662d0 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2ac06ea40 con 0x7fe2ac165c80 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.104+0000 7fe2b0b22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2ac06d710 con 0x7fe2ac166ca0 2024-03-18T15:01:01.105 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2a9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 0x7fe2ac140bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2a9d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 0x7fe2ac140bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59544/0 (socket says 172.21.15.152:59544) 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2a9d9b640 1 -- 172.21.15.152:0/2138830119 learned_addr learned my addr 172.21.15.152:0/2138830119 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac13f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aad9d640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac142eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 -- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 msgr2=0x7fe2ac142eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac142eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 -- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 msgr2=0x7fe2ac140bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 0x7fe2ac140bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.105+0000 7fe2aa59c640 1 -- 172.21.15.152:0/2138830119 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2ac13fdd0 con 0x7fe2ac165c80 2024-03-18T15:01:01.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.106+0000 7fe2aa59c640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac13f890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe29c033000 tx=0x7fe29c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.108+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c041070 con 0x7fe2ac165c80 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.108+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29c037040 con 0x7fe2ac165c80 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.108+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2ac09da00 con 0x7fe2ac165c80 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.109+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2ac09d720 con 0x7fe2ac165c80 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.109+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe29c045400 con 0x7fe2ac165c80 2024-03-18T15:01:01.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.109+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f54c814e5d0 con 0x7f54c806eb80 2024-03-18T15:01:01.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.111+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2ac04f5b0 con 0x7fe2ac165c80 2024-03-18T15:01:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.114+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe29c04c060 con 0x7fe2ac165c80 2024-03-18T15:01:01.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.114+0000 7fe29affd640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 0x7fe28c06e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.114+0000 7fe2a9d9b640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 0x7fe28c06e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.115+0000 7fe2a9d9b640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 0x7fe28c06e160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b03c0 tx=0x7fe2a4007a80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.115+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe29c0ac030 con 0x7fe2ac165c80 2024-03-18T15:01:01.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.121+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe29c07ab90 con 0x7fe2ac165c80 2024-03-18T15:01:01.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.195+0000 7fca77ec6640 1 Processor -- start 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.195+0000 7fca77ec6640 1 -- start start 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.196+0000 7fca77ec6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fca700d10d0 0x7fca70162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.196+0000 7fca77ec6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700b3440 con 0x7fca701622b0 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.196+0000 7fca77ec6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fca700d20a0 con 0x7fca7015ea90 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.196+0000 7fca77ec6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fca700d16c0 con 0x7fca700d10d0 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.197+0000 7fca76463640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fca7015ea90 0x7fca7015eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:48916/0 (socket says 172.21.15.152:48916) 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.197+0000 7fca76463640 1 -- 172.21.15.152:0/1332588906 learned_addr learned my addr 172.21.15.152:0/1332588906 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.197+0000 7fca75461640 1 --2- 172.21.15.152:0/1332588906 >> v2:172.21.15.152:3300/0 conn(0x7fca700d10d0 0x7fca70162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.198+0000 7fca75461640 1 -- 172.21.15.152:0/1332588906 >> v1:172.21.15.186:6789/0 conn(0x7fca7015ea90 legacy=0x7fca7015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.198+0000 7fca75461640 1 -- 172.21.15.152:0/1332588906 >> v1:172.21.15.152:6789/0 conn(0x7fca701622b0 legacy=0x7fca70162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.198+0000 7fca75461640 1 -- 172.21.15.152:0/1332588906 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700d2380 con 0x7fca700d10d0 2024-03-18T15:01:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.199+0000 7fca75461640 1 --2- 172.21.15.152:0/1332588906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700d10d0 0x7fca70162da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097d0 tx=0x7fca6c02b500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3542b1db864b75e1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.199+0000 7fca74c60640 1 -- 172.21.15.152:0/1332588906 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c037070 con 0x7fca700d10d0 2024-03-18T15:01:01.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.199+0000 7fca74c60640 1 -- 172.21.15.152:0/1332588906 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca6c030710 con 0x7fca700d10d0 2024-03-18T15:01:01.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.199+0000 7fca74c60640 1 -- 172.21.15.152:0/1332588906 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6c030ae0 con 0x7fca700d10d0 2024-03-18T15:01:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.200+0000 7fca77ec6640 1 -- 172.21.15.152:0/1332588906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700d10d0 msgr2=0x7fca70162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.200+0000 7fca77ec6640 1 --2- 172.21.15.152:0/1332588906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700d10d0 0x7fca70162da0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097d0 tx=0x7fca6c02b500 comp rx=0 tx=0).stop 2024-03-18T15:01:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.200+0000 7fca77ec6640 1 -- 172.21.15.152:0/1332588906 shutdown_connections 2024-03-18T15:01:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.200+0000 7fca77ec6640 1 --2- 172.21.15.152:0/1332588906 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700d10d0 0x7fca70162da0 secure :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fca6c0097d0 tx=0x7fca6c02b500 comp rx=0 tx=0).stop 2024-03-18T15:01:01.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.200+0000 7fca77ec6640 1 -- 172.21.15.152:0/1332588906 >> 172.21.15.152:0/1332588906 conn(0x7fca700d4070 msgr2=0x7fca700d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.204+0000 7fca77ec6640 1 -- 172.21.15.152:0/1332588906 shutdown_connections 2024-03-18T15:01:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.208+0000 7fca77ec6640 1 -- 172.21.15.152:0/1332588906 wait complete. 2024-03-18T15:01:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.209+0000 7fca77ec6640 1 Processor -- start 2024-03-18T15:01:01.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.210+0000 7fca77ec6640 1 -- start start 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca7015ea90 0x7fca700b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca701622b0 0x7fca700b85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca76463640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca76463640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59564/0 (socket says 172.21.15.152:59564) 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca76463640 1 -- 172.21.15.152:0/3016872832 learned_addr learned my addr 172.21.15.152:0/3016872832 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fca700cfc90 con 0x7fca700b6bf0 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fca700d2660 con 0x7fca7015ea90 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.211+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fca700cfe10 con 0x7fca701622b0 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 -- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca701622b0 msgr2=0x7fca700b85e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca701622b0 0x7fca700b85e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 -- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca7015ea90 msgr2=0x7fca700b5f30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T15:01:01.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca7015ea90 0x7fca700b5f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca700b7540 con 0x7fca700b6bf0 2024-03-18T15:01:01.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.212+0000 7fca76463640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca6800cbe0 tx=0x7fca6800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.213+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68018070 con 0x7fca700b6bf0 2024-03-18T15:01:01.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.214+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca700b7820 con 0x7fca700b6bf0 2024-03-18T15:01:01.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.214+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca700b7de0 con 0x7fca700b6bf0 2024-03-18T15:01:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.217+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca68004b60 con 0x7fca700b6bf0 2024-03-18T15:01:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.218+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6800ab40 con 0x7fca700b6bf0 2024-03-18T15:01:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.218+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fca6801b070 con 0x7fca700b6bf0 2024-03-18T15:01:01.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.218+0000 7fca667fc640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 0x7fca5406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.219+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fca6808a500 con 0x7fca700b6bf0 2024-03-18T15:01:01.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.219+0000 7fca75c62640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 0x7fca5406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.220+0000 7fca75c62640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 0x7fca5406e190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca60000f60 tx=0x7fca60007990 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.221+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca58005290 con 0x7fca700b6bf0 2024-03-18T15:01:01.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.230+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fca68058fd0 con 0x7fca700b6bf0 2024-03-18T15:01:01.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.369+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fdd8c005850 con 0x7fdda0039c00 2024-03-18T15:01:01.372 INFO:teuthology.orchestra.run.smithi152.stdout:64424509449 2024-03-18T15:01:01.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.369+0000 7fdd96ffd640 1 -- 172.21.15.152:0/2123683003 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdd9c05c3e0 con 0x7fdda0039c00 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 msgr2=0x7fdd8806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 0x7fdd8806e090 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fdda0054860 tx=0x7fdd98009190 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 msgr2=0x7fdda0185780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdd9c00c780 tx=0x7fdd9c00cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 shutdown_connections 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdda00e3810 0x7fdda004f360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdd8806bbd0 0x7fdd8806e090 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdda0050be0 0x7fdda004ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 --2- 172.21.15.152:0/2123683003 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdda0039c00 0x7fdda0185780 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 >> 172.21.15.152:0/2123683003 conn(0x7fdda0055bc0 msgr2=0x7fdda0006a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 shutdown_connections 2024-03-18T15:01:01.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.388+0000 7fdda759e640 1 -- 172.21.15.152:0/2123683003 wait complete. 2024-03-18T15:01:01.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509449 got 64424509449 for osd.2 2024-03-18T15:01:01.409 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.431 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.431+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fab64005580 con 0x7fab840d00e0 2024-03-18T15:01:01.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.432+0000 7fab6b7fe640 1 -- 172.21.15.152:0/1780841939 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fab7403f070 con 0x7fab840d00e0 2024-03-18T15:01:01.432 INFO:teuthology.orchestra.run.smithi152.stdout:64424509448 2024-03-18T15:01:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 msgr2=0x7fab7006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 0x7fab7006e160 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fab840b5280 tx=0x7fab78008040 comp rx=0 tx=0).stop 2024-03-18T15:01:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 msgr2=0x7fab841f8920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fab74009870 tx=0x7fab740046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 shutdown_connections 2024-03-18T15:01:01.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fab84143c20 0x7fab841fb500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fab7006bca0 0x7fab7006e160 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fab8414bdf0 0x7fab841f5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 --2- 172.21.15.152:0/1780841939 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fab840d00e0 0x7fab841f8920 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.436+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 >> 172.21.15.152:0/1780841939 conn(0x7fab8406b5e0 msgr2=0x7fab8406ca60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.437+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 shutdown_connections 2024-03-18T15:01:01.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.437+0000 7fab894ac640 1 -- 172.21.15.152:0/1780841939 wait complete. 2024-03-18T15:01:01.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.446+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fd4a0005850 con 0x7fd4c0159cc0 2024-03-18T15:01:01.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.447+0000 7fd4b5ffb640 1 -- 172.21.15.152:0/1739831593 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fd4c015d4f0 con 0x7fd4c0159cc0 2024-03-18T15:01:01.447 INFO:teuthology.orchestra.run.smithi152.stdout:55834574856 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 msgr2=0x7fd4a406e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 0x7fd4a406e490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc036000 tx=0x7fd4bc03b040 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 msgr2=0x7fd4c009bd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 0x7fd4c009bd70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000c520 tx=0x7fd4b000c9e0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 shutdown_connections 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4c0159cc0 0x7fd4c009bd70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4c01598e0 0x7fd4c01548b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd4a406bfd0 0x7fd4a406e490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 --2- 172.21.15.152:0/1739831593 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4c006cc70 0x7fd4c0156310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 >> 172.21.15.152:0/1739831593 conn(0x7fd4c006b5e0 msgr2=0x7fd4c00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.451+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 shutdown_connections 2024-03-18T15:01:01.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.452+0000 7fd4c79f4640 1 -- 172.21.15.152:0/1739831593 wait complete. 2024-03-18T15:01:01.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.1 2024-03-18T15:01:01.454 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.462+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f65b806ea40 con 0x7f65b80b3440 2024-03-18T15:01:01.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.463+0000 7f65b4ff9640 1 -- 172.21.15.152:0/3333490430 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f65ac019300 con 0x7f65b80b3440 2024-03-18T15:01:01.463 INFO:teuthology.orchestra.run.smithi152.stdout:60129542152 2024-03-18T15:01:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 msgr2=0x7f65a407f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 0x7f65a407f0f0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f65a8009ca0 tx=0x7f65a8009000 comp rx=0 tx=0).stop 2024-03-18T15:01:01.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 msgr2=0x7f65b809d8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f65ac00c780 tx=0x7f65ac00cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 shutdown_connections 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f65b80b3440 0x7f65b809d8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f65b808b9e0 0x7f65b80ce930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f65a407cc30 0x7f65a407f0f0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 --2- 172.21.15.152:0/3333490430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f65b806cc70 0x7f65b8208c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 >> 172.21.15.152:0/3333490430 conn(0x7f65b806b1c0 msgr2=0x7f65b80ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 shutdown_connections 2024-03-18T15:01:01.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.466+0000 7f659e7fc640 1 -- 172.21.15.152:0/3333490430 wait complete. 2024-03-18T15:01:01.468 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.0 2024-03-18T15:01:01.468 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.484 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542152 got 60129542152 for osd.7 2024-03-18T15:01:01.484 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.486+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fe2ac155bc0 con 0x7fe2ac165c80 2024-03-18T15:01:01.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.487+0000 7fe29affd640 1 -- 172.21.15.152:0/2138830119 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe29c07a490 con 0x7fe2ac165c80 2024-03-18T15:01:01.487 INFO:teuthology.orchestra.run.smithi152.stdout:60129542151 2024-03-18T15:01:01.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 msgr2=0x7fe28c06e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 0x7fe28c06e160 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac0b03c0 tx=0x7fe2a4007a80 comp rx=0 tx=0).stop 2024-03-18T15:01:01.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 msgr2=0x7fe2ac13f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac13f890 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fe29c033000 tx=0x7fe29c0046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 shutdown_connections 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe28c06bca0 0x7fe28c06e160 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2ac166ca0 0x7fe2ac142eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2ac1662d0 0x7fe2ac140bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 --2- 172.21.15.152:0/2138830119 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2ac165c80 0x7fe2ac13f890 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 >> 172.21.15.152:0/2138830119 conn(0x7fe2ac0b1cd0 msgr2=0x7fe2ac0b4950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 shutdown_connections 2024-03-18T15:01:01.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.489+0000 7fe2b0b22640 1 -- 172.21.15.152:0/2138830119 wait complete. 2024-03-18T15:01:01.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.496+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f54b0005580 con 0x7f54c806eb80 2024-03-18T15:01:01.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.496+0000 7f54be7fc640 1 -- 172.21.15.152:0/1570138910 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f54b8069e90 con 0x7f54c806eb80 2024-03-18T15:01:01.496 INFO:teuthology.orchestra.run.smithi152.stdout:60129542151 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 msgr2=0x7f54ac06e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 0x7f54ac06e300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f54c815b4b0 tx=0x7f54c4009190 comp rx=0 tx=0).stop 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 msgr2=0x7f54c814e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f54b800ebb0 tx=0x7f54b800c520 comp rx=0 tx=0).stop 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 shutdown_connections 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f54c80b4450 0x7f54c80a99f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f54ac06be40 0x7f54ac06e300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f54c80b4070 0x7f54c80a94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 --2- 172.21.15.152:0/1570138910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f54c806eb80 0x7f54c814e090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.499+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 >> 172.21.15.152:0/1570138910 conn(0x7f54c80d04d0 msgr2=0x7f54c80b51d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.500+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 shutdown_connections 2024-03-18T15:01:01.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.500+0000 7f54cffc6640 1 -- 172.21.15.152:0/1570138910 wait complete. 2024-03-18T15:01:01.503 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.4 2024-03-18T15:01:01.503 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.511 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.6 2024-03-18T15:01:01.511 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.545+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fca58005580 con 0x7fca700b6bf0 2024-03-18T15:01:01.546 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.546+0000 7fca667fc640 1 -- 172.21.15.152:0/3016872832 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca680588d0 con 0x7fca700b6bf0 2024-03-18T15:01:01.546 INFO:teuthology.orchestra.run.smithi152.stdout:64424509448 2024-03-18T15:01:01.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 msgr2=0x7fca5406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 0x7fca5406e190 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fca60000f60 tx=0x7fca60007990 comp rx=0 tx=0).stop 2024-03-18T15:01:01.548 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 msgr2=0x7fca7015d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fca6800cbe0 tx=0x7fca6800a430 comp rx=0 tx=0).stop 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 shutdown_connections 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fca700b6bf0 0x7fca7015d5e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fca5406bcd0 0x7fca5406e190 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fca701622b0 0x7fca700b85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 --2- 172.21.15.152:0/3016872832 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fca7015ea90 0x7fca700b5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 >> 172.21.15.152:0/3016872832 conn(0x7fca700d4070 msgr2=0x7fca700d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 shutdown_connections 2024-03-18T15:01:01.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.548+0000 7fca77ec6640 1 -- 172.21.15.152:0/3016872832 wait complete. 2024-03-18T15:01:01.559 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.3 2024-03-18T15:01:01.559 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.613+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f0f0814cd00 con 0x7f0f08072f20 2024-03-18T15:01:01.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.613+0000 7f0eef7fe640 1 -- 172.21.15.152:0/3170057408 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f0f00050300 con 0x7f0f08072f20 2024-03-18T15:01:01.614 INFO:teuthology.orchestra.run.smithi152.stdout:60129542150 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 msgr2=0x7f0ef406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 0x7f0ef406e190 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0efc000f60 tx=0x7f0efc007c40 comp rx=0 tx=0).stop 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 msgr2=0x7f0f080aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0f0002c1b0 tx=0x7f0f00004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 shutdown_connections 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0f080d01a0 0x7f0f080cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bcd0 0x7f0ef406e190 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f08072f20 0x7f0f080aef90 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 --2- 172.21.15.152:0/3170057408 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f0806bd50 0x7f0f0814c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 >> 172.21.15.152:0/3170057408 conn(0x7f0f0806b1c0 msgr2=0x7f0f0815c6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 shutdown_connections 2024-03-18T15:01:01.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.616+0000 7f0f0d353640 1 -- 172.21.15.152:0/3170057408 wait complete. 2024-03-18T15:01:01.628 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542150 got 60129542150 for osd.5 2024-03-18T15:01:01.628 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:01.628 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T15:01:01.628 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:01.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.729+0000 7fdbad77e640 1 Processor -- start 2024-03-18T15:01:01.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.729+0000 7fdbad77e640 1 -- start start 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdbad77e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 0x7fdba80d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdbad77e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdba80d2d50 0x7fdba80b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdbad77e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdba80d1200 con 0x7fdba80d1e40 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdbad77e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdba80cff90 con 0x7fdba80d2d50 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdbad77e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fdba80b34d0 con 0x7fdba815e5a0 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdba77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdba80d2d50 0x7fdba80b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdba77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdba80d2d50 0x7fdba80b3c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59572/0 (socket says 172.21.15.152:59572) 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdba77fe640 1 -- 172.21.15.152:0/4230383816 learned_addr learned my addr 172.21.15.152:0/4230383816 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.730+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/4230383816 >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 0x7fdba80d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba77fe640 1 -- 172.21.15.152:0/4230383816 >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 msgr2=0x7fdba80d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba77fe640 1 --2- 172.21.15.152:0/4230383816 >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 0x7fdba80d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba77fe640 1 -- 172.21.15.152:0/4230383816 >> v1:172.21.15.186:6789/0 conn(0x7fdba80d1e40 legacy=0x7fdba80d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba77fe640 1 -- 172.21.15.152:0/4230383816 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba80d14e0 con 0x7fdba80d2d50 2024-03-18T15:01:01.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/4230383816 >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 0x7fdba80d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:01.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba77fe640 1 --2- 172.21.15.152:0/4230383816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba80d2d50 0x7fdba80b3c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdba80d1b60 tx=0x7fdba002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31fc9808b50cc2a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba5ffb640 1 -- 172.21.15.152:0/4230383816 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba002ca80 con 0x7fdba80d2d50 2024-03-18T15:01:01.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba5ffb640 1 -- 172.21.15.152:0/4230383816 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba002cc20 con 0x7fdba80d2d50 2024-03-18T15:01:01.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.731+0000 7fdba5ffb640 1 -- 172.21.15.152:0/4230383816 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba00343f0 con 0x7fdba80d2d50 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 -- 172.21.15.152:0/4230383816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba80d2d50 msgr2=0x7fdba80b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 --2- 172.21.15.152:0/4230383816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba80d2d50 0x7fdba80b3c40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdba80d1b60 tx=0x7fdba002bee0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 -- 172.21.15.152:0/4230383816 shutdown_connections 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 --2- 172.21.15.152:0/4230383816 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba80d2d50 0x7fdba80b3c40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 --2- 172.21.15.152:0/4230383816 >> v2:172.21.15.186:3300/0 conn(0x7fdba815e5a0 0x7fdba80d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 -- 172.21.15.152:0/4230383816 >> 172.21.15.152:0/4230383816 conn(0x7fdba80d4060 msgr2=0x7fdba80d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 -- 172.21.15.152:0/4230383816 shutdown_connections 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.732+0000 7fdbad77e640 1 -- 172.21.15.152:0/4230383816 wait complete. 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.733+0000 7fdbad77e640 1 Processor -- start 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.733+0000 7fdbad77e640 1 -- start start 2024-03-18T15:01:01.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 0x7fdba8156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdba80d2d50 0x7fdba80b6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80b4300 con 0x7fdba815e5a0 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdba80b4180 con 0x7fdba80d2d50 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdbad77e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdba80b4480 con 0x7fdba80d1e40 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdba77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59578/0 (socket says 172.21.15.152:59578) 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdba77fe640 1 -- 172.21.15.152:0/2068572925 learned_addr learned my addr 172.21.15.152:0/2068572925 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdba67fc640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdba80d2d50 0x7fdba80b6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.734+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 0x7fdba8156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 -- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 msgr2=0x7fdba8156370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 0x7fdba8156370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 -- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdba80d2d50 msgr2=0x7fdba80b6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdba80d2d50 0x7fdba80b6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 -- 172.21.15.152:0/2068572925 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdba80b75c0 con 0x7fdba815e5a0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 0x7fdba8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdba77fe640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdba0036040 tx=0x7fdba0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0043020 con 0x7fdba815e5a0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdba003e450 con 0x7fdba815e5a0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdba80b78a0 con 0x7fdba815e5a0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdba0009510 con 0x7fdba815e5a0 2024-03-18T15:01:01.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.735+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdba80b7e60 con 0x7fdba815e5a0 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.736+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdba0005d10 con 0x7fdba815e5a0 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.736+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdba804f5b0 con 0x7fdba815e5a0 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.737+0000 7fdb8f7fe640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 0x7fdb9406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.737+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 0x7fdb9406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.737+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdba00ad410 con 0x7fdba815e5a0 2024-03-18T15:01:01.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.737+0000 7fdba6ffd640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 0x7fdb9406e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006fd0 tx=0x7fdb9c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:01.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.741+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdba007bf90 con 0x7fdba815e5a0 2024-03-18T15:01:01.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.949+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdba80b4b00 con 0x7fdb9406bbd0 2024-03-18T15:01:01.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.955+0000 7fdb8f7fe640 1 -- 172.21.15.152:0/2068572925 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7fdba80b4b00 con 0x7fdb9406bbd0 2024-03-18T15:01:01.958 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:01.959 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:01.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.958+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 msgr2=0x7fdb9406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.958+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 0x7fdb9406e090 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c006fd0 tx=0x7fdb9c008040 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.958+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 msgr2=0x7fdba80b8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.958+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdba0036040 tx=0x7fdba0004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 shutdown_connections 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdba815e5a0 0x7fdba80b8660 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdba80d2d50 0x7fdba80b6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb9406bbd0 0x7fdb9406e090 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 --2- 172.21.15.152:0/2068572925 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdba80d1e40 0x7fdba8156370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 >> 172.21.15.152:0/2068572925 conn(0x7fdba80d4060 msgr2=0x7fdba806d0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 shutdown_connections 2024-03-18T15:01:01.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:01.959+0000 7fdbad77e640 1 -- 172.21.15.152:0/2068572925 wait complete. 2024-03-18T15:01:01.970 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-03-18T15:01:01.807116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223312,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751408,"statfs":{"total":773094113280,"available":772865441792,"internally_reserved":0,"allocated":3022848,"data_stored":1809972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.206943"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620901+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:50.620901+0000","last_peered":"2024-03-18T15:00:50.620901+0000","last_clean":"2024-03-18T15:00:50.620901+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:50.620901+0000","last_undegraded":"2024-03-18T15:00:50.620901+0000","last_fullsized":"2024-03-18T15:00:50.620901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620369+0000","last_change":"2024-03-18T15:00:49.603216+0000","last_active":"2024-03-18T15:00:50.620369+0000","last_peered":"2024-03-18T15:00:50.620369+0000","last_clean":"2024-03-18T15:00:50.620369+0000","last_became_active":"2024-03-18T15:00:49.602932+0000","last_became_peered":"2024-03-18T15:00:49.602932+0000","last_unstale":"2024-03-18T15:00:50.620369+0000","last_undegraded":"2024-03-18T15:00:50.620369+0000","last_fullsized":"2024-03-18T15:00:50.620369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604634+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:50.604634+0000","last_peered":"2024-03-18T15:00:50.604634+0000","last_clean":"2024-03-18T15:00:50.604634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.604634+0000","last_undegraded":"2024-03-18T15:00:50.604634+0000","last_fullsized":"2024-03-18T15:00:50.604634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620537+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:50.620537+0000","last_peered":"2024-03-18T15:00:50.620537+0000","last_clean":"2024-03-18T15:00:50.620537+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:50.620537+0000","last_undegraded":"2024-03-18T15:00:50.620537+0000","last_fullsized":"2024-03-18T15:00:50.620537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604133+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:50.604133+0000","last_peered":"2024-03-18T15:00:50.604133+0000","last_clean":"2024-03-18T15:00:50.604133+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:50.604133+0000","last_undegraded":"2024-03-18T15:00:50.604133+0000","last_fullsized":"2024-03-18T15:00:50.604133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620249+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:50.620249+0000","last_peered":"2024-03-18T15:00:50.620249+0000","last_clean":"2024-03-18T15:00:50.620249+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:50.620249+0000","last_undegraded":"2024-03-18T15:00:50.620249+0000","last_fullsized":"2024-03-18T15:00:50.620249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620908+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:50.620908+0000","last_peered":"2024-03-18T15:00:50.620908+0000","last_clean":"2024-03-18T15:00:50.620908+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:50.620908+0000","last_undegraded":"2024-03-18T15:00:50.620908+0000","last_fullsized":"2024-03-18T15:00:50.620908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620515+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:50.620515+0000","last_peered":"2024-03-18T15:00:50.620515+0000","last_clean":"2024-03-18T15:00:50.620515+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:50.620515+0000","last_undegraded":"2024-03-18T15:00:50.620515+0000","last_fullsized":"2024-03-18T15:00:50.620515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:36:52.555465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620200+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:50.620200+0000","last_peered":"2024-03-18T15:00:50.620200+0000","last_clean":"2024-03-18T15:00:50.620200+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:50.620200+0000","last_undegraded":"2024-03-18T15:00:50.620200+0000","last_fullsized":"2024-03-18T15:00:50.620200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603266+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:50.603266+0000","last_peered":"2024-03-18T15:00:50.603266+0000","last_clean":"2024-03-18T15:00:50.603266+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:50.603266+0000","last_undegraded":"2024-03-18T15:00:50.603266+0000","last_fullsized":"2024-03-18T15:00:50.603266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:23.089072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620271+0000","last_change":"2024-03-18T15:00:49.604557+0000","last_active":"2024-03-18T15:00:50.620271+0000","last_peered":"2024-03-18T15:00:50.620271+0000","last_clean":"2024-03-18T15:00:50.620271+0000","last_became_active":"2024-03-18T15:00:49.604266+0000","last_became_peered":"2024-03-18T15:00:49.604266+0000","last_unstale":"2024-03-18T15:00:50.620271+0000","last_undegraded":"2024-03-18T15:00:50.620271+0000","last_fullsized":"2024-03-18T15:00:50.620271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603310+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:50.603310+0000","last_peered":"2024-03-18T15:00:50.603310+0000","last_clean":"2024-03-18T15:00:50.603310+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:50.603310+0000","last_undegraded":"2024-03-18T15:00:50.603310+0000","last_fullsized":"2024-03-18T15:00:50.603310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604025+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:50.604025+0000","last_peered":"2024-03-18T15:00:50.604025+0000","last_clean":"2024-03-18T15:00:50.604025+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:50.604025+0000","last_undegraded":"2024-03-18T15:00:50.604025+0000","last_fullsized":"2024-03-18T15:00:50.604025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621040+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:50.621040+0000","last_peered":"2024-03-18T15:00:50.621040+0000","last_clean":"2024-03-18T15:00:50.621040+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:50.621040+0000","last_undegraded":"2024-03-18T15:00:50.621040+0000","last_fullsized":"2024-03-18T15:00:50.621040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:26:34.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620412+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:50.620412+0000","last_peered":"2024-03-18T15:00:50.620412+0000","last_clean":"2024-03-18T15:00:50.620412+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:50.620412+0000","last_undegraded":"2024-03-18T15:00:50.620412+0000","last_fullsized":"2024-03-18T15:00:50.620412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620636+0000","last_change":"2024-03-18T15:00:49.607455+0000","last_active":"2024-03-18T15:00:50.620636+0000","last_peered":"2024-03-18T15:00:50.620636+0000","last_clean":"2024-03-18T15:00:50.620636+0000","last_became_active":"2024-03-18T15:00:49.607104+0000","last_became_peered":"2024-03-18T15:00:49.607104+0000","last_unstale":"2024-03-18T15:00:50.620636+0000","last_undegraded":"2024-03-18T15:00:50.620636+0000","last_fullsized":"2024-03-18T15:00:50.620636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604248+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:50.604248+0000","last_peered":"2024-03-18T15:00:50.604248+0000","last_clean":"2024-03-18T15:00:50.604248+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:50.604248+0000","last_undegraded":"2024-03-18T15:00:50.604248+0000","last_fullsized":"2024-03-18T15:00:50.604248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603478+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:50.603478+0000","last_peered":"2024-03-18T15:00:50.603478+0000","last_clean":"2024-03-18T15:00:50.603478+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:50.603478+0000","last_undegraded":"2024-03-18T15:00:50.603478+0000","last_fullsized":"2024-03-18T15:00:50.603478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620664+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:50.620664+0000","last_peered":"2024-03-18T15:00:50.620664+0000","last_clean":"2024-03-18T15:00:50.620664+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:50.620664+0000","last_undegraded":"2024-03-18T15:00:50.620664+0000","last_fullsized":"2024-03-18T15:00:50.620664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:49:37.471400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620766+0000","last_change":"2024-03-18T15:00:49.612185+0000","last_active":"2024-03-18T15:00:50.620766+0000","last_peered":"2024-03-18T15:00:50.620766+0000","last_clean":"2024-03-18T15:00:50.620766+0000","last_became_active":"2024-03-18T15:00:49.611939+0000","last_became_peered":"2024-03-18T15:00:49.611939+0000","last_unstale":"2024-03-18T15:00:50.620766+0000","last_undegraded":"2024-03-18T15:00:50.620766+0000","last_fullsized":"2024-03-18T15:00:50.620766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604331+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:50.604331+0000","last_peered":"2024-03-18T15:00:50.604331+0000","last_clean":"2024-03-18T15:00:50.604331+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:50.604331+0000","last_undegraded":"2024-03-18T15:00:50.604331+0000","last_fullsized":"2024-03-18T15:00:50.604331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620097+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:50.620097+0000","last_peered":"2024-03-18T15:00:50.620097+0000","last_clean":"2024-03-18T15:00:50.620097+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:50.620097+0000","last_undegraded":"2024-03-18T15:00:50.620097+0000","last_fullsized":"2024-03-18T15:00:50.620097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604324+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:50.604324+0000","last_peered":"2024-03-18T15:00:50.604324+0000","last_clean":"2024-03-18T15:00:50.604324+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:50.604324+0000","last_undegraded":"2024-03-18T15:00:50.604324+0000","last_fullsized":"2024-03-18T15:00:50.604324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620882+0000","last_change":"2024-03-18T15:00:49.608853+0000","last_active":"2024-03-18T15:00:50.620882+0000","last_peered":"2024-03-18T15:00:50.620882+0000","last_clean":"2024-03-18T15:00:50.620882+0000","last_became_active":"2024-03-18T15:00:49.608585+0000","last_became_peered":"2024-03-18T15:00:49.608585+0000","last_unstale":"2024-03-18T15:00:50.620882+0000","last_undegraded":"2024-03-18T15:00:50.620882+0000","last_fullsized":"2024-03-18T15:00:50.620882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620169+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:50.620169+0000","last_peered":"2024-03-18T15:00:50.620169+0000","last_clean":"2024-03-18T15:00:50.620169+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:50.620169+0000","last_undegraded":"2024-03-18T15:00:50.620169+0000","last_fullsized":"2024-03-18T15:00:50.620169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603605+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:50.603605+0000","last_peered":"2024-03-18T15:00:50.603605+0000","last_clean":"2024-03-18T15:00:50.603605+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:50.603605+0000","last_undegraded":"2024-03-18T15:00:50.603605+0000","last_fullsized":"2024-03-18T15:00:50.603605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620256+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:50.620256+0000","last_peered":"2024-03-18T15:00:50.620256+0000","last_clean":"2024-03-18T15:00:50.620256+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:50.620256+0000","last_undegraded":"2024-03-18T15:00:50.620256+0000","last_fullsized":"2024-03-18T15:00:50.620256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603929+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:50.603929+0000","last_peered":"2024-03-18T15:00:50.603929+0000","last_clean":"2024-03-18T15:00:50.603929+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:50.603929+0000","last_undegraded":"2024-03-18T15:00:50.603929+0000","last_fullsized":"2024-03-18T15:00:50.603929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604039+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:50.604039+0000","last_peered":"2024-03-18T15:00:50.604039+0000","last_clean":"2024-03-18T15:00:50.604039+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:50.604039+0000","last_undegraded":"2024-03-18T15:00:50.604039+0000","last_fullsized":"2024-03-18T15:00:50.604039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621239+0000","last_change":"2024-03-18T15:00:49.616126+0000","last_active":"2024-03-18T15:00:50.621239+0000","last_peered":"2024-03-18T15:00:50.621239+0000","last_clean":"2024-03-18T15:00:50.621239+0000","last_became_active":"2024-03-18T15:00:49.615785+0000","last_became_peered":"2024-03-18T15:00:49.615785+0000","last_unstale":"2024-03-18T15:00:50.621239+0000","last_undegraded":"2024-03-18T15:00:50.621239+0000","last_fullsized":"2024-03-18T15:00:50.621239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603418+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:50.603418+0000","last_peered":"2024-03-18T15:00:50.603418+0000","last_clean":"2024-03-18T15:00:50.603418+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:50.603418+0000","last_undegraded":"2024-03-18T15:00:50.603418+0000","last_fullsized":"2024-03-18T15:00:50.603418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:08.152207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620519+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:50.620519+0000","last_peered":"2024-03-18T15:00:50.620519+0000","last_clean":"2024-03-18T15:00:50.620519+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:50.620519+0000","last_undegraded":"2024-03-18T15:00:50.620519+0000","last_fullsized":"2024-03-18T15:00:50.620519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620754+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:50.620754+0000","last_peered":"2024-03-18T15:00:50.620754+0000","last_clean":"2024-03-18T15:00:50.620754+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.620754+0000","last_undegraded":"2024-03-18T15:00:50.620754+0000","last_fullsized":"2024-03-18T15:00:50.620754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620957+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:50.620957+0000","last_peered":"2024-03-18T15:00:50.620957+0000","last_clean":"2024-03-18T15:00:50.620957+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:50.620957+0000","last_undegraded":"2024-03-18T15:00:50.620957+0000","last_fullsized":"2024-03-18T15:00:50.620957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:49.079685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620377+0000","last_change":"2024-03-18T15:00:49.607347+0000","last_active":"2024-03-18T15:00:50.620377+0000","last_peered":"2024-03-18T15:00:50.620377+0000","last_clean":"2024-03-18T15:00:50.620377+0000","last_became_active":"2024-03-18T15:00:49.607022+0000","last_became_peered":"2024-03-18T15:00:49.607022+0000","last_unstale":"2024-03-18T15:00:50.620377+0000","last_undegraded":"2024-03-18T15:00:50.620377+0000","last_fullsized":"2024-03-18T15:00:50.620377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604347+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:50.604347+0000","last_peered":"2024-03-18T15:00:50.604347+0000","last_clean":"2024-03-18T15:00:50.604347+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:50.604347+0000","last_undegraded":"2024-03-18T15:00:50.604347+0000","last_fullsized":"2024-03-18T15:00:50.604347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620710+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:50.620710+0000","last_peered":"2024-03-18T15:00:50.620710+0000","last_clean":"2024-03-18T15:00:50.620710+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:50.620710+0000","last_undegraded":"2024-03-18T15:00:50.620710+0000","last_fullsized":"2024-03-18T15:00:50.620710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620037+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:50.620037+0000","last_peered":"2024-03-18T15:00:50.620037+0000","last_clean":"2024-03-18T15:00:50.620037+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:50.620037+0000","last_undegraded":"2024-03-18T15:00:50.620037+0000","last_fullsized":"2024-03-18T15:00:50.620037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620388+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:50.620388+0000","last_peered":"2024-03-18T15:00:50.620388+0000","last_clean":"2024-03-18T15:00:50.620388+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:50.620388+0000","last_undegraded":"2024-03-18T15:00:50.620388+0000","last_fullsized":"2024-03-18T15:00:50.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620495+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:50.620495+0000","last_peered":"2024-03-18T15:00:50.620495+0000","last_clean":"2024-03-18T15:00:50.620495+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:50.620495+0000","last_undegraded":"2024-03-18T15:00:50.620495+0000","last_fullsized":"2024-03-18T15:00:50.620495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603700+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:50.603700+0000","last_peered":"2024-03-18T15:00:50.603700+0000","last_clean":"2024-03-18T15:00:50.603700+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:50.603700+0000","last_undegraded":"2024-03-18T15:00:50.603700+0000","last_fullsized":"2024-03-18T15:00:50.603700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620614+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:50.620614+0000","last_peered":"2024-03-18T15:00:50.620614+0000","last_clean":"2024-03-18T15:00:50.620614+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:50.620614+0000","last_undegraded":"2024-03-18T15:00:50.620614+0000","last_fullsized":"2024-03-18T15:00:50.620614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621073+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:50.621073+0000","last_peered":"2024-03-18T15:00:50.621073+0000","last_clean":"2024-03-18T15:00:50.621073+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:50.621073+0000","last_undegraded":"2024-03-18T15:00:50.621073+0000","last_fullsized":"2024-03-18T15:00:50.621073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:02.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604738+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:50.604738+0000","last_peered":"2024-03-18T15:00:50.604738+0000","last_clean":"2024-03-18T15:00:50.604738+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:50.604738+0000","last_undegraded":"2024-03-18T15:00:50.604738+0000","last_fullsized":"2024-03-18T15:00:50.604738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620895+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:50.620895+0000","last_peered":"2024-03-18T15:00:50.620895+0000","last_clean":"2024-03-18T15:00:50.620895+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:50.620895+0000","last_undegraded":"2024-03-18T15:00:50.620895+0000","last_fullsized":"2024-03-18T15:00:50.620895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620601+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:50.620601+0000","last_peered":"2024-03-18T15:00:50.620601+0000","last_clean":"2024-03-18T15:00:50.620601+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:50.620601+0000","last_undegraded":"2024-03-18T15:00:50.620601+0000","last_fullsized":"2024-03-18T15:00:50.620601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603786+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:50.603786+0000","last_peered":"2024-03-18T15:00:50.603786+0000","last_clean":"2024-03-18T15:00:50.603786+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:50.603786+0000","last_undegraded":"2024-03-18T15:00:50.603786+0000","last_fullsized":"2024-03-18T15:00:50.603786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619985+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:50.619985+0000","last_peered":"2024-03-18T15:00:50.619985+0000","last_clean":"2024-03-18T15:00:50.619985+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:50.619985+0000","last_undegraded":"2024-03-18T15:00:50.619985+0000","last_fullsized":"2024-03-18T15:00:50.619985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620140+0000","last_change":"2024-03-18T15:00:49.610465+0000","last_active":"2024-03-18T15:00:50.620140+0000","last_peered":"2024-03-18T15:00:50.620140+0000","last_clean":"2024-03-18T15:00:50.620140+0000","last_became_active":"2024-03-18T15:00:49.610044+0000","last_became_peered":"2024-03-18T15:00:49.610044+0000","last_unstale":"2024-03-18T15:00:50.620140+0000","last_undegraded":"2024-03-18T15:00:50.620140+0000","last_fullsized":"2024-03-18T15:00:50.620140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604433+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:50.604433+0000","last_peered":"2024-03-18T15:00:50.604433+0000","last_clean":"2024-03-18T15:00:50.604433+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:50.604433+0000","last_undegraded":"2024-03-18T15:00:50.604433+0000","last_fullsized":"2024-03-18T15:00:50.604433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604572+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:50.604572+0000","last_peered":"2024-03-18T15:00:50.604572+0000","last_clean":"2024-03-18T15:00:50.604572+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:50.604572+0000","last_undegraded":"2024-03-18T15:00:50.604572+0000","last_fullsized":"2024-03-18T15:00:50.604572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603787+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:50.603787+0000","last_peered":"2024-03-18T15:00:50.603787+0000","last_clean":"2024-03-18T15:00:50.603787+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:50.603787+0000","last_undegraded":"2024-03-18T15:00:50.603787+0000","last_fullsized":"2024-03-18T15:00:50.603787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621006+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:50.621006+0000","last_peered":"2024-03-18T15:00:50.621006+0000","last_clean":"2024-03-18T15:00:50.621006+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:50.621006+0000","last_undegraded":"2024-03-18T15:00:50.621006+0000","last_fullsized":"2024-03-18T15:00:50.621006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.819937+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.819937+0000","last_peered":"2024-03-18T15:00:50.819937+0000","last_clean":"2024-03-18T15:00:50.819937+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.819937+0000","last_undegraded":"2024-03-18T15:00:50.819937+0000","last_fullsized":"2024-03-18T15:00:50.819937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620360+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:50.620360+0000","last_peered":"2024-03-18T15:00:50.620360+0000","last_clean":"2024-03-18T15:00:50.620360+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:50.620360+0000","last_undegraded":"2024-03-18T15:00:50.620360+0000","last_fullsized":"2024-03-18T15:00:50.620360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620538+0000","last_change":"2024-03-18T15:00:49.604968+0000","last_active":"2024-03-18T15:00:50.620538+0000","last_peered":"2024-03-18T15:00:50.620538+0000","last_clean":"2024-03-18T15:00:50.620538+0000","last_became_active":"2024-03-18T15:00:49.604691+0000","last_became_peered":"2024-03-18T15:00:49.604691+0000","last_unstale":"2024-03-18T15:00:50.620538+0000","last_undegraded":"2024-03-18T15:00:50.620538+0000","last_fullsized":"2024-03-18T15:00:50.620538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.049398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619995+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:50.619995+0000","last_peered":"2024-03-18T15:00:50.619995+0000","last_clean":"2024-03-18T15:00:50.619995+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:50.619995+0000","last_undegraded":"2024-03-18T15:00:50.619995+0000","last_fullsized":"2024-03-18T15:00:50.619995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603241+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:50.603241+0000","last_peered":"2024-03-18T15:00:50.603241+0000","last_clean":"2024-03-18T15:00:50.603241+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:50.603241+0000","last_undegraded":"2024-03-18T15:00:50.603241+0000","last_fullsized":"2024-03-18T15:00:50.603241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:19.757700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620674+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:50.620674+0000","last_peered":"2024-03-18T15:00:50.620674+0000","last_clean":"2024-03-18T15:00:50.620674+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:50.620674+0000","last_undegraded":"2024-03-18T15:00:50.620674+0000","last_fullsized":"2024-03-18T15:00:50.620674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620069+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:50.620069+0000","last_peered":"2024-03-18T15:00:50.620069+0000","last_clean":"2024-03-18T15:00:50.620069+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:50.620069+0000","last_undegraded":"2024-03-18T15:00:50.620069+0000","last_fullsized":"2024-03-18T15:00:50.620069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603679+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:50.603679+0000","last_peered":"2024-03-18T15:00:50.603679+0000","last_clean":"2024-03-18T15:00:50.603679+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:50.603679+0000","last_undegraded":"2024-03-18T15:00:50.603679+0000","last_fullsized":"2024-03-18T15:00:50.603679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620575+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:50.620575+0000","last_peered":"2024-03-18T15:00:50.620575+0000","last_clean":"2024-03-18T15:00:50.620575+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:50.620575+0000","last_undegraded":"2024-03-18T15:00:50.620575+0000","last_fullsized":"2024-03-18T15:00:50.620575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604641+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:50.604641+0000","last_peered":"2024-03-18T15:00:50.604641+0000","last_clean":"2024-03-18T15:00:50.604641+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:50.604641+0000","last_undegraded":"2024-03-18T15:00:50.604641+0000","last_fullsized":"2024-03-18T15:00:50.604641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620859+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:50.620859+0000","last_peered":"2024-03-18T15:00:50.620859+0000","last_clean":"2024-03-18T15:00:50.620859+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:50.620859+0000","last_undegraded":"2024-03-18T15:00:50.620859+0000","last_fullsized":"2024-03-18T15:00:50.620859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621075+0000","last_change":"2024-03-18T15:00:49.616193+0000","last_active":"2024-03-18T15:00:50.621075+0000","last_peered":"2024-03-18T15:00:50.621075+0000","last_clean":"2024-03-18T15:00:50.621075+0000","last_became_active":"2024-03-18T15:00:49.615875+0000","last_became_peered":"2024-03-18T15:00:49.615875+0000","last_unstale":"2024-03-18T15:00:50.621075+0000","last_undegraded":"2024-03-18T15:00:50.621075+0000","last_fullsized":"2024-03-18T15:00:50.621075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621370+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:50.621370+0000","last_peered":"2024-03-18T15:00:50.621370+0000","last_clean":"2024-03-18T15:00:50.621370+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:50.621370+0000","last_undegraded":"2024-03-18T15:00:50.621370+0000","last_fullsized":"2024-03-18T15:00:50.621370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:22.506254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":78052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:01.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:02.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.112+0000 7fee11620640 1 Processor -- start 2024-03-18T15:01:02.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.112+0000 7fee11620640 1 -- start start 2024-03-18T15:01:02.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee11620640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fee0c15f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee11620640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0b3440 con 0x7fee0c1622b0 2024-03-18T15:01:02.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee11620640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee0c0d20a0 con 0x7fee0c0d10d0 2024-03-18T15:01:02.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee11620640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0d16c0 con 0x7fee0c162da0 2024-03-18T15:01:02.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0affd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fee0c1622b0 0x7fee0c162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44002/0 (socket says 172.21.15.152:44002) 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0affd640 1 -- 172.21.15.152:0/2588598543 learned_addr learned my addr 172.21.15.152:0/2588598543 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fee0c15f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2065340070 0 0) 0x7fee0c0b3440 con 0x7fee0c1622b0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedf8003520 con 0x7fee0c1622b0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3336615406 0 0) 0x7fedf8003520 con 0x7fee0c1622b0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 msgr2=0x7fee0c15f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fee0c15f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 >> v1:172.21.15.186:6789/0 conn(0x7fee0c0d10d0 legacy=0x7fee0c15ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0d2380 con 0x7fee0c1622b0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fedfc001670 con 0x7fee0c1622b0 2024-03-18T15:01:02.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 >> v1:172.21.15.152:6789/0 conn(0x7fee0c1622b0 legacy=0x7fee0c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedf8003a50 0x7fedf8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fedf8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8004d40 0x7fedf80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0d16c0 con 0x7fedf8003a50 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fedf800bbf0 con 0x7fedf8004d40 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fedf800bdf0 con 0x7fee0c162da0 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.113+0000 7fee0affd640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedf8003a50 0x7fedf8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8004d40 0x7fedf80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee03fff640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fedf8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0affd640 1 -- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 msgr2=0x7fedf8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0affd640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c162da0 0x7fedf8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0affd640 1 -- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8004d40 msgr2=0x7fedf80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0affd640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8004d40 0x7fedf80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0affd640 1 -- 172.21.15.152:0/2588598543 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf8003520 con 0x7fedf8003a50 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.114+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8004d40 0x7fedf80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee0affd640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedf8003a50 0x7fedf8003e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00c210 tx=0x7fedf8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d65705c17d1d1ac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc007d30 con 0x7fedf8003a50 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedfc030070 con 0x7fedf8003a50 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee0a7fc640 1 -- 172.21.15.152:0/2588598543 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedfc02cd60 con 0x7fedf8003a50 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee11620640 1 -- 172.21.15.152:0/2588598543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedf8003a50 msgr2=0x7fedf8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee11620640 1 --2- 172.21.15.152:0/2588598543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fedf8003a50 0x7fedf8003e70 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fedfc00c210 tx=0x7fedf8005830 comp rx=0 tx=0).stop 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.115+0000 7fee0b7fe640 1 -- 172.21.15.152:0/2588598543 reap_dead start 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.116+0000 7fee11620640 1 -- 172.21.15.152:0/2588598543 shutdown_connections 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.116+0000 7fee11620640 1 -- 172.21.15.152:0/2588598543 >> 172.21.15.152:0/2588598543 conn(0x7fee0c0d4070 msgr2=0x7fee0c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:02.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.116+0000 7fee11620640 1 -- 172.21.15.152:0/2588598543 shutdown_connections 2024-03-18T15:01:02.120 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.116+0000 7fee11620640 1 -- 172.21.15.152:0/2588598543 wait complete. 2024-03-18T15:01:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 Processor -- start 2024-03-18T15:01:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 -- start start 2024-03-18T15:01:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 0x7fee0c0b8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 0x7fee0c0cd160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0cfc90 con 0x7fee0c1599e0 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fee0c0d2660 con 0x7fedf8003a50 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee11620640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fee0c0cfe10 con 0x7fee0c159560 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.117+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59584/0 (socket says 172.21.15.152:59584) 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 -- 172.21.15.152:0/3829025067 learned_addr learned my addr 172.21.15.152:0/3829025067 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0affd640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 0x7fee0c0b8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee03fff640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 0x7fee0c0cd160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 -- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 msgr2=0x7fee0c0cd160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 0x7fee0c0cd160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 -- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 msgr2=0x7fee0c0b8980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 0x7fee0c0b8980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 -- 172.21.15.152:0/3829025067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee0c0b9ac0 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0affd640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 0x7fee0c0b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee03fff640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 0x7fee0c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee0b7fe640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee0c08e1b0 tx=0x7fee04010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0401a030 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee04003990 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee04003d80 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee0c1f5c00 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.118+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee0c0b9500 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.119+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee0c0d2fd0 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.119+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fee04005d10 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.120+0000 7fee037fe640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 0x7fedec06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.120+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fee0408b050 con 0x7fee0c1599e0 2024-03-18T15:01:02.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.120+0000 7fee0affd640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 0x7fedec06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.120+0000 7fee0affd640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 0x7fedec06e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedfc034000 tx=0x7fedfc009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.124+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fee0c0d2fd0 con 0x7fee0c1599e0 2024-03-18T15:01:02.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.295+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee0c068710 con 0x7fedec06bc00 2024-03-18T15:01:02.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.301+0000 7fee037fe640 1 -- 172.21.15.152:0/3829025067 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251835 (secure 0 0 0) 0x7fedfc030040 con 0x7fedec06bc00 2024-03-18T15:01:02.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:02.305 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:02.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 msgr2=0x7fedec06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 0x7fedec06e0c0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fedfc034000 tx=0x7fedfc009030 comp rx=0 tx=0).stop 2024-03-18T15:01:02.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 msgr2=0x7fee0c0cd6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fee0c08e1b0 tx=0x7fee04010590 comp rx=0 tx=0).stop 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 shutdown_connections 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fee0c1599e0 0x7fee0c0cd6a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fedec06bc00 0x7fedec06e0c0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fee0c159560 0x7fee0c0cd160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 --2- 172.21.15.152:0/3829025067 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fedf8003a50 0x7fee0c0b8980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 >> 172.21.15.152:0/3829025067 conn(0x7fee0c0d4070 msgr2=0x7fee0c15ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 shutdown_connections 2024-03-18T15:01:02.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.304+0000 7fee11620640 1 -- 172.21.15.152:0/3829025067 wait complete. 2024-03-18T15:01:02.315 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":29,"stamp":"2024-03-18T15:01:01.807116+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223312,"kb_used_data":2952,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751408,"statfs":{"total":773094113280,"available":772865441792,"internally_reserved":0,"allocated":3022848,"data_stored":1809972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":776,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"11.206943"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620901+0000","last_change":"2024-03-18T15:00:49.602559+0000","last_active":"2024-03-18T15:00:50.620901+0000","last_peered":"2024-03-18T15:00:50.620901+0000","last_clean":"2024-03-18T15:00:50.620901+0000","last_became_active":"2024-03-18T15:00:49.602244+0000","last_became_peered":"2024-03-18T15:00:49.602244+0000","last_unstale":"2024-03-18T15:00:50.620901+0000","last_undegraded":"2024-03-18T15:00:50.620901+0000","last_fullsized":"2024-03-18T15:00:50.620901+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621209+0000","last_change":"2024-03-18T15:00:49.605702+0000","last_active":"2024-03-18T15:00:50.621209+0000","last_peered":"2024-03-18T15:00:50.621209+0000","last_clean":"2024-03-18T15:00:50.621209+0000","last_became_active":"2024-03-18T15:00:49.605453+0000","last_became_peered":"2024-03-18T15:00:49.605453+0000","last_unstale":"2024-03-18T15:00:50.621209+0000","last_undegraded":"2024-03-18T15:00:50.621209+0000","last_fullsized":"2024-03-18T15:00:50.621209+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620369+0000","last_change":"2024-03-18T15:00:49.603216+0000","last_active":"2024-03-18T15:00:50.620369+0000","last_peered":"2024-03-18T15:00:50.620369+0000","last_clean":"2024-03-18T15:00:50.620369+0000","last_became_active":"2024-03-18T15:00:49.602932+0000","last_became_peered":"2024-03-18T15:00:49.602932+0000","last_unstale":"2024-03-18T15:00:50.620369+0000","last_undegraded":"2024-03-18T15:00:50.620369+0000","last_fullsized":"2024-03-18T15:00:50.620369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:55:06.190837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604634+0000","last_change":"2024-03-18T15:00:49.611858+0000","last_active":"2024-03-18T15:00:50.604634+0000","last_peered":"2024-03-18T15:00:50.604634+0000","last_clean":"2024-03-18T15:00:50.604634+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.604634+0000","last_undegraded":"2024-03-18T15:00:50.604634+0000","last_fullsized":"2024-03-18T15:00:50.604634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620537+0000","last_change":"2024-03-18T15:00:49.608648+0000","last_active":"2024-03-18T15:00:50.620537+0000","last_peered":"2024-03-18T15:00:50.620537+0000","last_clean":"2024-03-18T15:00:50.620537+0000","last_became_active":"2024-03-18T15:00:49.608303+0000","last_became_peered":"2024-03-18T15:00:49.608303+0000","last_unstale":"2024-03-18T15:00:50.620537+0000","last_undegraded":"2024-03-18T15:00:50.620537+0000","last_fullsized":"2024-03-18T15:00:50.620537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604133+0000","last_change":"2024-03-18T15:00:49.614407+0000","last_active":"2024-03-18T15:00:50.604133+0000","last_peered":"2024-03-18T15:00:50.604133+0000","last_clean":"2024-03-18T15:00:50.604133+0000","last_became_active":"2024-03-18T15:00:49.611346+0000","last_became_peered":"2024-03-18T15:00:49.611346+0000","last_unstale":"2024-03-18T15:00:50.604133+0000","last_undegraded":"2024-03-18T15:00:50.604133+0000","last_fullsized":"2024-03-18T15:00:50.604133+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620249+0000","last_change":"2024-03-18T15:00:49.604411+0000","last_active":"2024-03-18T15:00:50.620249+0000","last_peered":"2024-03-18T15:00:50.620249+0000","last_clean":"2024-03-18T15:00:50.620249+0000","last_became_active":"2024-03-18T15:00:49.604089+0000","last_became_peered":"2024-03-18T15:00:49.604089+0000","last_unstale":"2024-03-18T15:00:50.620249+0000","last_undegraded":"2024-03-18T15:00:50.620249+0000","last_fullsized":"2024-03-18T15:00:50.620249+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620056+0000","last_change":"2024-03-18T15:00:49.613900+0000","last_active":"2024-03-18T15:00:50.620056+0000","last_peered":"2024-03-18T15:00:50.620056+0000","last_clean":"2024-03-18T15:00:50.620056+0000","last_became_active":"2024-03-18T15:00:49.613586+0000","last_became_peered":"2024-03-18T15:00:49.613586+0000","last_unstale":"2024-03-18T15:00:50.620056+0000","last_undegraded":"2024-03-18T15:00:50.620056+0000","last_fullsized":"2024-03-18T15:00:50.620056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:40:56.707532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620908+0000","last_change":"2024-03-18T15:00:49.613965+0000","last_active":"2024-03-18T15:00:50.620908+0000","last_peered":"2024-03-18T15:00:50.620908+0000","last_clean":"2024-03-18T15:00:50.620908+0000","last_became_active":"2024-03-18T15:00:49.613700+0000","last_became_peered":"2024-03-18T15:00:49.613700+0000","last_unstale":"2024-03-18T15:00:50.620908+0000","last_undegraded":"2024-03-18T15:00:50.620908+0000","last_fullsized":"2024-03-18T15:00:50.620908+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620515+0000","last_change":"2024-03-18T15:00:49.614720+0000","last_active":"2024-03-18T15:00:50.620515+0000","last_peered":"2024-03-18T15:00:50.620515+0000","last_clean":"2024-03-18T15:00:50.620515+0000","last_became_active":"2024-03-18T15:00:49.614463+0000","last_became_peered":"2024-03-18T15:00:49.614463+0000","last_unstale":"2024-03-18T15:00:50.620515+0000","last_undegraded":"2024-03-18T15:00:50.620515+0000","last_fullsized":"2024-03-18T15:00:50.620515+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:36:52.555465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620200+0000","last_change":"2024-03-18T15:00:49.614041+0000","last_active":"2024-03-18T15:00:50.620200+0000","last_peered":"2024-03-18T15:00:50.620200+0000","last_clean":"2024-03-18T15:00:50.620200+0000","last_became_active":"2024-03-18T15:00:49.613783+0000","last_became_peered":"2024-03-18T15:00:49.613783+0000","last_unstale":"2024-03-18T15:00:50.620200+0000","last_undegraded":"2024-03-18T15:00:50.620200+0000","last_fullsized":"2024-03-18T15:00:50.620200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603266+0000","last_change":"2024-03-18T15:00:49.607570+0000","last_active":"2024-03-18T15:00:50.603266+0000","last_peered":"2024-03-18T15:00:50.603266+0000","last_clean":"2024-03-18T15:00:50.603266+0000","last_became_active":"2024-03-18T15:00:49.607246+0000","last_became_peered":"2024-03-18T15:00:49.607246+0000","last_unstale":"2024-03-18T15:00:50.603266+0000","last_undegraded":"2024-03-18T15:00:50.603266+0000","last_fullsized":"2024-03-18T15:00:50.603266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:23.089072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621212+0000","last_change":"2024-03-18T15:00:49.610356+0000","last_active":"2024-03-18T15:00:50.621212+0000","last_peered":"2024-03-18T15:00:50.621212+0000","last_clean":"2024-03-18T15:00:50.621212+0000","last_became_active":"2024-03-18T15:00:49.610060+0000","last_became_peered":"2024-03-18T15:00:49.610060+0000","last_unstale":"2024-03-18T15:00:50.621212+0000","last_undegraded":"2024-03-18T15:00:50.621212+0000","last_fullsized":"2024-03-18T15:00:50.621212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620271+0000","last_change":"2024-03-18T15:00:49.604557+0000","last_active":"2024-03-18T15:00:50.620271+0000","last_peered":"2024-03-18T15:00:50.620271+0000","last_clean":"2024-03-18T15:00:50.620271+0000","last_became_active":"2024-03-18T15:00:49.604266+0000","last_became_peered":"2024-03-18T15:00:49.604266+0000","last_unstale":"2024-03-18T15:00:50.620271+0000","last_undegraded":"2024-03-18T15:00:50.620271+0000","last_fullsized":"2024-03-18T15:00:50.620271+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:13:06.475632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621602+0000","last_change":"2024-03-18T15:00:49.604198+0000","last_active":"2024-03-18T15:00:50.621602+0000","last_peered":"2024-03-18T15:00:50.621602+0000","last_clean":"2024-03-18T15:00:50.621602+0000","last_became_active":"2024-03-18T15:00:49.603907+0000","last_became_peered":"2024-03-18T15:00:49.603907+0000","last_unstale":"2024-03-18T15:00:50.621602+0000","last_undegraded":"2024-03-18T15:00:50.621602+0000","last_fullsized":"2024-03-18T15:00:50.621602+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603310+0000","last_change":"2024-03-18T15:00:49.606308+0000","last_active":"2024-03-18T15:00:50.603310+0000","last_peered":"2024-03-18T15:00:50.603310+0000","last_clean":"2024-03-18T15:00:50.603310+0000","last_became_active":"2024-03-18T15:00:49.606061+0000","last_became_peered":"2024-03-18T15:00:49.606061+0000","last_unstale":"2024-03-18T15:00:50.603310+0000","last_undegraded":"2024-03-18T15:00:50.603310+0000","last_fullsized":"2024-03-18T15:00:50.603310+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604025+0000","last_change":"2024-03-18T15:00:49.600746+0000","last_active":"2024-03-18T15:00:50.604025+0000","last_peered":"2024-03-18T15:00:50.604025+0000","last_clean":"2024-03-18T15:00:50.604025+0000","last_became_active":"2024-03-18T15:00:49.597407+0000","last_became_peered":"2024-03-18T15:00:49.597407+0000","last_unstale":"2024-03-18T15:00:50.604025+0000","last_undegraded":"2024-03-18T15:00:50.604025+0000","last_fullsized":"2024-03-18T15:00:50.604025+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:22:11.515856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601746+0000","last_change":"2024-03-18T15:00:49.602236+0000","last_active":"2024-03-18T15:00:50.601746+0000","last_peered":"2024-03-18T15:00:50.601746+0000","last_clean":"2024-03-18T15:00:50.601746+0000","last_became_active":"2024-03-18T15:00:49.601953+0000","last_became_peered":"2024-03-18T15:00:49.601953+0000","last_unstale":"2024-03-18T15:00:50.601746+0000","last_undegraded":"2024-03-18T15:00:50.601746+0000","last_fullsized":"2024-03-18T15:00:50.601746+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:38.591126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621040+0000","last_change":"2024-03-18T15:00:49.599794+0000","last_active":"2024-03-18T15:00:50.621040+0000","last_peered":"2024-03-18T15:00:50.621040+0000","last_clean":"2024-03-18T15:00:50.621040+0000","last_became_active":"2024-03-18T15:00:49.599498+0000","last_became_peered":"2024-03-18T15:00:49.599498+0000","last_unstale":"2024-03-18T15:00:50.621040+0000","last_undegraded":"2024-03-18T15:00:50.621040+0000","last_fullsized":"2024-03-18T15:00:50.621040+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:26:34.226203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620412+0000","last_change":"2024-03-18T15:00:49.611463+0000","last_active":"2024-03-18T15:00:50.620412+0000","last_peered":"2024-03-18T15:00:50.620412+0000","last_clean":"2024-03-18T15:00:50.620412+0000","last_became_active":"2024-03-18T15:00:49.611176+0000","last_became_peered":"2024-03-18T15:00:49.611176+0000","last_unstale":"2024-03-18T15:00:50.620412+0000","last_undegraded":"2024-03-18T15:00:50.620412+0000","last_fullsized":"2024-03-18T15:00:50.620412+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620636+0000","last_change":"2024-03-18T15:00:49.607455+0000","last_active":"2024-03-18T15:00:50.620636+0000","last_peered":"2024-03-18T15:00:50.620636+0000","last_clean":"2024-03-18T15:00:50.620636+0000","last_became_active":"2024-03-18T15:00:49.607104+0000","last_became_peered":"2024-03-18T15:00:49.607104+0000","last_unstale":"2024-03-18T15:00:50.620636+0000","last_undegraded":"2024-03-18T15:00:50.620636+0000","last_fullsized":"2024-03-18T15:00:50.620636+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604248+0000","last_change":"2024-03-18T15:00:49.605017+0000","last_active":"2024-03-18T15:00:50.604248+0000","last_peered":"2024-03-18T15:00:50.604248+0000","last_clean":"2024-03-18T15:00:50.604248+0000","last_became_active":"2024-03-18T15:00:49.604744+0000","last_became_peered":"2024-03-18T15:00:49.604744+0000","last_unstale":"2024-03-18T15:00:50.604248+0000","last_undegraded":"2024-03-18T15:00:50.604248+0000","last_fullsized":"2024-03-18T15:00:50.604248+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620336+0000","last_change":"2024-03-18T15:00:49.610406+0000","last_active":"2024-03-18T15:00:50.620336+0000","last_peered":"2024-03-18T15:00:50.620336+0000","last_clean":"2024-03-18T15:00:50.620336+0000","last_became_active":"2024-03-18T15:00:49.610179+0000","last_became_peered":"2024-03-18T15:00:49.610179+0000","last_unstale":"2024-03-18T15:00:50.620336+0000","last_undegraded":"2024-03-18T15:00:50.620336+0000","last_fullsized":"2024-03-18T15:00:50.620336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603478+0000","last_change":"2024-03-18T15:00:49.605768+0000","last_active":"2024-03-18T15:00:50.603478+0000","last_peered":"2024-03-18T15:00:50.603478+0000","last_clean":"2024-03-18T15:00:50.603478+0000","last_became_active":"2024-03-18T15:00:49.605490+0000","last_became_peered":"2024-03-18T15:00:49.605490+0000","last_unstale":"2024-03-18T15:00:50.603478+0000","last_undegraded":"2024-03-18T15:00:50.603478+0000","last_fullsized":"2024-03-18T15:00:50.603478+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621017+0000","last_change":"2024-03-18T15:00:49.609664+0000","last_active":"2024-03-18T15:00:50.621017+0000","last_peered":"2024-03-18T15:00:50.621017+0000","last_clean":"2024-03-18T15:00:50.621017+0000","last_became_active":"2024-03-18T15:00:49.609392+0000","last_became_peered":"2024-03-18T15:00:49.609392+0000","last_unstale":"2024-03-18T15:00:50.621017+0000","last_undegraded":"2024-03-18T15:00:50.621017+0000","last_fullsized":"2024-03-18T15:00:50.621017+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620664+0000","last_change":"2024-03-18T15:00:49.606156+0000","last_active":"2024-03-18T15:00:50.620664+0000","last_peered":"2024-03-18T15:00:50.620664+0000","last_clean":"2024-03-18T15:00:50.620664+0000","last_became_active":"2024-03-18T15:00:49.605828+0000","last_became_peered":"2024-03-18T15:00:49.605828+0000","last_unstale":"2024-03-18T15:00:50.620664+0000","last_undegraded":"2024-03-18T15:00:50.620664+0000","last_fullsized":"2024-03-18T15:00:50.620664+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:49:37.471400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621122+0000","last_change":"2024-03-18T15:00:49.614663+0000","last_active":"2024-03-18T15:00:50.621122+0000","last_peered":"2024-03-18T15:00:50.621122+0000","last_clean":"2024-03-18T15:00:50.621122+0000","last_became_active":"2024-03-18T15:00:49.614339+0000","last_became_peered":"2024-03-18T15:00:49.614339+0000","last_unstale":"2024-03-18T15:00:50.621122+0000","last_undegraded":"2024-03-18T15:00:50.621122+0000","last_fullsized":"2024-03-18T15:00:50.621122+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:22:08.260516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621500+0000","last_change":"2024-03-18T15:00:49.610521+0000","last_active":"2024-03-18T15:00:50.621500+0000","last_peered":"2024-03-18T15:00:50.621500+0000","last_clean":"2024-03-18T15:00:50.621500+0000","last_became_active":"2024-03-18T15:00:49.610259+0000","last_became_peered":"2024-03-18T15:00:49.610259+0000","last_unstale":"2024-03-18T15:00:50.621500+0000","last_undegraded":"2024-03-18T15:00:50.621500+0000","last_fullsized":"2024-03-18T15:00:50.621500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620766+0000","last_change":"2024-03-18T15:00:49.612185+0000","last_active":"2024-03-18T15:00:50.620766+0000","last_peered":"2024-03-18T15:00:50.620766+0000","last_clean":"2024-03-18T15:00:50.620766+0000","last_became_active":"2024-03-18T15:00:49.611939+0000","last_became_peered":"2024-03-18T15:00:49.611939+0000","last_unstale":"2024-03-18T15:00:50.620766+0000","last_undegraded":"2024-03-18T15:00:50.620766+0000","last_fullsized":"2024-03-18T15:00:50.620766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604331+0000","last_change":"2024-03-18T15:00:49.615152+0000","last_active":"2024-03-18T15:00:50.604331+0000","last_peered":"2024-03-18T15:00:50.604331+0000","last_clean":"2024-03-18T15:00:50.604331+0000","last_became_active":"2024-03-18T15:00:49.614842+0000","last_became_peered":"2024-03-18T15:00:49.614842+0000","last_unstale":"2024-03-18T15:00:50.604331+0000","last_undegraded":"2024-03-18T15:00:50.604331+0000","last_fullsized":"2024-03-18T15:00:50.604331+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601792+0000","last_change":"2024-03-18T15:00:49.605849+0000","last_active":"2024-03-18T15:00:50.601792+0000","last_peered":"2024-03-18T15:00:50.601792+0000","last_clean":"2024-03-18T15:00:50.601792+0000","last_became_active":"2024-03-18T15:00:49.605591+0000","last_became_peered":"2024-03-18T15:00:49.605591+0000","last_unstale":"2024-03-18T15:00:50.601792+0000","last_undegraded":"2024-03-18T15:00:50.601792+0000","last_fullsized":"2024-03-18T15:00:50.601792+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:05.445647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620097+0000","last_change":"2024-03-18T15:00:49.603484+0000","last_active":"2024-03-18T15:00:50.620097+0000","last_peered":"2024-03-18T15:00:50.620097+0000","last_clean":"2024-03-18T15:00:50.620097+0000","last_became_active":"2024-03-18T15:00:49.603167+0000","last_became_peered":"2024-03-18T15:00:49.603167+0000","last_unstale":"2024-03-18T15:00:50.620097+0000","last_undegraded":"2024-03-18T15:00:50.620097+0000","last_fullsized":"2024-03-18T15:00:50.620097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:09:00.440783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604324+0000","last_change":"2024-03-18T15:00:49.603998+0000","last_active":"2024-03-18T15:00:50.604324+0000","last_peered":"2024-03-18T15:00:50.604324+0000","last_clean":"2024-03-18T15:00:50.604324+0000","last_became_active":"2024-03-18T15:00:49.603714+0000","last_became_peered":"2024-03-18T15:00:49.603714+0000","last_unstale":"2024-03-18T15:00:50.604324+0000","last_undegraded":"2024-03-18T15:00:50.604324+0000","last_fullsized":"2024-03-18T15:00:50.604324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.960921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621433+0000","last_change":"2024-03-18T15:00:48.607304+0000","last_active":"2024-03-18T15:00:50.621433+0000","last_peered":"2024-03-18T15:00:50.621433+0000","last_clean":"2024-03-18T15:00:50.621433+0000","last_became_active":"2024-03-18T15:00:48.607020+0000","last_became_peered":"2024-03-18T15:00:48.607020+0000","last_unstale":"2024-03-18T15:00:50.621433+0000","last_undegraded":"2024-03-18T15:00:50.621433+0000","last_fullsized":"2024-03-18T15:00:50.621433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:01:33.662969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620882+0000","last_change":"2024-03-18T15:00:49.608853+0000","last_active":"2024-03-18T15:00:50.620882+0000","last_peered":"2024-03-18T15:00:50.620882+0000","last_clean":"2024-03-18T15:00:50.620882+0000","last_became_active":"2024-03-18T15:00:49.608585+0000","last_became_peered":"2024-03-18T15:00:49.608585+0000","last_unstale":"2024-03-18T15:00:50.620882+0000","last_undegraded":"2024-03-18T15:00:50.620882+0000","last_fullsized":"2024-03-18T15:00:50.620882+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:15:27.931676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620169+0000","last_change":"2024-03-18T15:00:48.600397+0000","last_active":"2024-03-18T15:00:50.620169+0000","last_peered":"2024-03-18T15:00:50.620169+0000","last_clean":"2024-03-18T15:00:50.620169+0000","last_became_active":"2024-03-18T15:00:48.600099+0000","last_became_peered":"2024-03-18T15:00:48.600099+0000","last_unstale":"2024-03-18T15:00:50.620169+0000","last_undegraded":"2024-03-18T15:00:50.620169+0000","last_fullsized":"2024-03-18T15:00:50.620169+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:37:29.719511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620480+0000","last_change":"2024-03-18T15:00:48.611187+0000","last_active":"2024-03-18T15:00:50.620480+0000","last_peered":"2024-03-18T15:00:50.620480+0000","last_clean":"2024-03-18T15:00:50.620480+0000","last_became_active":"2024-03-18T15:00:48.610913+0000","last_became_peered":"2024-03-18T15:00:48.610913+0000","last_unstale":"2024-03-18T15:00:50.620480+0000","last_undegraded":"2024-03-18T15:00:50.620480+0000","last_fullsized":"2024-03-18T15:00:50.620480+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620061+0000","last_change":"2024-03-18T15:00:49.606896+0000","last_active":"2024-03-18T15:00:50.620061+0000","last_peered":"2024-03-18T15:00:50.620061+0000","last_clean":"2024-03-18T15:00:50.620061+0000","last_became_active":"2024-03-18T15:00:49.606558+0000","last_became_peered":"2024-03-18T15:00:49.606558+0000","last_unstale":"2024-03-18T15:00:50.620061+0000","last_undegraded":"2024-03-18T15:00:50.620061+0000","last_fullsized":"2024-03-18T15:00:50.620061+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:00:08.998111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603605+0000","last_change":"2024-03-18T15:00:48.598028+0000","last_active":"2024-03-18T15:00:50.603605+0000","last_peered":"2024-03-18T15:00:50.603605+0000","last_clean":"2024-03-18T15:00:50.603605+0000","last_became_active":"2024-03-18T15:00:48.597744+0000","last_became_peered":"2024-03-18T15:00:48.597744+0000","last_unstale":"2024-03-18T15:00:50.603605+0000","last_undegraded":"2024-03-18T15:00:50.603605+0000","last_fullsized":"2024-03-18T15:00:50.603605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621475+0000","last_change":"2024-03-18T15:00:49.611972+0000","last_active":"2024-03-18T15:00:50.621475+0000","last_peered":"2024-03-18T15:00:50.621475+0000","last_clean":"2024-03-18T15:00:50.621475+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.621475+0000","last_undegraded":"2024-03-18T15:00:50.621475+0000","last_fullsized":"2024-03-18T15:00:50.621475+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:21:26.431462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620256+0000","last_change":"2024-03-18T15:00:48.606090+0000","last_active":"2024-03-18T15:00:50.620256+0000","last_peered":"2024-03-18T15:00:50.620256+0000","last_clean":"2024-03-18T15:00:50.620256+0000","last_became_active":"2024-03-18T15:00:48.605750+0000","last_became_peered":"2024-03-18T15:00:48.605750+0000","last_unstale":"2024-03-18T15:00:50.620256+0000","last_undegraded":"2024-03-18T15:00:50.620256+0000","last_fullsized":"2024-03-18T15:00:50.620256+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:14:22.078859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603929+0000","last_change":"2024-03-18T15:00:49.604336+0000","last_active":"2024-03-18T15:00:50.603929+0000","last_peered":"2024-03-18T15:00:50.603929+0000","last_clean":"2024-03-18T15:00:50.603929+0000","last_became_active":"2024-03-18T15:00:49.604025+0000","last_became_peered":"2024-03-18T15:00:49.604025+0000","last_unstale":"2024-03-18T15:00:50.603929+0000","last_undegraded":"2024-03-18T15:00:50.603929+0000","last_fullsized":"2024-03-18T15:00:50.603929+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604039+0000","last_change":"2024-03-18T15:00:48.600881+0000","last_active":"2024-03-18T15:00:50.604039+0000","last_peered":"2024-03-18T15:00:50.604039+0000","last_clean":"2024-03-18T15:00:50.604039+0000","last_became_active":"2024-03-18T15:00:48.600614+0000","last_became_peered":"2024-03-18T15:00:48.600614+0000","last_unstale":"2024-03-18T15:00:50.604039+0000","last_undegraded":"2024-03-18T15:00:50.604039+0000","last_fullsized":"2024-03-18T15:00:50.604039+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621239+0000","last_change":"2024-03-18T15:00:49.616126+0000","last_active":"2024-03-18T15:00:50.621239+0000","last_peered":"2024-03-18T15:00:50.621239+0000","last_clean":"2024-03-18T15:00:50.621239+0000","last_became_active":"2024-03-18T15:00:49.615785+0000","last_became_peered":"2024-03-18T15:00:49.615785+0000","last_unstale":"2024-03-18T15:00:50.621239+0000","last_undegraded":"2024-03-18T15:00:50.621239+0000","last_fullsized":"2024-03-18T15:00:50.621239+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:45:00.662513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"21'3","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621210+0000","last_change":"2024-03-18T15:00:48.603580+0000","last_active":"2024-03-18T15:00:50.621210+0000","last_peered":"2024-03-18T15:00:50.621210+0000","last_clean":"2024-03-18T15:00:50.621210+0000","last_became_active":"2024-03-18T15:00:48.603304+0000","last_became_peered":"2024-03-18T15:00:48.603304+0000","last_unstale":"2024-03-18T15:00:50.621210+0000","last_undegraded":"2024-03-18T15:00:50.621210+0000","last_fullsized":"2024-03-18T15:00:50.621210+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603418+0000","last_change":"2024-03-18T15:00:49.602637+0000","last_active":"2024-03-18T15:00:50.603418+0000","last_peered":"2024-03-18T15:00:50.603418+0000","last_clean":"2024-03-18T15:00:50.603418+0000","last_became_active":"2024-03-18T15:00:49.602367+0000","last_became_peered":"2024-03-18T15:00:49.602367+0000","last_unstale":"2024-03-18T15:00:50.603418+0000","last_undegraded":"2024-03-18T15:00:50.603418+0000","last_fullsized":"2024-03-18T15:00:50.603418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:08.152207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"21'6","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620519+0000","last_change":"2024-03-18T15:00:48.609941+0000","last_active":"2024-03-18T15:00:50.620519+0000","last_peered":"2024-03-18T15:00:50.620519+0000","last_clean":"2024-03-18T15:00:50.620519+0000","last_became_active":"2024-03-18T15:00:48.609606+0000","last_became_peered":"2024-03-18T15:00:48.609606+0000","last_unstale":"2024-03-18T15:00:50.620519+0000","last_undegraded":"2024-03-18T15:00:50.620519+0000","last_fullsized":"2024-03-18T15:00:50.620519+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:37:52.423825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620754+0000","last_change":"2024-03-18T15:00:49.611831+0000","last_active":"2024-03-18T15:00:50.620754+0000","last_peered":"2024-03-18T15:00:50.620754+0000","last_clean":"2024-03-18T15:00:50.620754+0000","last_became_active":"2024-03-18T15:00:49.611588+0000","last_became_peered":"2024-03-18T15:00:49.611588+0000","last_unstale":"2024-03-18T15:00:50.620754+0000","last_undegraded":"2024-03-18T15:00:50.620754+0000","last_fullsized":"2024-03-18T15:00:50.620754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:32:45.755793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620957+0000","last_change":"2024-03-18T15:00:48.598176+0000","last_active":"2024-03-18T15:00:50.620957+0000","last_peered":"2024-03-18T15:00:50.620957+0000","last_clean":"2024-03-18T15:00:50.620957+0000","last_became_active":"2024-03-18T15:00:48.597860+0000","last_became_peered":"2024-03-18T15:00:48.597860+0000","last_unstale":"2024-03-18T15:00:50.620957+0000","last_undegraded":"2024-03-18T15:00:50.620957+0000","last_fullsized":"2024-03-18T15:00:50.620957+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:37:49.079685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620377+0000","last_change":"2024-03-18T15:00:49.607347+0000","last_active":"2024-03-18T15:00:50.620377+0000","last_peered":"2024-03-18T15:00:50.620377+0000","last_clean":"2024-03-18T15:00:50.620377+0000","last_became_active":"2024-03-18T15:00:49.607022+0000","last_became_peered":"2024-03-18T15:00:49.607022+0000","last_unstale":"2024-03-18T15:00:50.620377+0000","last_undegraded":"2024-03-18T15:00:50.620377+0000","last_fullsized":"2024-03-18T15:00:50.620377+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:29:23.477545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604347+0000","last_change":"2024-03-18T15:00:48.609691+0000","last_active":"2024-03-18T15:00:50.604347+0000","last_peered":"2024-03-18T15:00:50.604347+0000","last_clean":"2024-03-18T15:00:50.604347+0000","last_became_active":"2024-03-18T15:00:48.609405+0000","last_became_peered":"2024-03-18T15:00:48.609405+0000","last_unstale":"2024-03-18T15:00:50.604347+0000","last_undegraded":"2024-03-18T15:00:50.604347+0000","last_fullsized":"2024-03-18T15:00:50.604347+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620710+0000","last_change":"2024-03-18T15:00:49.611042+0000","last_active":"2024-03-18T15:00:50.620710+0000","last_peered":"2024-03-18T15:00:50.620710+0000","last_clean":"2024-03-18T15:00:50.620710+0000","last_became_active":"2024-03-18T15:00:49.610772+0000","last_became_peered":"2024-03-18T15:00:49.610772+0000","last_unstale":"2024-03-18T15:00:50.620710+0000","last_undegraded":"2024-03-18T15:00:50.620710+0000","last_fullsized":"2024-03-18T15:00:50.620710+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:11.531512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620037+0000","last_change":"2024-03-18T15:00:48.600811+0000","last_active":"2024-03-18T15:00:50.620037+0000","last_peered":"2024-03-18T15:00:50.620037+0000","last_clean":"2024-03-18T15:00:50.620037+0000","last_became_active":"2024-03-18T15:00:48.600157+0000","last_became_peered":"2024-03-18T15:00:48.600157+0000","last_unstale":"2024-03-18T15:00:50.620037+0000","last_undegraded":"2024-03-18T15:00:50.620037+0000","last_fullsized":"2024-03-18T15:00:50.620037+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:18.747487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620388+0000","last_change":"2024-03-18T15:00:49.602600+0000","last_active":"2024-03-18T15:00:50.620388+0000","last_peered":"2024-03-18T15:00:50.620388+0000","last_clean":"2024-03-18T15:00:50.620388+0000","last_became_active":"2024-03-18T15:00:49.602326+0000","last_became_peered":"2024-03-18T15:00:49.602326+0000","last_unstale":"2024-03-18T15:00:50.620388+0000","last_undegraded":"2024-03-18T15:00:50.620388+0000","last_fullsized":"2024-03-18T15:00:50.620388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"21'8","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601757+0000","last_change":"2024-03-18T15:00:48.601593+0000","last_active":"2024-03-18T15:00:50.601757+0000","last_peered":"2024-03-18T15:00:50.601757+0000","last_clean":"2024-03-18T15:00:50.601757+0000","last_became_active":"2024-03-18T15:00:48.601284+0000","last_became_peered":"2024-03-18T15:00:48.601284+0000","last_unstale":"2024-03-18T15:00:50.601757+0000","last_undegraded":"2024-03-18T15:00:50.601757+0000","last_fullsized":"2024-03-18T15:00:50.601757+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620495+0000","last_change":"2024-03-18T15:00:49.608730+0000","last_active":"2024-03-18T15:00:50.620495+0000","last_peered":"2024-03-18T15:00:50.620495+0000","last_clean":"2024-03-18T15:00:50.620495+0000","last_became_active":"2024-03-18T15:00:49.607149+0000","last_became_peered":"2024-03-18T15:00:49.607149+0000","last_unstale":"2024-03-18T15:00:50.620495+0000","last_undegraded":"2024-03-18T15:00:50.620495+0000","last_fullsized":"2024-03-18T15:00:50.620495+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:28:12.700312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603700+0000","last_change":"2024-03-18T15:00:48.602231+0000","last_active":"2024-03-18T15:00:50.603700+0000","last_peered":"2024-03-18T15:00:50.603700+0000","last_clean":"2024-03-18T15:00:50.603700+0000","last_became_active":"2024-03-18T15:00:48.601914+0000","last_became_peered":"2024-03-18T15:00:48.601914+0000","last_unstale":"2024-03-18T15:00:50.603700+0000","last_undegraded":"2024-03-18T15:00:50.603700+0000","last_fullsized":"2024-03-18T15:00:50.603700+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:39:18.113525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620614+0000","last_change":"2024-03-18T15:00:49.610469+0000","last_active":"2024-03-18T15:00:50.620614+0000","last_peered":"2024-03-18T15:00:50.620614+0000","last_clean":"2024-03-18T15:00:50.620614+0000","last_became_active":"2024-03-18T15:00:49.607012+0000","last_became_peered":"2024-03-18T15:00:49.607012+0000","last_unstale":"2024-03-18T15:00:50.620614+0000","last_undegraded":"2024-03-18T15:00:50.620614+0000","last_fullsized":"2024-03-18T15:00:50.620614+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:12:58.631634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601882+0000","last_change":"2024-03-18T15:00:48.604915+0000","last_active":"2024-03-18T15:00:50.601882+0000","last_peered":"2024-03-18T15:00:50.601882+0000","last_clean":"2024-03-18T15:00:50.601882+0000","last_became_active":"2024-03-18T15:00:48.604626+0000","last_became_peered":"2024-03-18T15:00:48.604626+0000","last_unstale":"2024-03-18T15:00:50.601882+0000","last_undegraded":"2024-03-18T15:00:50.601882+0000","last_fullsized":"2024-03-18T15:00:50.601882+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621073+0000","last_change":"2024-03-18T15:00:49.610331+0000","last_active":"2024-03-18T15:00:50.621073+0000","last_peered":"2024-03-18T15:00:50.621073+0000","last_clean":"2024-03-18T15:00:50.621073+0000","last_became_active":"2024-03-18T15:00:49.610078+0000","last_became_peered":"2024-03-18T15:00:49.610078+0000","last_unstale":"2024-03-18T15:00:50.621073+0000","last_undegraded":"2024-03-18T15:00:50.621073+0000","last_fullsized":"2024-03-18T15:00:50.621073+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:02.601372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621332+0000","last_change":"2024-03-18T15:00:48.598309+0000","last_active":"2024-03-18T15:00:50.621332+0000","last_peered":"2024-03-18T15:00:50.621332+0000","last_clean":"2024-03-18T15:00:50.621332+0000","last_became_active":"2024-03-18T15:00:48.598035+0000","last_became_peered":"2024-03-18T15:00:48.598035+0000","last_unstale":"2024-03-18T15:00:50.621332+0000","last_undegraded":"2024-03-18T15:00:50.621332+0000","last_fullsized":"2024-03-18T15:00:50.621332+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604738+0000","last_change":"2024-03-18T15:00:49.612324+0000","last_active":"2024-03-18T15:00:50.604738+0000","last_peered":"2024-03-18T15:00:50.604738+0000","last_clean":"2024-03-18T15:00:50.604738+0000","last_became_active":"2024-03-18T15:00:49.611516+0000","last_became_peered":"2024-03-18T15:00:49.611516+0000","last_unstale":"2024-03-18T15:00:50.604738+0000","last_undegraded":"2024-03-18T15:00:50.604738+0000","last_fullsized":"2024-03-18T15:00:50.604738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:02.253877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601689+0000","last_change":"2024-03-18T15:00:48.604054+0000","last_active":"2024-03-18T15:00:50.601689+0000","last_peered":"2024-03-18T15:00:50.601689+0000","last_clean":"2024-03-18T15:00:50.601689+0000","last_became_active":"2024-03-18T15:00:48.603764+0000","last_became_peered":"2024-03-18T15:00:48.603764+0000","last_unstale":"2024-03-18T15:00:50.601689+0000","last_undegraded":"2024-03-18T15:00:50.601689+0000","last_fullsized":"2024-03-18T15:00:50.601689+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620895+0000","last_change":"2024-03-18T15:00:49.611293+0000","last_active":"2024-03-18T15:00:50.620895+0000","last_peered":"2024-03-18T15:00:50.620895+0000","last_clean":"2024-03-18T15:00:50.620895+0000","last_became_active":"2024-03-18T15:00:49.607114+0000","last_became_peered":"2024-03-18T15:00:49.607114+0000","last_unstale":"2024-03-18T15:00:50.620895+0000","last_undegraded":"2024-03-18T15:00:50.620895+0000","last_fullsized":"2024-03-18T15:00:50.620895+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:53.349512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":170,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620601+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:00:50.620601+0000","last_peered":"2024-03-18T15:00:50.620601+0000","last_clean":"2024-03-18T15:00:50.620601+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:00:50.620601+0000","last_undegraded":"2024-03-18T15:00:50.620601+0000","last_fullsized":"2024-03-18T15:00:50.620601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603786+0000","last_change":"2024-03-18T15:00:48.601314+0000","last_active":"2024-03-18T15:00:50.603786+0000","last_peered":"2024-03-18T15:00:50.603786+0000","last_clean":"2024-03-18T15:00:50.603786+0000","last_became_active":"2024-03-18T15:00:48.601088+0000","last_became_peered":"2024-03-18T15:00:48.601088+0000","last_unstale":"2024-03-18T15:00:50.603786+0000","last_undegraded":"2024-03-18T15:00:50.603786+0000","last_fullsized":"2024-03-18T15:00:50.603786+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:52.540222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621611+0000","last_change":"2024-03-18T15:00:49.615549+0000","last_active":"2024-03-18T15:00:50.621611+0000","last_peered":"2024-03-18T15:00:50.621611+0000","last_clean":"2024-03-18T15:00:50.621611+0000","last_became_active":"2024-03-18T15:00:49.615256+0000","last_became_peered":"2024-03-18T15:00:49.615256+0000","last_unstale":"2024-03-18T15:00:50.621611+0000","last_undegraded":"2024-03-18T15:00:50.621611+0000","last_fullsized":"2024-03-18T15:00:50.621611+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619985+0000","last_change":"2024-03-18T15:00:48.607134+0000","last_active":"2024-03-18T15:00:50.619985+0000","last_peered":"2024-03-18T15:00:50.619985+0000","last_clean":"2024-03-18T15:00:50.619985+0000","last_became_active":"2024-03-18T15:00:48.606441+0000","last_became_peered":"2024-03-18T15:00:48.606441+0000","last_unstale":"2024-03-18T15:00:50.619985+0000","last_undegraded":"2024-03-18T15:00:50.619985+0000","last_fullsized":"2024-03-18T15:00:50.619985+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:11:04.435435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620140+0000","last_change":"2024-03-18T15:00:49.610465+0000","last_active":"2024-03-18T15:00:50.620140+0000","last_peered":"2024-03-18T15:00:50.620140+0000","last_clean":"2024-03-18T15:00:50.620140+0000","last_became_active":"2024-03-18T15:00:49.610044+0000","last_became_peered":"2024-03-18T15:00:49.610044+0000","last_unstale":"2024-03-18T15:00:50.620140+0000","last_undegraded":"2024-03-18T15:00:50.620140+0000","last_fullsized":"2024-03-18T15:00:50.620140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:03:21.039963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.601878+0000","last_change":"2024-03-18T15:00:48.606746+0000","last_active":"2024-03-18T15:00:50.601878+0000","last_peered":"2024-03-18T15:00:50.601878+0000","last_clean":"2024-03-18T15:00:50.601878+0000","last_became_active":"2024-03-18T15:00:48.606402+0000","last_became_peered":"2024-03-18T15:00:48.606402+0000","last_unstale":"2024-03-18T15:00:50.601878+0000","last_undegraded":"2024-03-18T15:00:50.601878+0000","last_fullsized":"2024-03-18T15:00:50.601878+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:40:04.064739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621808+0000","last_change":"2024-03-18T15:00:49.599116+0000","last_active":"2024-03-18T15:00:50.621808+0000","last_peered":"2024-03-18T15:00:50.621808+0000","last_clean":"2024-03-18T15:00:50.621808+0000","last_became_active":"2024-03-18T15:00:49.598788+0000","last_became_peered":"2024-03-18T15:00:49.598788+0000","last_unstale":"2024-03-18T15:00:50.621808+0000","last_undegraded":"2024-03-18T15:00:50.621808+0000","last_fullsized":"2024-03-18T15:00:50.621808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:06:39.193566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604433+0000","last_change":"2024-03-18T15:00:48.599094+0000","last_active":"2024-03-18T15:00:50.604433+0000","last_peered":"2024-03-18T15:00:50.604433+0000","last_clean":"2024-03-18T15:00:50.604433+0000","last_became_active":"2024-03-18T15:00:48.598740+0000","last_became_peered":"2024-03-18T15:00:48.598740+0000","last_unstale":"2024-03-18T15:00:50.604433+0000","last_undegraded":"2024-03-18T15:00:50.604433+0000","last_fullsized":"2024-03-18T15:00:50.604433+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604572+0000","last_change":"2024-03-18T15:00:49.604354+0000","last_active":"2024-03-18T15:00:50.604572+0000","last_peered":"2024-03-18T15:00:50.604572+0000","last_clean":"2024-03-18T15:00:50.604572+0000","last_became_active":"2024-03-18T15:00:49.604088+0000","last_became_peered":"2024-03-18T15:00:49.604088+0000","last_unstale":"2024-03-18T15:00:50.604572+0000","last_undegraded":"2024-03-18T15:00:50.604572+0000","last_fullsized":"2024-03-18T15:00:50.604572+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:10:23.158553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621065+0000","last_change":"2024-03-18T15:00:48.601947+0000","last_active":"2024-03-18T15:00:50.621065+0000","last_peered":"2024-03-18T15:00:50.621065+0000","last_clean":"2024-03-18T15:00:50.621065+0000","last_became_active":"2024-03-18T15:00:48.601640+0000","last_became_peered":"2024-03-18T15:00:48.601640+0000","last_unstale":"2024-03-18T15:00:50.621065+0000","last_undegraded":"2024-03-18T15:00:50.621065+0000","last_fullsized":"2024-03-18T15:00:50.621065+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603787+0000","last_change":"2024-03-18T15:00:49.612237+0000","last_active":"2024-03-18T15:00:50.603787+0000","last_peered":"2024-03-18T15:00:50.603787+0000","last_clean":"2024-03-18T15:00:50.603787+0000","last_became_active":"2024-03-18T15:00:49.611941+0000","last_became_peered":"2024-03-18T15:00:49.611941+0000","last_unstale":"2024-03-18T15:00:50.603787+0000","last_undegraded":"2024-03-18T15:00:50.603787+0000","last_fullsized":"2024-03-18T15:00:50.603787+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:58:39.859417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621006+0000","last_change":"2024-03-18T15:00:48.609704+0000","last_active":"2024-03-18T15:00:50.621006+0000","last_peered":"2024-03-18T15:00:50.621006+0000","last_clean":"2024-03-18T15:00:50.621006+0000","last_became_active":"2024-03-18T15:00:48.609396+0000","last_became_peered":"2024-03-18T15:00:48.609396+0000","last_unstale":"2024-03-18T15:00:50.621006+0000","last_undegraded":"2024-03-18T15:00:50.621006+0000","last_fullsized":"2024-03-18T15:00:50.621006+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:18:07.201067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620949+0000","last_change":"2024-03-18T15:00:49.599880+0000","last_active":"2024-03-18T15:00:50.620949+0000","last_peered":"2024-03-18T15:00:50.620949+0000","last_clean":"2024-03-18T15:00:50.620949+0000","last_became_active":"2024-03-18T15:00:49.599446+0000","last_became_peered":"2024-03-18T15:00:49.599446+0000","last_unstale":"2024-03-18T15:00:50.620949+0000","last_undegraded":"2024-03-18T15:00:50.620949+0000","last_fullsized":"2024-03-18T15:00:50.620949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.819937+0000","last_change":"2024-03-18T15:00:48.601110+0000","last_active":"2024-03-18T15:00:50.819937+0000","last_peered":"2024-03-18T15:00:50.819937+0000","last_clean":"2024-03-18T15:00:50.819937+0000","last_became_active":"2024-03-18T15:00:48.600829+0000","last_became_peered":"2024-03-18T15:00:48.600829+0000","last_unstale":"2024-03-18T15:00:50.819937+0000","last_undegraded":"2024-03-18T15:00:50.819937+0000","last_fullsized":"2024-03-18T15:00:50.819937+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:27:36.040306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621147+0000","last_change":"2024-03-18T15:00:49.609651+0000","last_active":"2024-03-18T15:00:50.621147+0000","last_peered":"2024-03-18T15:00:50.621147+0000","last_clean":"2024-03-18T15:00:50.621147+0000","last_became_active":"2024-03-18T15:00:49.609369+0000","last_became_peered":"2024-03-18T15:00:49.609369+0000","last_unstale":"2024-03-18T15:00:50.621147+0000","last_undegraded":"2024-03-18T15:00:50.621147+0000","last_fullsized":"2024-03-18T15:00:50.621147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:08:36.915710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620360+0000","last_change":"2024-03-18T15:00:48.603021+0000","last_active":"2024-03-18T15:00:50.620360+0000","last_peered":"2024-03-18T15:00:50.620360+0000","last_clean":"2024-03-18T15:00:50.620360+0000","last_became_active":"2024-03-18T15:00:48.602680+0000","last_became_peered":"2024-03-18T15:00:48.602680+0000","last_unstale":"2024-03-18T15:00:50.620360+0000","last_undegraded":"2024-03-18T15:00:50.620360+0000","last_fullsized":"2024-03-18T15:00:50.620360+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:14:07.141994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620538+0000","last_change":"2024-03-18T15:00:49.604968+0000","last_active":"2024-03-18T15:00:50.620538+0000","last_peered":"2024-03-18T15:00:50.620538+0000","last_clean":"2024-03-18T15:00:50.620538+0000","last_became_active":"2024-03-18T15:00:49.604691+0000","last_became_peered":"2024-03-18T15:00:49.604691+0000","last_unstale":"2024-03-18T15:00:50.620538+0000","last_undegraded":"2024-03-18T15:00:50.620538+0000","last_fullsized":"2024-03-18T15:00:50.620538+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:05.049398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.619995+0000","last_change":"2024-03-18T15:00:48.609674+0000","last_active":"2024-03-18T15:00:50.619995+0000","last_peered":"2024-03-18T15:00:50.619995+0000","last_clean":"2024-03-18T15:00:50.619995+0000","last_became_active":"2024-03-18T15:00:48.609393+0000","last_became_peered":"2024-03-18T15:00:48.609393+0000","last_unstale":"2024-03-18T15:00:50.619995+0000","last_undegraded":"2024-03-18T15:00:50.619995+0000","last_fullsized":"2024-03-18T15:00:50.619995+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:37.580914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603241+0000","last_change":"2024-03-18T15:00:49.603427+0000","last_active":"2024-03-18T15:00:50.603241+0000","last_peered":"2024-03-18T15:00:50.603241+0000","last_clean":"2024-03-18T15:00:50.603241+0000","last_became_active":"2024-03-18T15:00:49.603149+0000","last_became_peered":"2024-03-18T15:00:49.603149+0000","last_unstale":"2024-03-18T15:00:50.603241+0000","last_undegraded":"2024-03-18T15:00:50.603241+0000","last_fullsized":"2024-03-18T15:00:50.603241+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:55:19.757700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621683+0000","last_change":"2024-03-18T15:00:48.603472+0000","last_active":"2024-03-18T15:00:50.621683+0000","last_peered":"2024-03-18T15:00:50.621683+0000","last_clean":"2024-03-18T15:00:50.621683+0000","last_became_active":"2024-03-18T15:00:48.602920+0000","last_became_peered":"2024-03-18T15:00:48.602920+0000","last_unstale":"2024-03-18T15:00:50.621683+0000","last_undegraded":"2024-03-18T15:00:50.621683+0000","last_fullsized":"2024-03-18T15:00:50.621683+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:50:14.488056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620208+0000","last_change":"2024-03-18T15:00:49.606743+0000","last_active":"2024-03-18T15:00:50.620208+0000","last_peered":"2024-03-18T15:00:50.620208+0000","last_clean":"2024-03-18T15:00:50.620208+0000","last_became_active":"2024-03-18T15:00:49.606428+0000","last_became_peered":"2024-03-18T15:00:49.606428+0000","last_unstale":"2024-03-18T15:00:50.620208+0000","last_undegraded":"2024-03-18T15:00:50.620208+0000","last_fullsized":"2024-03-18T15:00:50.620208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:14:13.856189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":14,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620831+0000","last_change":"2024-03-18T15:00:48.606167+0000","last_active":"2024-03-18T15:00:50.620831+0000","last_peered":"2024-03-18T15:00:50.620831+0000","last_clean":"2024-03-18T15:00:50.620831+0000","last_became_active":"2024-03-18T15:00:48.605831+0000","last_became_peered":"2024-03-18T15:00:48.605831+0000","last_unstale":"2024-03-18T15:00:50.620831+0000","last_undegraded":"2024-03-18T15:00:50.620831+0000","last_fullsized":"2024-03-18T15:00:50.620831+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:48:33.423891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621330+0000","last_change":"2024-03-18T15:00:49.610925+0000","last_active":"2024-03-18T15:00:50.621330+0000","last_peered":"2024-03-18T15:00:50.621330+0000","last_clean":"2024-03-18T15:00:50.621330+0000","last_became_active":"2024-03-18T15:00:49.610629+0000","last_became_peered":"2024-03-18T15:00:49.610629+0000","last_unstale":"2024-03-18T15:00:50.621330+0000","last_undegraded":"2024-03-18T15:00:50.621330+0000","last_fullsized":"2024-03-18T15:00:50.621330+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:02:38.011899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620674+0000","last_change":"2024-03-18T15:00:48.606308+0000","last_active":"2024-03-18T15:00:50.620674+0000","last_peered":"2024-03-18T15:00:50.620674+0000","last_clean":"2024-03-18T15:00:50.620674+0000","last_became_active":"2024-03-18T15:00:48.605995+0000","last_became_peered":"2024-03-18T15:00:48.605995+0000","last_unstale":"2024-03-18T15:00:50.620674+0000","last_undegraded":"2024-03-18T15:00:50.620674+0000","last_fullsized":"2024-03-18T15:00:50.620674+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:49:54.674644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620069+0000","last_change":"2024-03-18T15:00:49.608580+0000","last_active":"2024-03-18T15:00:50.620069+0000","last_peered":"2024-03-18T15:00:50.620069+0000","last_clean":"2024-03-18T15:00:50.620069+0000","last_became_active":"2024-03-18T15:00:49.608309+0000","last_became_peered":"2024-03-18T15:00:49.608309+0000","last_unstale":"2024-03-18T15:00:50.620069+0000","last_undegraded":"2024-03-18T15:00:50.620069+0000","last_fullsized":"2024-03-18T15:00:50.620069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:52:14.226798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.603679+0000","last_change":"2024-03-18T15:00:49.610242+0000","last_active":"2024-03-18T15:00:50.603679+0000","last_peered":"2024-03-18T15:00:50.603679+0000","last_clean":"2024-03-18T15:00:50.603679+0000","last_became_active":"2024-03-18T15:00:49.609978+0000","last_became_peered":"2024-03-18T15:00:49.609978+0000","last_unstale":"2024-03-18T15:00:50.603679+0000","last_undegraded":"2024-03-18T15:00:50.603679+0000","last_fullsized":"2024-03-18T15:00:50.603679+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:14:42.045306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620575+0000","last_change":"2024-03-18T15:00:48.606807+0000","last_active":"2024-03-18T15:00:50.620575+0000","last_peered":"2024-03-18T15:00:50.620575+0000","last_clean":"2024-03-18T15:00:50.620575+0000","last_became_active":"2024-03-18T15:00:48.606208+0000","last_became_peered":"2024-03-18T15:00:48.606208+0000","last_unstale":"2024-03-18T15:00:50.620575+0000","last_undegraded":"2024-03-18T15:00:50.620575+0000","last_fullsized":"2024-03-18T15:00:50.620575+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:59:01.302664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.604641+0000","last_change":"2024-03-18T15:00:49.610020+0000","last_active":"2024-03-18T15:00:50.604641+0000","last_peered":"2024-03-18T15:00:50.604641+0000","last_clean":"2024-03-18T15:00:50.604641+0000","last_became_active":"2024-03-18T15:00:49.609738+0000","last_became_peered":"2024-03-18T15:00:49.609738+0000","last_unstale":"2024-03-18T15:00:50.604641+0000","last_undegraded":"2024-03-18T15:00:50.604641+0000","last_fullsized":"2024-03-18T15:00:50.604641+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:11:57.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"21'2","reported_seq":16,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620859+0000","last_change":"2024-03-18T15:00:48.605633+0000","last_active":"2024-03-18T15:00:50.620859+0000","last_peered":"2024-03-18T15:00:50.620859+0000","last_clean":"2024-03-18T15:00:50.620859+0000","last_became_active":"2024-03-18T15:00:48.605283+0000","last_became_peered":"2024-03-18T15:00:48.605283+0000","last_unstale":"2024-03-18T15:00:50.620859+0000","last_undegraded":"2024-03-18T15:00:50.620859+0000","last_fullsized":"2024-03-18T15:00:50.620859+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:51:53.197608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621075+0000","last_change":"2024-03-18T15:00:49.616193+0000","last_active":"2024-03-18T15:00:50.621075+0000","last_peered":"2024-03-18T15:00:50.621075+0000","last_clean":"2024-03-18T15:00:50.621075+0000","last_became_active":"2024-03-18T15:00:49.615875+0000","last_became_peered":"2024-03-18T15:00:49.615875+0000","last_unstale":"2024-03-18T15:00:50.621075+0000","last_undegraded":"2024-03-18T15:00:50.621075+0000","last_fullsized":"2024-03-18T15:00:50.621075+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:34:10.566090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"21'1","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621253+0000","last_change":"2024-03-18T15:00:48.609702+0000","last_active":"2024-03-18T15:00:50.621253+0000","last_peered":"2024-03-18T15:00:50.621253+0000","last_clean":"2024-03-18T15:00:50.621253+0000","last_became_active":"2024-03-18T15:00:48.609383+0000","last_became_peered":"2024-03-18T15:00:48.609383+0000","last_unstale":"2024-03-18T15:00:50.621253+0000","last_undegraded":"2024-03-18T15:00:50.621253+0000","last_fullsized":"2024-03-18T15:00:50.621253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:07:28.443347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":12,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.620760+0000","last_change":"2024-03-18T15:00:49.608193+0000","last_active":"2024-03-18T15:00:50.620760+0000","last_peered":"2024-03-18T15:00:50.620760+0000","last_clean":"2024-03-18T15:00:50.620760+0000","last_became_active":"2024-03-18T15:00:49.607932+0000","last_became_peered":"2024-03-18T15:00:49.607932+0000","last_unstale":"2024-03-18T15:00:50.620760+0000","last_undegraded":"2024-03-18T15:00:50.620760+0000","last_fullsized":"2024-03-18T15:00:50.620760+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:48.576868+0000","last_clean_scrub_stamp":"2024-03-18T15:00:48.576868+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:47:16.921430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"21'4","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-03-18T15:00:50.621370+0000","last_change":"2024-03-18T15:00:48.602744+0000","last_active":"2024-03-18T15:00:50.621370+0000","last_peered":"2024-03-18T15:00:50.621370+0000","last_clean":"2024-03-18T15:00:50.621370+0000","last_became_active":"2024-03-18T15:00:48.602343+0000","last_became_peered":"2024-03-18T15:00:48.602343+0000","last_unstale":"2024-03-18T15:00:50.621370+0000","last_undegraded":"2024-03-18T15:00:50.621370+0000","last_fullsized":"2024-03-18T15:00:50.621370+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:47.566655+0000","last_clean_scrub_stamp":"2024-03-18T15:00:47.566655+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:31:22.506254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509449,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509450,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27240,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344600,"statfs":{"total":96636764160,"available":96608870400,"internally_reserved":0,"allocated":221184,"data_stored":78052,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509449,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":224,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":229376,"data_stored":78212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542153,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27824,"kb_used_data":800,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344016,"statfs":{"total":96636764160,"available":96608272384,"internally_reserved":0,"allocated":819200,"data_stored":669002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542152,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":79664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27244,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344596,"statfs":{"total":96636764160,"available":96608866304,"internally_reserved":0,"allocated":225280,"data_stored":78142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542152,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":78178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574856,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31992,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339848,"statfs":{"total":96636764160,"available":96604004352,"internally_reserved":0,"allocated":827392,"data_stored":669058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:02.319 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T15:01:02.319 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-18T15:01:02.319 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-03-18T15:01:02.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-03-18T15:01:02.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.456+0000 7fc540b32640 1 Processor -- start 2024-03-18T15:01:02.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.456+0000 7fc540b32640 1 -- start start 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc53c13df70 0x7fc53c0ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 0x7fc53c1406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 0x7fc53c15ead0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc53c13e350 con 0x7fc53c13df70 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fc53c0ced20 con 0x7fc53c15bf60 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc540b32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc53c0cf000 con 0x7fc53c140c20 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc53a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc53c13df70 0x7fc53c0ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc53a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc53c13df70 0x7fc53c0ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59588/0 (socket says 172.21.15.152:59588) 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.457+0000 7fc53a59c640 1 -- 172.21.15.152:0/3048367548 learned_addr learned my addr 172.21.15.152:0/3048367548 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53ad9d640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 0x7fc53c15ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc533fff640 1 --2- 172.21.15.152:0/3048367548 >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 0x7fc53c1406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 -- 172.21.15.152:0/3048367548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 msgr2=0x7fc53c15ead0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 0x7fc53c15ead0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 -- 172.21.15.152:0/3048367548 >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 msgr2=0x7fc53c1406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 --2- 172.21.15.152:0/3048367548 >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 0x7fc53c1406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 -- 172.21.15.152:0/3048367548 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c0cf2e0 con 0x7fc53c13df70 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53ad9d640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 0x7fc53c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc533fff640 1 --2- 172.21.15.152:0/3048367548 >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 0x7fc53c1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc53a59c640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c13df70 0x7fc53c0ce6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc53c06f2c0 tx=0x7fc52c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f3efee584a72b41 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.458+0000 7fc539d9b640 1 -- 172.21.15.152:0/3048367548 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c02e070 con 0x7fc53c13df70 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc539d9b640 1 -- 172.21.15.152:0/3048367548 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc52c037070 con 0x7fc53c13df70 2024-03-18T15:01:02.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc539d9b640 1 -- 172.21.15.152:0/3048367548 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc52c031a00 con 0x7fc53c13df70 2024-03-18T15:01:02.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 -- 172.21.15.152:0/3048367548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c13df70 msgr2=0x7fc53c0ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c13df70 0x7fc53c0ce6b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc53c06f2c0 tx=0x7fc52c02b880 comp rx=0 tx=0).stop 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 -- 172.21.15.152:0/3048367548 shutdown_connections 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c140c20 0x7fc53c15ead0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 --2- 172.21.15.152:0/3048367548 >> v2:172.21.15.186:3300/0 conn(0x7fc53c15bf60 0x7fc53c1406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 --2- 172.21.15.152:0/3048367548 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c13df70 0x7fc53c0ce6b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 -- 172.21.15.152:0/3048367548 >> 172.21.15.152:0/3048367548 conn(0x7fc53c06b3a0 msgr2=0x7fc53c06b7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 -- 172.21.15.152:0/3048367548 shutdown_connections 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.459+0000 7fc540b32640 1 -- 172.21.15.152:0/3048367548 wait complete. 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.460+0000 7fc540b32640 1 Processor -- start 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 -- start start 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c13df70 0x7fc53c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c140c20 0x7fc53c06dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c15f010 con 0x7fc53c15bf60 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc53c15c3f0 con 0x7fc53c140c20 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc540b32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc53c15f190 con 0x7fc53c13df70 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc53ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc53ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59592/0 (socket says 172.21.15.152:59592) 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc53ad9d640 1 -- 172.21.15.152:0/2069669305 learned_addr learned my addr 172.21.15.152:0/2069669305 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc53a59c640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c13df70 0x7fc53c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.461+0000 7fc533fff640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c140c20 0x7fc53c06dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 -- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c13df70 msgr2=0x7fc53c151430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c13df70 0x7fc53c151430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 -- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c140c20 msgr2=0x7fc53c06dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c140c20 0x7fc53c06dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 -- 172.21.15.152:0/2069669305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc53c151970 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc53ad9d640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc53400cef0 tx=0x7fc53400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53401a070 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc53400d840 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc53c0ae680 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc53400dc30 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.462+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc53c0aec40 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.463+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc53c071690 con 0x7fc53c15bf60 2024-03-18T15:01:02.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.463+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc53401d070 con 0x7fc53c15bf60 2024-03-18T15:01:02.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.464+0000 7fc532ffd640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 0x7fc51c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.464+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc53408b270 con 0x7fc53c15bf60 2024-03-18T15:01:02.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.464+0000 7fc53a59c640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 0x7fc51c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.464+0000 7fc53a59c640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 0x7fc51c06e0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc52c036000 tx=0x7fc52c03d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.468+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc534059d60 con 0x7fc53c15bf60 2024-03-18T15:01:02.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.687+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fc53c069050 con 0x7fc53c15bf60 2024-03-18T15:01:02.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.687+0000 7fc532ffd640 1 -- 172.21.15.152:0/2069669305 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fc534059660 con 0x7fc53c15bf60 2024-03-18T15:01:02.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:02.688 INFO:teuthology.orchestra.run.smithi152.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 msgr2=0x7fc51c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 0x7fc51c06e0c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc52c036000 tx=0x7fc52c03d040 comp rx=0 tx=0).stop 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 msgr2=0x7fc53c06e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fc53400cef0 tx=0x7fc53400a710 comp rx=0 tx=0).stop 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 shutdown_connections 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc53c15bf60 0x7fc53c06e130 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc53c140c20 0x7fc53c06dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc51c06bc00 0x7fc51c06e0c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 --2- 172.21.15.152:0/2069669305 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc53c13df70 0x7fc53c151430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 >> 172.21.15.152:0/2069669305 conn(0x7fc53c06b3a0 msgr2=0x7fc53c15e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 shutdown_connections 2024-03-18T15:01:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.689+0000 7fc540b32640 1 -- 172.21.15.152:0/2069669305 wait complete. 2024-03-18T15:01:02.700 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-03-18T15:01:02.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:02.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.802+0000 7f93f3212640 1 Processor -- start 2024-03-18T15:01:02.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.802+0000 7f93f3212640 1 -- start start 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.803+0000 7f93f3212640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93ec1622b0 0x7f93ec0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.803+0000 7f93f3212640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f93ec15ea90 0x7f93ec15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.803+0000 7f93f3212640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f93ec0b3440 con 0x7f93ec162690 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f3212640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0d16c0 con 0x7f93ec1622b0 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f3212640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f93ec0d2660 con 0x7f93ec15ea90 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f0fae640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f93ec1622b0 0x7f93ec0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93ebfff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f93ec162690 0x7f93ec162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44018/0 (socket says 172.21.15.152:44018) 2024-03-18T15:01:02.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93ebfff640 1 -- 172.21.15.152:0/1403427349 learned_addr learned my addr 172.21.15.152:0/1403427349 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f17af640 1 --2- 172.21.15.152:0/1403427349 >> v2:172.21.15.186:3300/0 conn(0x7f93ec15ea90 0x7f93ec15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f0fae640 1 -- 172.21.15.152:0/1403427349 >> v2:172.21.15.186:3300/0 conn(0x7f93ec15ea90 msgr2=0x7f93ec15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f0fae640 1 --2- 172.21.15.152:0/1403427349 >> v2:172.21.15.186:3300/0 conn(0x7f93ec15ea90 0x7f93ec15eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f0fae640 1 -- 172.21.15.152:0/1403427349 >> v1:172.21.15.152:6789/0 conn(0x7f93ec162690 legacy=0x7f93ec162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93f0fae640 1 -- 172.21.15.152:0/1403427349 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec0d20a0 con 0x7f93ec1622b0 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.804+0000 7f93eb7fe640 1 -- 172.21.15.152:0/1403427349 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3927426622 0 0) 0x7f93ec0b3440 con 0x7f93ec162690 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f0fae640 1 --2- 172.21.15.152:0/1403427349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec1622b0 0x7f93ec0d10d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93e00097a0 tx=0x7f93e002b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f99e667e3664151 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93eb7fe640 1 -- 172.21.15.152:0/1403427349 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0038070 con 0x7f93ec1622b0 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93eb7fe640 1 -- 172.21.15.152:0/1403427349 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0031700 con 0x7f93ec1622b0 2024-03-18T15:01:02.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93eb7fe640 1 -- 172.21.15.152:0/1403427349 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0031ad0 con 0x7f93ec1622b0 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 -- 172.21.15.152:0/1403427349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec1622b0 msgr2=0x7f93ec0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 --2- 172.21.15.152:0/1403427349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec1622b0 0x7f93ec0d10d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f93e00097a0 tx=0x7f93e002b7a0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 -- 172.21.15.152:0/1403427349 shutdown_connections 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 --2- 172.21.15.152:0/1403427349 >> v2:172.21.15.186:3300/0 conn(0x7f93ec15ea90 0x7f93ec15eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 --2- 172.21.15.152:0/1403427349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec1622b0 0x7f93ec0d10d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 -- 172.21.15.152:0/1403427349 >> 172.21.15.152:0/1403427349 conn(0x7f93ec0d4070 msgr2=0x7f93ec0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 -- 172.21.15.152:0/1403427349 shutdown_connections 2024-03-18T15:01:02.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.805+0000 7f93f3212640 1 -- 172.21.15.152:0/1403427349 wait complete. 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 Processor -- start 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 -- start start 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93ec1622b0 0x7f93ec15d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 0x7f93ec15d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0cfc90 con 0x7f93ec15ea90 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f93ec0d2ab0 con 0x7f93ec162690 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f3212640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f93ec0cfe10 con 0x7f93ec1622b0 2024-03-18T15:01:02.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.807+0000 7f93f0fae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59608/0 (socket says 172.21.15.152:59608) 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 -- 172.21.15.152:0/1470670706 learned_addr learned my addr 172.21.15.152:0/1470670706 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 -- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93ec1622b0 msgr2=0x7f93ec15d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93ebfff640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93ec1622b0 0x7f93ec15d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f17af640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 0x7f93ec15d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93ec1622b0 0x7f93ec15d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 -- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 msgr2=0x7f93ec15d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 0x7f93ec15d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 -- 172.21.15.152:0/1470670706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93ec1f58d0 con 0x7f93ec15ea90 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f17af640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 0x7f93ec15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f0fae640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93e00098c0 tx=0x7f93e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0038040 con 0x7f93ec15ea90 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93e0031500 con 0x7f93ec15ea90 2024-03-18T15:01:02.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93ec1f5ac0 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93e0033bd0 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.808+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93ec15c190 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.809+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93ec04f5b0 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.810+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f93e0045020 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.810+0000 7f93e97fa640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 0x7f93d006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.810+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f93e00abb50 con 0x7f93ec15ea90 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.810+0000 7f93ebfff640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 0x7f93d006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:02.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.810+0000 7f93ebfff640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 0x7f93d006e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93d8007fd0 tx=0x7f93d8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:02.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.818+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f93e0030070 con 0x7f93ec15ea90 2024-03-18T15:01:02.997 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.997+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93ec0d18d0 con 0x7f93ec15ea90 2024-03-18T15:01:02.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:02.998+0000 7f93e97fa640 1 -- 172.21.15.152:0/1470670706 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f93e00316d0 con 0x7f93ec15ea90 2024-03-18T15:01:02.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:02.999 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:03.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 msgr2=0x7f93d006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 0x7f93d006e090 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f93d8007fd0 tx=0x7f93d8009040 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 msgr2=0x7f93ec1f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f93e00098c0 tx=0x7f93e00046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 shutdown_connections 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f93ec162690 0x7f93ec15d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93d006bbd0 0x7f93d006e090 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f93ec1622b0 0x7f93ec15d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 --2- 172.21.15.152:0/1470670706 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f93ec15ea90 0x7f93ec1f5390 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 >> 172.21.15.152:0/1470670706 conn(0x7f93ec0d4070 msgr2=0x7f93ec159cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 shutdown_connections 2024-03-18T15:01:03.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.000+0000 7f93f3212640 1 -- 172.21.15.152:0/1470670706 wait complete. 2024-03-18T15:01:03.011 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:03.011 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:03.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 Processor -- start 2024-03-18T15:01:03.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 -- start start 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e800d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6e800ceca0 0x7f6e800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e800cce20 con 0x7f6e800ce840 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6e800b7d60 con 0x7f6e800ceca0 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.116+0000 7f6e84d97640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6e800cd100 con 0x7f6e8015c140 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7ed9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6e800ceca0 0x7f6e800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e77fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6e800ce840 0x7f6e800b7110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44034/0 (socket says 172.21.15.152:44034) 2024-03-18T15:01:03.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e77fff640 1 -- 172.21.15.152:0/3421812650 learned_addr learned my addr 172.21.15.152:0/3421812650 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7e59c640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e800d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7ed9d640 1 -- 172.21.15.152:0/3421812650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 msgr2=0x7f6e800d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7ed9d640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e800d08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7ed9d640 1 -- 172.21.15.152:0/3421812650 >> v1:172.21.15.152:6789/0 conn(0x7f6e800ce840 legacy=0x7f6e800b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7ed9d640 1 -- 172.21.15.152:0/3421812650 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e800cd3e0 con 0x7f6e800ceca0 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7dd9b640 1 -- 172.21.15.152:0/3421812650 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 605855879 0 0) 0x7f6e800cce20 con 0x7f6e800ce840 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.117+0000 7f6e7e59c640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e800d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e7ed9d640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ceca0 0x7f6e800b7820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009d90 tx=0x7f6e7802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82fb895613ff06c2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e7dd9b640 1 -- 172.21.15.152:0/3421812650 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78039070 con 0x7f6e800ceca0 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e7dd9b640 1 -- 172.21.15.152:0/3421812650 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7802cc50 con 0x7f6e800ceca0 2024-03-18T15:01:03.119 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e7dd9b640 1 -- 172.21.15.152:0/3421812650 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e78034440 con 0x7f6e800ceca0 2024-03-18T15:01:03.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 -- 172.21.15.152:0/3421812650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ceca0 msgr2=0x7f6e800b7820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ceca0 0x7f6e800b7820 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f6e78009d90 tx=0x7f6e7802bea0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 -- 172.21.15.152:0/3421812650 shutdown_connections 2024-03-18T15:01:03.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ceca0 0x7f6e800b7820 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 --2- 172.21.15.152:0/3421812650 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e800d08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 -- 172.21.15.152:0/3421812650 >> 172.21.15.152:0/3421812650 conn(0x7f6e8009b160 msgr2=0x7f6e800d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 -- 172.21.15.152:0/3421812650 shutdown_connections 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.118+0000 7f6e84d97640 1 -- 172.21.15.152:0/3421812650 wait complete. 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 Processor -- start 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 -- start start 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 0x7f6e800c9040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e80146510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e800cf130 con 0x7f6e800ce840 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6e800cd9a0 con 0x7f6e800ceca0 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.120+0000 7f6e84d97640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6e800d0e00 con 0x7f6e8015c140 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59616/0 (socket says 172.21.15.152:59616) 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 -- 172.21.15.152:0/1347491224 learned_addr learned my addr 172.21.15.152:0/1347491224 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 -- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 msgr2=0x7f6e80146510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7ed9d640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e80146510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e77fff640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 0x7f6e800c9040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e80146510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 -- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 msgr2=0x7f6e800c9040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 0x7f6e800c9040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 -- 172.21.15.152:0/1347491224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e801475e0 con 0x7f6e800ce840 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e77fff640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 0x7f6e800c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:03.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e7e59c640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000d800 tx=0x7f6e7000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70004030 con 0x7f6e800ce840 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e700041d0 con 0x7f6e800ce840 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e801478c0 con 0x7f6e800ce840 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e700096a0 con 0x7f6e800ce840 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.121+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e80147e80 con 0x7f6e800ce840 2024-03-18T15:01:03.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.122+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8004f540 con 0x7f6e800ce840 2024-03-18T15:01:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.123+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6e70009840 con 0x7f6e800ce840 2024-03-18T15:01:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.123+0000 7f6e76ffd640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 0x7f6e6006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.123+0000 7f6e77fff640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 0x7f6e6006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.123+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6e7008ad10 con 0x7f6e800ce840 2024-03-18T15:01:03.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.124+0000 7f6e77fff640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 0x7f6e6006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e80074540 tx=0x7f6e68009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.127+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6e70059890 con 0x7f6e800ce840 2024-03-18T15:01:03.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.304+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6e800ce620 con 0x7f6e800ce840 2024-03-18T15:01:03.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.304+0000 7f6e76ffd640 1 -- 172.21.15.152:0/1347491224 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f6e70059190 con 0x7f6e800ce840 2024-03-18T15:01:03.304 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:03.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 msgr2=0x7f6e6006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 0x7f6e6006e090 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f6e80074540 tx=0x7f6e68009040 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 msgr2=0x7f6e80146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f6e7000d800 tx=0x7f6e7000dcc0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 shutdown_connections 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6006bbd0 0x7f6e6006e090 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e8015c140 0x7f6e80146510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e800ceca0 0x7f6e800c9040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 --2- 172.21.15.152:0/1347491224 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e800ce840 0x7f6e80146f20 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 >> 172.21.15.152:0/1347491224 conn(0x7f6e8009b160 msgr2=0x7f6e800b6540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 shutdown_connections 2024-03-18T15:01:03.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.306+0000 7f6e84d97640 1 -- 172.21.15.152:0/1347491224 wait complete. 2024-03-18T15:01:03.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:03.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.454+0000 7fe893697640 1 Processor -- start 2024-03-18T15:01:03.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.454+0000 7fe893697640 1 -- start start 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe893697640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe88c161890 0x7fe88c0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe893697640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88c0cffe0 con 0x7fe88c0d1070 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe893697640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe88c0cfa20 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe893697640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe88c0cfd00 con 0x7fe88c161890 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe88c161890 0x7fe88c0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe88c161890 0x7fe88c0d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59624/0 (socket says 172.21.15.152:59624) 2024-03-18T15:01:03.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891c34640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe88c0d1070 0x7fe88c0d2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44044/0 (socket says 172.21.15.152:44044) 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 -- 172.21.15.152:0/1459362104 learned_addr learned my addr 172.21.15.152:0/1459362104 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 -- 172.21.15.152:0/1459362104 >> v1:172.21.15.186:6789/0 conn(0x7fe88c0b4ec0 legacy=0x7fe88c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 -- 172.21.15.152:0/1459362104 >> v1:172.21.15.152:6789/0 conn(0x7fe88c0d1070 legacy=0x7fe88c0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe891433640 1 -- 172.21.15.152:0/1459362104 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c0cf710 con 0x7fe88c161890 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.455+0000 7fe883fff640 1 -- 172.21.15.152:0/1459362104 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1175962771 0 0) 0x7fe88c0cffe0 con 0x7fe88c0d1070 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.456+0000 7fe891433640 1 --2- 172.21.15.152:0/1459362104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c161890 0x7fe88c0d4bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe88802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7297571e11554675 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.456+0000 7fe883fff640 1 -- 172.21.15.152:0/1459362104 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888034070 con 0x7fe88c161890 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.456+0000 7fe883fff640 1 -- 172.21.15.152:0/1459362104 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe888030860 con 0x7fe88c161890 2024-03-18T15:01:03.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.456+0000 7fe883fff640 1 -- 172.21.15.152:0/1459362104 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888030c30 con 0x7fe88c161890 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.456+0000 7fe893697640 1 -- 172.21.15.152:0/1459362104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c161890 msgr2=0x7fe88c0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 --2- 172.21.15.152:0/1459362104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c161890 0x7fe88c0d4bb0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe88802b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 -- 172.21.15.152:0/1459362104 shutdown_connections 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 --2- 172.21.15.152:0/1459362104 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c161890 0x7fe88c0d4bb0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 -- 172.21.15.152:0/1459362104 >> 172.21.15.152:0/1459362104 conn(0x7fe88c0d4090 msgr2=0x7fe88c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 -- 172.21.15.152:0/1459362104 shutdown_connections 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.457+0000 7fe893697640 1 -- 172.21.15.152:0/1459362104 wait complete. 2024-03-18T15:01:03.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.458+0000 7fe893697640 1 Processor -- start 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.458+0000 7fe893697640 1 -- start start 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.458+0000 7fe893697640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88c0d1070 0x7fe88c15f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe88c161890 0x7fe88c0b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c0b6ee0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe88c0b5580 con 0x7fe88c161890 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe88c0b7060 con 0x7fe88c0d1070 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59626/0 (socket says 172.21.15.152:59626) 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 -- 172.21.15.152:0/2750778270 learned_addr learned my addr 172.21.15.152:0/2750778270 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 -- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88c0d1070 msgr2=0x7fe88c15f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88c0d1070 0x7fe88c15f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 -- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe88c161890 msgr2=0x7fe88c0b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe88c161890 0x7fe88c0b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 -- 172.21.15.152:0/2750778270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe88c0ca2a0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe891433640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe888004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888048070 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe888030660 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe888034040 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe88c15fdb0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.459+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe88c0c9fc0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.460+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe88c04f540 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.461+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe888037070 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.461+0000 7fe881ffb640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 0x7fe87006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.461+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe8880ac8e0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.461+0000 7fe890c32640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 0x7fe87006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.462+0000 7fe890c32640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 0x7fe87006e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006fd0 tx=0x7fe87c006bc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.466+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe88c15fdb0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.640+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe88c162e20 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.640+0000 7fe881ffb640 1 -- 172.21.15.152:0/2750778270 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fe88c0ca2a0 con 0x7fe88c0b4ec0 2024-03-18T15:01:03.641 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 msgr2=0x7fe87006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 0x7fe87006e090 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe87c006fd0 tx=0x7fe87c006bc0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 msgr2=0x7fe88c0c9650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fe888009870 tx=0x7fe888004730 comp rx=0 tx=0).stop 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 shutdown_connections 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe88c161890 0x7fe88c0b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe87006bbd0 0x7fe87006e090 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe88c0d1070 0x7fe88c15f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 --2- 172.21.15.152:0/2750778270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe88c0b4ec0 0x7fe88c0c9650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 >> 172.21.15.152:0/2750778270 conn(0x7fe88c0d4090 msgr2=0x7fe88c162710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 shutdown_connections 2024-03-18T15:01:03.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.642+0000 7fe893697640 1 -- 172.21.15.152:0/2750778270 wait complete. 2024-03-18T15:01:03.654 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.758+0000 7f7c4aaa7640 1 Processor -- start 2024-03-18T15:01:03.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.758+0000 7f7c4aaa7640 1 -- start start 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c4aaa7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 0x7f7c440d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c4aaa7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c440b4ec0 0x7f7c440b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c4aaa7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c440cffe0 con 0x7f7c440d0960 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c4aaa7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7c440cfa20 con 0x7f7c440b4ec0 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c4aaa7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7c440cfd00 con 0x7f7c44161890 2024-03-18T15:01:03.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c43fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c440b4ec0 0x7f7c440b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c43fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7c440b4ec0 0x7f7c440b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59628/0 (socket says 172.21.15.152:59628) 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.759+0000 7f7c43fff640 1 -- 172.21.15.152:0/3108116502 learned_addr learned my addr 172.21.15.152:0/3108116502 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c48843640 1 --2- 172.21.15.152:0/3108116502 >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 0x7f7c440d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c43fff640 1 -- 172.21.15.152:0/3108116502 >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 msgr2=0x7f7c440d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c43fff640 1 --2- 172.21.15.152:0/3108116502 >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 0x7f7c440d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c43fff640 1 -- 172.21.15.152:0/3108116502 >> v1:172.21.15.186:6789/0 conn(0x7f7c440d0960 legacy=0x7f7c440d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c43fff640 1 -- 172.21.15.152:0/3108116502 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440cf710 con 0x7f7c440b4ec0 2024-03-18T15:01:03.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c48843640 1 --2- 172.21.15.152:0/3108116502 >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 0x7f7c440d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.760+0000 7f7c43fff640 1 --2- 172.21.15.152:0/3108116502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440b6ee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7c4406bb90 tx=0x7f7c3002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2575d51821b65c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c437fe640 1 -- 172.21.15.152:0/3108116502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30034070 con 0x7f7c440b4ec0 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c437fe640 1 -- 172.21.15.152:0/3108116502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c30030860 con 0x7f7c440b4ec0 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c437fe640 1 -- 172.21.15.152:0/3108116502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c30030c30 con 0x7f7c440b4ec0 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/3108116502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 msgr2=0x7f7c440b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/3108116502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440b6ee0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f7c4406bb90 tx=0x7f7c3002b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/3108116502 shutdown_connections 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/3108116502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440b6ee0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/3108116502 >> v2:172.21.15.186:3300/0 conn(0x7f7c44161890 0x7f7c440d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/3108116502 >> 172.21.15.152:0/3108116502 conn(0x7f7c440d4090 msgr2=0x7f7c440d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/3108116502 shutdown_connections 2024-03-18T15:01:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.761+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/3108116502 wait complete. 2024-03-18T15:01:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.762+0000 7f7c4aaa7640 1 Processor -- start 2024-03-18T15:01:03.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.762+0000 7f7c4aaa7640 1 -- start start 2024-03-18T15:01:03.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c440d0960 0x7f7c441e9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c44161890 0x7f7c441ea350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440d0df0 con 0x7f7c440b4ec0 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7c440b5580 con 0x7f7c440d0960 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c4aaa7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7c440d0f70 con 0x7f7c44161890 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c48843640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c48843640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59642/0 (socket says 172.21.15.152:59642) 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.763+0000 7f7c48843640 1 -- 172.21.15.152:0/1292250635 learned_addr learned my addr 172.21.15.152:0/1292250635 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 -- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c44161890 msgr2=0x7f7c441ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c44161890 0x7f7c441ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 -- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c440d0960 msgr2=0x7f7c441e9e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c43fff640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c440d0960 0x7f7c441e9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c440d0960 0x7f7c441e9e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 -- 172.21.15.152:0/1292250635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c440c9280 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c48843640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800d7d0 tx=0x7f7c3800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c38004030 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c380041d0 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c440ce540 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c380096a0 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.764+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c440c89e0 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.765+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c4404f540 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.766+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7c38009840 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.766+0000 7f7c417fa640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 0x7f7c2806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.766+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f7c3808adb0 con 0x7f7c440b4ec0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.766+0000 7f7c43fff640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 0x7f7c2806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:03.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.767+0000 7f7c43fff640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 0x7f7c2806e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c30036000 tx=0x7f7c3003b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:03.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.771+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7c38059810 con 0x7f7c440b4ec0 2024-03-18T15:01:03.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.949+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7c440b9f50 con 0x7f7c440b4ec0 2024-03-18T15:01:03.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.950+0000 7f7c417fa640 1 -- 172.21.15.152:0/1292250635 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f7c38059110 con 0x7f7c440b4ec0 2024-03-18T15:01:03.951 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:03.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 msgr2=0x7f7c2806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 0x7f7c2806e090 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f7c30036000 tx=0x7f7c3003b040 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 msgr2=0x7f7c440ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7c3800d7d0 tx=0x7f7c3800dc90 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 shutdown_connections 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7c2806bbd0 0x7f7c2806e090 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7c44161890 0x7f7c441ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7c440d0960 0x7f7c441e9e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 --2- 172.21.15.152:0/1292250635 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7c440b4ec0 0x7f7c440ce000 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 >> 172.21.15.152:0/1292250635 conn(0x7f7c440d4090 msgr2=0x7f7c4415f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 shutdown_connections 2024-03-18T15:01:03.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:03.952+0000 7f7c4aaa7640 1 -- 172.21.15.152:0/1292250635 wait complete. 2024-03-18T15:01:03.963 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:04.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.064+0000 7f5944380640 1 Processor -- start 2024-03-18T15:01:04.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.064+0000 7f5944380640 1 -- start start 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c3a0 0x7f593c0d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f593c15c780 0x7f593c0ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f593c0cedb0 0x7f593c0cf240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f593c0cd510 con 0x7f593c0cedb0 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f593c0cd7f0 con 0x7f593c15c780 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f5944380640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f593c0cdad0 con 0x7f593c15c3a0 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f594291d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f593c0cedb0 0x7f593c0cf240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f594291d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f593c0cedb0 0x7f593c0cf240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59650/0 (socket says 172.21.15.152:59650) 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f594291d640 1 -- 172.21.15.152:0/2583429946 learned_addr learned my addr 172.21.15.152:0/2583429946 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f594211c640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c3a0 0x7f593c0d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.065+0000 7f594191b640 1 --2- 172.21.15.152:0/2583429946 >> v2:172.21.15.186:3300/0 conn(0x7f593c15c780 0x7f593c0ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 -- 172.21.15.152:0/2583429946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c3a0 msgr2=0x7f593c0d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c3a0 0x7f593c0d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 -- 172.21.15.152:0/2583429946 >> v2:172.21.15.186:3300/0 conn(0x7f593c15c780 msgr2=0x7f593c0ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 --2- 172.21.15.152:0/2583429946 >> v2:172.21.15.186:3300/0 conn(0x7f593c15c780 0x7f593c0ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 -- 172.21.15.152:0/2583429946 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c0cddb0 con 0x7f593c0cedb0 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594291d640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c0cedb0 0x7f593c0cf240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f593c072b10 tx=0x7f593402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd7bed91d099855 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.066+0000 7f594111a640 1 -- 172.21.15.152:0/2583429946 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593402ca70 con 0x7f593c0cedb0 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f594111a640 1 -- 172.21.15.152:0/2583429946 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f593402cc10 con 0x7f593c0cedb0 2024-03-18T15:01:04.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f594111a640 1 -- 172.21.15.152:0/2583429946 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59340343f0 con 0x7f593c0cedb0 2024-03-18T15:01:04.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 -- 172.21.15.152:0/2583429946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c0cedb0 msgr2=0x7f593c0cf240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c0cedb0 0x7f593c0cf240 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f593c072b10 tx=0x7f593402bed0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 -- 172.21.15.152:0/2583429946 shutdown_connections 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c0cedb0 0x7f593c0cf240 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 --2- 172.21.15.152:0/2583429946 >> v2:172.21.15.186:3300/0 conn(0x7f593c15c780 0x7f593c0ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 --2- 172.21.15.152:0/2583429946 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c3a0 0x7f593c0d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 -- 172.21.15.152:0/2583429946 >> 172.21.15.152:0/2583429946 conn(0x7f593c0d1e60 msgr2=0x7f593c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 -- 172.21.15.152:0/2583429946 shutdown_connections 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.067+0000 7f5944380640 1 -- 172.21.15.152:0/2583429946 wait complete. 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.069+0000 7f5944380640 1 Processor -- start 2024-03-18T15:01:04.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.069+0000 7f5944380640 1 -- start start 2024-03-18T15:01:04.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 0x7f593c0cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 0x7f593c14aef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f593c0cfee0 con 0x7f593c15c3a0 2024-03-18T15:01:04.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f593c0cfd60 con 0x7f593c0cedb0 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.070+0000 7f5944380640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f593c0d0060 con 0x7f593c15c780 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59656/0 (socket says 172.21.15.152:59656) 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 -- 172.21.15.152:0/963814984 learned_addr learned my addr 172.21.15.152:0/963814984 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594291d640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 0x7f593c14aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594211c640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 0x7f593c0cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 -- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 msgr2=0x7f593c14aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 0x7f593c14aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 -- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 msgr2=0x7f593c0cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 0x7f593c0cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 -- 172.21.15.152:0/963814984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f593c1f3860 con 0x7f593c15c3a0 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594211c640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 0x7f593c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:04.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594291d640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 0x7f593c14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f594191b640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e870 tx=0x7f592c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c017070 con 0x7f593c15c3a0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f592c00c940 con 0x7f593c15c3a0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f593c1f3b40 con 0x7f593c15c3a0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f592c00cd30 con 0x7f593c15c3a0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.071+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f593c0cb650 con 0x7f593c15c3a0 2024-03-18T15:01:04.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.072+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f593c04f5b0 con 0x7f593c15c3a0 2024-03-18T15:01:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.073+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f592c01a070 con 0x7f593c15c3a0 2024-03-18T15:01:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.073+0000 7f5932ffd640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 0x7f592006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.073+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f592c08abe0 con 0x7f593c15c3a0 2024-03-18T15:01:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.074+0000 7f594211c640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 0x7f592006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.074+0000 7f594211c640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 0x7f592006e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5938009a40 tx=0x7f5938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.078+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f592c059760 con 0x7f593c15c3a0 2024-03-18T15:01:04.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.296+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f593c0ce370 con 0x7f593c15c3a0 2024-03-18T15:01:04.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.296+0000 7f5932ffd640 1 -- 172.21.15.152:0/963814984 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f592c059060 con 0x7f593c15c3a0 2024-03-18T15:01:04.297 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:04.297 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:04.297 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:04.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 msgr2=0x7f592006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 0x7f592006e090 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f5938009a40 tx=0x7f5938008040 comp rx=0 tx=0).stop 2024-03-18T15:01:04.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 msgr2=0x7f593c0b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f592c00e870 tx=0x7f592c00ed30 comp rx=0 tx=0).stop 2024-03-18T15:01:04.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 shutdown_connections 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f592006bbd0 0x7f592006e090 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f593c15c780 0x7f593c14aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f593c15c3a0 0x7f593c0b4360 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 --2- 172.21.15.152:0/963814984 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f593c0cedb0 0x7f593c0cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 >> 172.21.15.152:0/963814984 conn(0x7f593c0d1e60 msgr2=0x7f593c15eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 shutdown_connections 2024-03-18T15:01:04.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.299+0000 7f5944380640 1 -- 172.21.15.152:0/963814984 wait complete. 2024-03-18T15:01:04.310 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:04.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.414+0000 7f9c278ff640 1 Processor -- start 2024-03-18T15:01:04.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 -- start start 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c3a0 0x7f9c200d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c200cef80 0x7f9c200af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c200cd510 con 0x7f9c2015c780 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9c200cd7f0 con 0x7f9c200cef80 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.415+0000 7f9c278ff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200cdad0 con 0x7f9c2015c3a0 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c200cef80 0x7f9c200af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9c200cef80 0x7f9c200af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59666/0 (socket says 172.21.15.152:59666) 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 -- 172.21.15.152:0/376431137 learned_addr learned my addr 172.21.15.152:0/376431137 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:04.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c2569b640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c3a0 0x7f9c200d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 -- 172.21.15.152:0/376431137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c3a0 msgr2=0x7f9c200d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c3a0 0x7f9c200d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 -- 172.21.15.152:0/376431137 >> v1:172.21.15.186:6789/0 conn(0x7f9c2015c780 legacy=0x7f9c200ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.416+0000 7f9c25e9c640 1 -- 172.21.15.152:0/376431137 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200cddb0 con 0x7f9c200cef80 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c25e9c640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200af000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009e50 tx=0x7f9c1c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7efc9381f6ea3b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c17fff640 1 -- 172.21.15.152:0/376431137 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c02cb00 con 0x7f9c200cef80 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c17fff640 1 -- 172.21.15.152:0/376431137 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c1c02cca0 con 0x7f9c200cef80 2024-03-18T15:01:04.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c17fff640 1 -- 172.21.15.152:0/376431137 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c034610 con 0x7f9c200cef80 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 -- 172.21.15.152:0/376431137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 msgr2=0x7f9c200af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200af000 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c009e50 tx=0x7f9c1c02bf60 comp rx=0 tx=0).stop 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 -- 172.21.15.152:0/376431137 shutdown_connections 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200af000 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 --2- 172.21.15.152:0/376431137 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c3a0 0x7f9c200d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 -- 172.21.15.152:0/376431137 >> 172.21.15.152:0/376431137 conn(0x7f9c200d1e60 msgr2=0x7f9c200d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 -- 172.21.15.152:0/376431137 shutdown_connections 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.417+0000 7f9c278ff640 1 -- 172.21.15.152:0/376431137 wait complete. 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 Processor -- start 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 -- start start 2024-03-18T15:01:04.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2015c3a0 0x7f9c200b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c780 0x7f9c200b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200cf590 con 0x7f9c200cef80 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9c200cf410 con 0x7f9c2015c3a0 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c278ff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9c200af540 con 0x7f9c2015c780 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c2569b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c2569b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59680/0 (socket says 172.21.15.152:59680) 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.419+0000 7f9c2569b640 1 -- 172.21.15.152:0/575290341 learned_addr learned my addr 172.21.15.152:0/575290341 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c25e9c640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c780 0x7f9c200b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c24e9a640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2015c3a0 0x7f9c200b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 -- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c780 msgr2=0x7f9c200b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c780 0x7f9c200b1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 -- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2015c3a0 msgr2=0x7f9c200b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2015c3a0 0x7f9c200b0270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 -- 172.21.15.152:0/575290341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c200b0930 con 0x7f9c200cef80 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c2569b640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d800 tx=0x7f9c1800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800b6c0 con 0x7f9c200cef80 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c18019070 con 0x7f9c200cef80 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c1800bac0 con 0x7f9c200cef80 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c200b0c10 con 0x7f9c200cef80 2024-03-18T15:01:04.423 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.420+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c200c9460 con 0x7f9c200cef80 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.421+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c2006b590 con 0x7f9c200cef80 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.422+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9c1800bc60 con 0x7f9c200cef80 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.422+0000 7f9c15ffb640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 0x7f9c0406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.422+0000 7f9c24e9a640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 0x7f9c0406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.422+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f9c1808aed0 con 0x7f9c200cef80 2024-03-18T15:01:04.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.423+0000 7f9c24e9a640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 0x7f9c0406e090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9c10007fd0 tx=0x7f9c10009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.427+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9c2006b590 con 0x7f9c200cef80 2024-03-18T15:01:04.608 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.608+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9c2004f5b0 con 0x7f9c200cef80 2024-03-18T15:01:04.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.609+0000 7f9c15ffb640 1 -- 172.21.15.152:0/575290341 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f9c18059a50 con 0x7f9c200cef80 2024-03-18T15:01:04.610 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:04.610 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 msgr2=0x7f9c0406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 0x7f9c0406e090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9c10007fd0 tx=0x7f9c10009040 comp rx=0 tx=0).stop 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 msgr2=0x7f9c200cb550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f9c1800d800 tx=0x7f9c1800dcc0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 shutdown_connections 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9c0406bbd0 0x7f9c0406e090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9c2015c780 0x7f9c200b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.612 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9c2015c3a0 0x7f9c200b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 --2- 172.21.15.152:0/575290341 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9c200cef80 0x7f9c200cb550 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 >> 172.21.15.152:0/575290341 conn(0x7f9c200d1e60 msgr2=0x7f9c200c7d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:04.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 shutdown_connections 2024-03-18T15:01:04.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.611+0000 7f9c278ff640 1 -- 172.21.15.152:0/575290341 wait complete. 2024-03-18T15:01:04.623 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:04.623 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 Processor -- start 2024-03-18T15:01:04.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 -- start start 2024-03-18T15:01:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcfc161890 0x7fdcfc0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0cffe0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcfc0cfa20 con 0x7fdcfc0d1070 2024-03-18T15:01:04.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.729+0000 7fdd047f1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdcfc0cfd00 con 0x7fdcfc161890 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd0258d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcfc161890 0x7fdcfc0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd01d8c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdcfc0b4ec0 0x7fdcfc0d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44052/0 (socket says 172.21.15.152:44052) 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd0258d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdcfc161890 0x7fdcfc0d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59690/0 (socket says 172.21.15.152:59690) 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd01d8c640 1 -- 172.21.15.152:0/2836165926 learned_addr learned my addr 172.21.15.152:0/2836165926 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd0258d640 1 -- 172.21.15.152:0/2836165926 >> v1:172.21.15.186:6789/0 conn(0x7fdcfc0d1070 legacy=0x7fdcfc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd0258d640 1 -- 172.21.15.152:0/2836165926 >> v1:172.21.15.152:6789/0 conn(0x7fdcfc0b4ec0 legacy=0x7fdcfc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.730+0000 7fdd0258d640 1 -- 172.21.15.152:0/2836165926 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0cf710 con 0x7fdcfc161890 2024-03-18T15:01:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.731+0000 7fdd0258d640 1 --2- 172.21.15.152:0/2836165926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc161890 0x7fdcfc0d4bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097a0 tx=0x7fdcf802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0282e53db55d6b3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.731+0000 7fdd0158b640 1 -- 172.21.15.152:0/2836165926 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8034070 con 0x7fdcfc161890 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.731+0000 7fdd0158b640 1 -- 172.21.15.152:0/2836165926 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf8030610 con 0x7fdcfc161890 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.731+0000 7fdd0158b640 1 -- 172.21.15.152:0/2836165926 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf80309e0 con 0x7fdcfc161890 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 -- 172.21.15.152:0/2836165926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc161890 msgr2=0x7fdcfc0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2836165926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc161890 0x7fdcfc0d4bb0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80097a0 tx=0x7fdcf802b960 comp rx=0 tx=0).stop 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 -- 172.21.15.152:0/2836165926 shutdown_connections 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2836165926 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc161890 0x7fdcfc0d4bb0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 -- 172.21.15.152:0/2836165926 >> 172.21.15.152:0/2836165926 conn(0x7fdcfc0d4090 msgr2=0x7fdcfc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 -- 172.21.15.152:0/2836165926 shutdown_connections 2024-03-18T15:01:04.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.732+0000 7fdd047f1640 1 -- 172.21.15.152:0/2836165926 wait complete. 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.733+0000 7fdd047f1640 1 Processor -- start 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.733+0000 7fdd047f1640 1 -- start start 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 0x7fdcfc0c8eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc161890 0x7fdcfc14e440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b6ee0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b5580 con 0x7fdcfc161890 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd047f1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdcfc0b7060 con 0x7fdcfc0d1070 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59692/0 (socket says 172.21.15.152:59692) 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 -- 172.21.15.152:0/2248391330 learned_addr learned my addr 172.21.15.152:0/2248391330 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:04.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd02d8e640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc161890 0x7fdcfc14e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd01d8c640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 0x7fdcfc0c8eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 -- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 msgr2=0x7fdcfc0c8eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 0x7fdcfc0c8eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 -- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc161890 msgr2=0x7fdcfc14e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc161890 0x7fdcfc14e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 -- 172.21.15.152:0/2248391330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcfc0c7910 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd01d8c640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 0x7fdcfc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.734+0000 7fdd0258d640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80098c0 tx=0x7fdcf80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.735+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8034040 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.735+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcf8039a10 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.735+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcfc0c7bf0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.735+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcf8039de0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.735+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcfc0c81b0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.736+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcfc04f540 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.736+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdcf8037070 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.737+0000 7fdcf2ffd640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 0x7fdce006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.737+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdcf80aca90 con 0x7fdcfc0b4ec0 2024-03-18T15:01:04.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.737+0000 7fdd01d8c640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 0x7fdce006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:04.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.737+0000 7fdd01d8c640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 0x7fdce006e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0cf6e0 tx=0x7fdcec009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:04.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:04.741+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdcf807b610 con 0x7fdcfc0b4ec0 2024-03-18T15:01:05.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.032+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdcfc08d7e0 con 0x7fdcfc0b4ec0 2024-03-18T15:01:05.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.033+0000 7fdcf2ffd640 1 -- 172.21.15.152:0/2248391330 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fdcf807af10 con 0x7fdcfc0b4ec0 2024-03-18T15:01:05.033 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:05.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.035+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 msgr2=0x7fdce006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.035+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 0x7fdce006e090 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fdcfc0cf6e0 tx=0x7fdcec009040 comp rx=0 tx=0).stop 2024-03-18T15:01:05.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.035+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 msgr2=0x7fdcfc158f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.035+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80098c0 tx=0x7fdcf80046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 shutdown_connections 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdcfc161890 0x7fdcfc14e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdce006bbd0 0x7fdce006e090 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdcfc0d1070 0x7fdcfc0c8eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 --2- 172.21.15.152:0/2248391330 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdcfc0b4ec0 0x7fdcfc158f00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 >> 172.21.15.152:0/2248391330 conn(0x7fdcfc0d4090 msgr2=0x7fdcfc0d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 shutdown_connections 2024-03-18T15:01:05.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.036+0000 7fdd047f1640 1 -- 172.21.15.152:0/2248391330 wait complete. 2024-03-18T15:01:05.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:05.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.150+0000 7ff293285640 1 Processor -- start 2024-03-18T15:01:05.150 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.150+0000 7ff293285640 1 -- start start 2024-03-18T15:01:05.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff293285640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28c0ceee0 0x7ff28c06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff293285640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c06d000 0x7ff28c0d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff293285640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff28c0cf2c0 con 0x7ff28c0d0a80 2024-03-18T15:01:05.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff293285640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff28c161c70 con 0x7ff28c0ceee0 2024-03-18T15:01:05.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff293285640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff28c0d1590 con 0x7ff28c06d000 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28c0ceee0 0x7ff28c06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff28c0ceee0 0x7ff28c06cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59698/0 (socket says 172.21.15.152:59698) 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 -- 172.21.15.152:0/2314126301 learned_addr learned my addr 172.21.15.152:0/2314126301 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff290820640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c06d000 0x7ff28c0d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 -- 172.21.15.152:0/2314126301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c06d000 msgr2=0x7ff28c0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c06d000 0x7ff28c0d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 -- 172.21.15.152:0/2314126301 >> v1:172.21.15.186:6789/0 conn(0x7ff28c0d0a80 legacy=0x7ff28c161e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.151+0000 7ff291021640 1 -- 172.21.15.152:0/2314126301 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c06d440 con 0x7ff28c0ceee0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.152+0000 7ff291021640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0ceee0 0x7ff28c06cac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff288009870 tx=0x7ff28802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2407b3705b386ee server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.152+0000 7ff283fff640 1 -- 172.21.15.152:0/2314126301 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2880317c0 con 0x7ff28c0ceee0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.152+0000 7ff283fff640 1 -- 172.21.15.152:0/2314126301 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff288037070 con 0x7ff28c0ceee0 2024-03-18T15:01:05.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.152+0000 7ff283fff640 1 -- 172.21.15.152:0/2314126301 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff288031b80 con 0x7ff28c0ceee0 2024-03-18T15:01:05.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 -- 172.21.15.152:0/2314126301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0ceee0 msgr2=0x7ff28c06cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0ceee0 0x7ff28c06cac0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff288009870 tx=0x7ff28802b860 comp rx=0 tx=0).stop 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 -- 172.21.15.152:0/2314126301 shutdown_connections 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c06d000 0x7ff28c0d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 --2- 172.21.15.152:0/2314126301 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0ceee0 0x7ff28c06cac0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 -- 172.21.15.152:0/2314126301 >> 172.21.15.152:0/2314126301 conn(0x7ff28c09b160 msgr2=0x7ff28c0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 -- 172.21.15.152:0/2314126301 shutdown_connections 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.153+0000 7ff293285640 1 -- 172.21.15.152:0/2314126301 wait complete. 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.154+0000 7ff293285640 1 Processor -- start 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.154+0000 7ff293285640 1 -- start start 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 0x7ff28c15dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c0ceee0 0x7ff28c09d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c0cc5b0 con 0x7ff28c0d0a80 2024-03-18T15:01:05.157 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff28c0ccc00 con 0x7ff28c06d000 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff293285640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff28c0cc890 con 0x7ff28c0ceee0 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59700/0 (socket says 172.21.15.152:59700) 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 -- 172.21.15.152:0/1205295718 learned_addr learned my addr 172.21.15.152:0/1205295718 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291021640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 0x7ff28c15dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff290820640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c0ceee0 0x7ff28c09d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 -- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c0ceee0 msgr2=0x7ff28c09d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c0ceee0 0x7ff28c09d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 -- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 msgr2=0x7ff28c15dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 0x7ff28c15dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 -- 172.21.15.152:0/1205295718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff28c15dc70 con 0x7ff28c0d0a80 2024-03-18T15:01:05.158 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291021640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 0x7ff28c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.155+0000 7ff291822640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff28400b970 tx=0x7ff28400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.156+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284019070 con 0x7ff28c0d0a80 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.156+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff28400cb40 con 0x7ff28c0d0a80 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.156+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff28c09c6a0 con 0x7ff28c0d0a80 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.156+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff284014440 con 0x7ff28c0d0a80 2024-03-18T15:01:05.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.156+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff28c09cc60 con 0x7ff28c0d0a80 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.157+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff28c04f540 con 0x7ff28c0d0a80 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.158+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff28401c070 con 0x7ff28c0d0a80 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.158+0000 7ff281ffb640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.158+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff28408a680 con 0x7ff28c0d0a80 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.158+0000 7ff291021640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.159+0000 7ff291021640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff288008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.163+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff284059170 con 0x7ff28c0d0a80 2024-03-18T15:01:05.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.457+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7ff28c0cf4b0 con 0x7ff28c0d0a80 2024-03-18T15:01:05.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.458+0000 7ff281ffb640 1 -- 172.21.15.152:0/1205295718 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7ff284058a70 con 0x7ff28c0d0a80 2024-03-18T15:01:05.521 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:05.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.459+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 msgr2=0x7ff27006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.459+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff288036000 tx=0x7ff288008030 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.459+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 msgr2=0x7ff28c15d730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.459+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7ff28400b970 tx=0x7ff28400be30 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 shutdown_connections 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff28c0d0a80 0x7ff28c15d730 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff27006bbd0 0x7ff27006e090 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff28c0ceee0 0x7ff28c09d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 --2- 172.21.15.152:0/1205295718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff28c06d000 0x7ff28c15dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 >> 172.21.15.152:0/1205295718 conn(0x7ff28c09b160 msgr2=0x7ff28c0cd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 shutdown_connections 2024-03-18T15:01:05.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.460+0000 7ff293285640 1 -- 172.21.15.152:0/1205295718 wait complete. 2024-03-18T15:01:05.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:05.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.634+0000 7f418b6b2640 1 Processor -- start 2024-03-18T15:01:05.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.634+0000 7f418b6b2640 1 -- start start 2024-03-18T15:01:05.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418b6b2640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41840b0150 0x7f41840ce970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418b6b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f418406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418b6b2640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4184071ee0 con 0x7f418406b700 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418b6b2640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4184072af0 con 0x7f41840b0150 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418b6b2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f41840721c0 con 0x7f41840ceeb0 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41840b0150 0x7f41840ce970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f4189c4f640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f418406b700 0x7f418406ddc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44054/0 (socket says 172.21.15.152:44054) 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f41840b0150 0x7f41840ce970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59704/0 (socket says 172.21.15.152:59704) 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f4189c4f640 1 -- 172.21.15.152:0/549375109 learned_addr learned my addr 172.21.15.152:0/549375109 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f4188c4d640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f418406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 -- 172.21.15.152:0/549375109 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 msgr2=0x7f418406b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f418406b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 -- 172.21.15.152:0/549375109 >> v1:172.21.15.152:6789/0 conn(0x7f418406b700 legacy=0x7f418406ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f418944e640 1 -- 172.21.15.152:0/549375109 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840724a0 con 0x7f41840b0150 2024-03-18T15:01:05.636 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.635+0000 7f4188c4d640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f418406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:05.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.636+0000 7f418944e640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41840ce970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f41800097a0 tx=0x7f418002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e76e2b2a48e6f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.636+0000 7f417bfff640 1 -- 172.21.15.152:0/549375109 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41800315a0 con 0x7f41840b0150 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.636+0000 7f417bfff640 1 -- 172.21.15.152:0/549375109 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4180037070 con 0x7f41840b0150 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.636+0000 7f417bfff640 1 -- 172.21.15.152:0/549375109 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4180031960 con 0x7f41840b0150 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 -- 172.21.15.152:0/549375109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 msgr2=0x7f41840ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41840ce970 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f41800097a0 tx=0x7f418002b840 comp rx=0 tx=0).stop 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 -- 172.21.15.152:0/549375109 shutdown_connections 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f418406b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 --2- 172.21.15.152:0/549375109 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41840ce970 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 -- 172.21.15.152:0/549375109 >> 172.21.15.152:0/549375109 conn(0x7f41840d0da0 msgr2=0x7f41840d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 -- 172.21.15.152:0/549375109 shutdown_connections 2024-03-18T15:01:05.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.637+0000 7f418b6b2640 1 -- 172.21.15.152:0/549375109 wait complete. 2024-03-18T15:01:05.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.638+0000 7f418b6b2640 1 Processor -- start 2024-03-18T15:01:05.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.638+0000 7f418b6b2640 1 -- start start 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f418406b700 0x7f41841e0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f41841e6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41840b0530 con 0x7f41840b0150 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41840d0900 con 0x7f418406b700 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.639+0000 7f418b6b2640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f41840b06b0 con 0x7f41840ceeb0 2024-03-18T15:01:05.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59712/0 (socket says 172.21.15.152:59712) 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 -- 172.21.15.152:0/1472794286 learned_addr learned my addr 172.21.15.152:0/1472794286 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4189c4f640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f41841e6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f418944e640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f418406b700 0x7f41841e0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 -- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 msgr2=0x7f41841e6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f41841e6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 -- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f418406b700 msgr2=0x7f41841e0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f418406b700 0x7f41841e0210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 -- 172.21.15.152:0/1472794286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41840c6730 con 0x7f41840b0150 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4188c4d640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f417400c7f0 tx=0x7f417400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4174015070 con 0x7f41840b0150 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.640+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41841e7290 con 0x7f41840b0150 2024-03-18T15:01:05.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.641+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41841f4c40 con 0x7f41840b0150 2024-03-18T15:01:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.641+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4174007820 con 0x7f41840b0150 2024-03-18T15:01:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.641+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f417401f060 con 0x7f41840b0150 2024-03-18T15:01:05.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.642+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4164005290 con 0x7f41840b0150 2024-03-18T15:01:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.643+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4174018070 con 0x7f41840b0150 2024-03-18T15:01:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.643+0000 7f4179ffb640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 0x7f416806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.643+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f417408ae70 con 0x7f41840b0150 2024-03-18T15:01:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.643+0000 7f418944e640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 0x7f416806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.644 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.644+0000 7f418944e640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 0x7f416806e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4180036000 tx=0x7f418003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.648+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f41840c6730 con 0x7f41840b0150 2024-03-18T15:01:05.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.826+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f4164005850 con 0x7f41840b0150 2024-03-18T15:01:05.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.826+0000 7f4179ffb640 1 -- 172.21.15.152:0/1472794286 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f4174059290 con 0x7f41840b0150 2024-03-18T15:01:05.827 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 msgr2=0x7f416806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 0x7f416806e090 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4180036000 tx=0x7f418003d040 comp rx=0 tx=0).stop 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 msgr2=0x7f41841f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f417400c7f0 tx=0x7f417400ccb0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 shutdown_connections 2024-03-18T15:01:05.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f416806bbd0 0x7f416806e090 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41840ceeb0 0x7f41841e6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41840b0150 0x7f41841f41c0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 --2- 172.21.15.152:0/1472794286 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f418406b700 0x7f41841e0210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.828+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 >> 172.21.15.152:0/1472794286 conn(0x7f41840d0da0 msgr2=0x7f41841e5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.829+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 shutdown_connections 2024-03-18T15:01:05.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.829+0000 7f418b6b2640 1 -- 172.21.15.152:0/1472794286 wait complete. 2024-03-18T15:01:05.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:05.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.940+0000 7f08ed5d4640 1 Processor -- start 2024-03-18T15:01:05.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.940+0000 7f08ed5d4640 1 -- start start 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08ed5d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08ed5d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f08e80d1190 0x7f08e80d15d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08ed5d4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f08e815f9d0 con 0x7f08e815ec80 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08ed5d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f08e80d1b10 con 0x7f08e80d1190 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08ed5d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f08e80ae9b0 con 0x7f08e81589d0 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08e67fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f08e80d1190 0x7f08e80d15d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08e67fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f08e80d1190 0x7f08e80d15d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59716/0 (socket says 172.21.15.152:59716) 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.941+0000 7f08e67fc640 1 -- 172.21.15.152:0/957930011 learned_addr learned my addr 172.21.15.152:0/957930011 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:05.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e6ffd640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e67fc640 1 -- 172.21.15.152:0/957930011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 msgr2=0x7f08e80af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e67fc640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e67fc640 1 -- 172.21.15.152:0/957930011 >> v1:172.21.15.186:6789/0 conn(0x7f08e815ec80 legacy=0x7f08e815f110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e67fc640 1 -- 172.21.15.152:0/957930011 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e80aec90 con 0x7f08e80d1190 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e6ffd640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.942+0000 7f08e67fc640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e80d1190 0x7f08e80d15d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009870 tx=0x7f08dc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ac815d1410b743 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08e5ffb640 1 -- 172.21.15.152:0/957930011 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc035020 con 0x7f08e80d1190 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08e5ffb640 1 -- 172.21.15.152:0/957930011 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08dc031640 con 0x7f08e80d1190 2024-03-18T15:01:05.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08e5ffb640 1 -- 172.21.15.152:0/957930011 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08dc02d040 con 0x7f08e80d1190 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 -- 172.21.15.152:0/957930011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e80d1190 msgr2=0x7f08e80d15d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e80d1190 0x7f08e80d15d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009870 tx=0x7f08dc02b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 -- 172.21.15.152:0/957930011 shutdown_connections 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e80d1190 0x7f08e80d15d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/957930011 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 -- 172.21.15.152:0/957930011 >> 172.21.15.152:0/957930011 conn(0x7f08e806c4b0 msgr2=0x7f08e806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:05.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 -- 172.21.15.152:0/957930011 shutdown_connections 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.943+0000 7f08ed5d4640 1 -- 172.21.15.152:0/957930011 wait complete. 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 Processor -- start 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 -- start start 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e80d1190 0x7f08e809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f08e8158db0 con 0x7f08e815ec80 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f08e80af250 con 0x7f08e80d1190 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08ed5d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f08e8158f30 con 0x7f08e81589d0 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08e77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59724/0 (socket says 172.21.15.152:59724) 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.945+0000 7f08e77fe640 1 -- 172.21.15.152:0/194854259 learned_addr learned my addr 172.21.15.152:0/194854259 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:05.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e6ffd640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e80d1190 0x7f08e809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e67fc640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 -- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 msgr2=0x7f08e80b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 -- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e80d1190 msgr2=0x7f08e809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e80d1190 0x7f08e809aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 -- 172.21.15.152:0/194854259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08e80b0870 con 0x7f08e815ec80 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08e77fe640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b970 tx=0x7f08e000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0019070 con 0x7f08e815ec80 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f08e000cae0 con 0x7f08e815ec80 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08e80b0b50 con 0x7f08e815ec80 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f08e0014440 con 0x7f08e815ec80 2024-03-18T15:01:05.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.946+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08e80b1110 con 0x7f08e815ec80 2024-03-18T15:01:05.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.947+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f08e001c070 con 0x7f08e815ec80 2024-03-18T15:01:05.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.947+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08e804f5b0 con 0x7f08e815ec80 2024-03-18T15:01:05.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.948+0000 7f08cf7fe640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 0x7f08d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:05.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.948+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f08e008a500 con 0x7f08e815ec80 2024-03-18T15:01:05.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.948+0000 7f08e6ffd640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 0x7f08d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:05.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.948+0000 7f08e6ffd640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 0x7f08d406e090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08e80d1ae0 tx=0x7f08d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:05.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:05.956+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f08e0058a30 con 0x7f08e815ec80 2024-03-18T15:01:06.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.173+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08e8074f00 con 0x7f08e815ec80 2024-03-18T15:01:06.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.173+0000 7f08cf7fe640 1 -- 172.21.15.152:0/194854259 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f08e005cad0 con 0x7f08e815ec80 2024-03-18T15:01:06.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:06.174 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:06.174 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 msgr2=0x7f08d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 0x7f08d406e090 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f08e80d1ae0 tx=0x7f08d8008040 comp rx=0 tx=0).stop 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 msgr2=0x7f08e814ac10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f08e000b970 tx=0x7f08e000be30 comp rx=0 tx=0).stop 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 shutdown_connections 2024-03-18T15:01:06.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f08e815ec80 0x7f08e814ac10 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f08d406bbd0 0x7f08d406e090 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f08e81589d0 0x7f08e80b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 --2- 172.21.15.152:0/194854259 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f08e80d1190 0x7f08e809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.175+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 >> 172.21.15.152:0/194854259 conn(0x7f08e806c4b0 msgr2=0x7f08e806c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.176+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 shutdown_connections 2024-03-18T15:01:06.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.176+0000 7f08ed5d4640 1 -- 172.21.15.152:0/194854259 wait complete. 2024-03-18T15:01:06.187 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:06.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.314+0000 7f3b876d1640 1 Processor -- start 2024-03-18T15:01:06.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.314+0000 7f3b876d1640 1 -- start start 2024-03-18T15:01:06.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.315+0000 7f3b876d1640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3b80154a90 0x7f3b8006cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.315+0000 7f3b876d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.315+0000 7f3b876d1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b8006e6f0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.315+0000 7f3b876d1640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3b8006d650 con 0x7f3b80154a90 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.315+0000 7f3b876d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3b8006d930 con 0x7f3b8006d1b0 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b84c6c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3b80154a90 0x7f3b8006cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b85c6e640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f3b8015e6b0 0x7f3b8015ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:48982/0 (socket says 172.21.15.152:48982) 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3b80154a90 0x7f3b8006cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50780/0 (socket says 172.21.15.152:50780) 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b84c6c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:39202/0 (socket says 172.21.15.152:39202) 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b85c6e640 1 -- 172.21.15.152:0/38415899 learned_addr learned my addr 172.21.15.152:0/38415899 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 -- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 msgr2=0x7f3b8015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 -- 172.21.15.152:0/38415899 >> v1:172.21.15.186:6789/0 conn(0x7f3b8015e6b0 legacy=0x7f3b8015ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b8546d640 1 -- 172.21.15.152:0/38415899 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b8006dc10 con 0x7f3b80154a90 2024-03-18T15:01:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b77fff640 1 -- 172.21.15.152:0/38415899 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1148318539 0 0) 0x7f3b8006e6f0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.316+0000 7f3b84c6c640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.317+0000 7f3b8546d640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b80154a90 0x7f3b8006cc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0097a0 tx=0x7f3b7c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8ec1946c53274fe server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.317+0000 7f3b77fff640 1 -- 172.21.15.152:0/38415899 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c0315a0 con 0x7f3b80154a90 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.317+0000 7f3b77fff640 1 -- 172.21.15.152:0/38415899 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7c037070 con 0x7f3b80154a90 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.317+0000 7f3b77fff640 1 -- 172.21.15.152:0/38415899 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7c031960 con 0x7f3b80154a90 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 -- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b80154a90 msgr2=0x7f3b8006cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b80154a90 0x7f3b8006cc70 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c0097a0 tx=0x7f3b7c02b840 comp rx=0 tx=0).stop 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 -- 172.21.15.152:0/38415899 shutdown_connections 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b8006d1b0 0x7f3b8015e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 --2- 172.21.15.152:0/38415899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b80154a90 0x7f3b8006cc70 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 -- 172.21.15.152:0/38415899 >> 172.21.15.152:0/38415899 conn(0x7f3b8006b5e0 msgr2=0x7f3b8006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 -- 172.21.15.152:0/38415899 shutdown_connections 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.318+0000 7f3b876d1640 1 -- 172.21.15.152:0/38415899 wait complete. 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.319+0000 7f3b876d1640 1 Processor -- start 2024-03-18T15:01:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.319+0000 7f3b876d1640 1 -- start start 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b8006d1b0 0x7f3b8014a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b80154a90 0x7f3b800b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3b80072020 con 0x7f3b8015e6b0 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3b8006e1d0 con 0x7f3b8006d1b0 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b876d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3b80154e70 con 0x7f3b80154a90 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b8546d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b8006d1b0 0x7f3b8014a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59734/0 (socket says 172.21.15.152:59734) 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 -- 172.21.15.152:0/4167962883 learned_addr learned my addr 172.21.15.152:0/4167962883 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b84c6c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b80154a90 0x7f3b800b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 -- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b80154a90 msgr2=0x7f3b800b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b80154a90 0x7f3b800b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 -- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b8006d1b0 msgr2=0x7f3b8014a910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b8006d1b0 0x7f3b8014a910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 -- 172.21.15.152:0/4167962883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b800cd8a0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.320+0000 7f3b85c6e640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c700 tx=0x7f3b7800cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.321+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b78018070 con 0x7f3b8015e6b0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.321+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b7800ce10 con 0x7f3b8015e6b0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.321+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b800cdb80 con 0x7f3b8015e6b0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.321+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b7800a860 con 0x7f3b8015e6b0 2024-03-18T15:01:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.321+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b800ce140 con 0x7f3b8015e6b0 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.322+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3b7801b070 con 0x7f3b8015e6b0 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.322+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b8004f5b0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.323+0000 7f3b75ffb640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 0x7f3b6406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.323+0000 7f3b8546d640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 0x7f3b6406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.323+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3b78089ec0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.323+0000 7f3b8546d640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 0x7f3b6406e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c036000 tx=0x7f3b7c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.327+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3b780583f0 con 0x7f3b8015e6b0 2024-03-18T15:01:06.507 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.506+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3b80159190 con 0x7f3b8015e6b0 2024-03-18T15:01:06.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.508+0000 7f3b75ffb640 1 -- 172.21.15.152:0/4167962883 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f3b7805c490 con 0x7f3b8015e6b0 2024-03-18T15:01:06.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:06.509 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 msgr2=0x7f3b6406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 0x7f3b6406e090 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3b7c036000 tx=0x7f3b7c008030 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 msgr2=0x7f3b800aeb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b7800c700 tx=0x7f3b7800cbc0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 shutdown_connections 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3b8015e6b0 0x7f3b800aeb50 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3b6406bbd0 0x7f3b6406e090 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3b80154a90 0x7f3b800b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 --2- 172.21.15.152:0/4167962883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3b8006d1b0 0x7f3b8014a910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 >> 172.21.15.152:0/4167962883 conn(0x7f3b8006b5e0 msgr2=0x7f3b80159570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 shutdown_connections 2024-03-18T15:01:06.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.510+0000 7f3b876d1640 1 -- 172.21.15.152:0/4167962883 wait complete. 2024-03-18T15:01:06.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:06.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.623+0000 7f595bc0b640 1 Processor -- start 2024-03-18T15:01:06.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.623+0000 7f595bc0b640 1 -- start start 2024-03-18T15:01:06.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.623+0000 7f595bc0b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595bc0b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59540cef80 0x7f59540af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595bc0b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59540cd510 con 0x7f595415c3a0 2024-03-18T15:01:06.625 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595bc0b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f59540cd7f0 con 0x7f59540cef80 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595bc0b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f59540cdad0 con 0x7f595415c780 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59540cef80 0x7f59540af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f59540cef80 0x7f59540af000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59744/0 (socket says 172.21.15.152:59744) 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 -- 172.21.15.152:0/3645518336 learned_addr learned my addr 172.21.15.152:0/3645518336 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f59591a6640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 -- 172.21.15.152:0/3645518336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 msgr2=0x7f59540d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 -- 172.21.15.152:0/3645518336 >> v1:172.21.15.186:6789/0 conn(0x7f595415c3a0 legacy=0x7f59540ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.624+0000 7f595a1a8640 1 -- 172.21.15.152:0/3645518336 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59540cddb0 con 0x7f59540cef80 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.625+0000 7f595a1a8640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59540cef80 0x7f59540af000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f594c009e50 tx=0x7f594c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b06ca06e984c60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.625+0000 7f59589a5640 1 -- 172.21.15.152:0/3645518336 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c02ca70 con 0x7f59540cef80 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.625+0000 7f59589a5640 1 -- 172.21.15.152:0/3645518336 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f594c02cc10 con 0x7f59540cef80 2024-03-18T15:01:06.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.625+0000 7f59589a5640 1 -- 172.21.15.152:0/3645518336 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f594c0343f0 con 0x7f59540cef80 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 -- 172.21.15.152:0/3645518336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59540cef80 msgr2=0x7f59540af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59540cef80 0x7f59540af000 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f594c009e50 tx=0x7f594c02bed0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 -- 172.21.15.152:0/3645518336 shutdown_connections 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f59540cef80 0x7f59540af000 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 --2- 172.21.15.152:0/3645518336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 -- 172.21.15.152:0/3645518336 >> 172.21.15.152:0/3645518336 conn(0x7f59540d1e60 msgr2=0x7f59540d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 -- 172.21.15.152:0/3645518336 shutdown_connections 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.626+0000 7f595bc0b640 1 -- 172.21.15.152:0/3645518336 wait complete. 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.627+0000 7f595bc0b640 1 Processor -- start 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.627+0000 7f595bc0b640 1 -- start start 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 0x7f59541522e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f59540cf590 con 0x7f595415c3a0 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f59540cf410 con 0x7f59540cef80 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f59540af540 con 0x7f595415c780 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59758/0 (socket says 172.21.15.152:59758) 2024-03-18T15:01:06.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 -- 172.21.15.152:0/164835313 learned_addr learned my addr 172.21.15.152:0/164835313 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595a1a8640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59599a7640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 0x7f59541522e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 -- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 msgr2=0x7f59540cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 -- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 msgr2=0x7f59541522e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 0x7f59541522e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 -- 172.21.15.152:0/164835313 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5954152820 con 0x7f595415c3a0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59599a7640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 0x7f59541522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f59591a6640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f594400d5f0 tx=0x7f594400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440125f0 con 0x7f595415c3a0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5944019070 con 0x7f595415c3a0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59540b3af0 con 0x7f595415c3a0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59440129d0 con 0x7f595415c3a0 2024-03-18T15:01:06.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.628+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59540b40b0 con 0x7f595415c3a0 2024-03-18T15:01:06.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.629+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5954069170 con 0x7f595415c3a0 2024-03-18T15:01:06.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.630+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5944012b70 con 0x7f595415c3a0 2024-03-18T15:01:06.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.631+0000 7f594a7fc640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 0x7f593806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:06.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.631+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f594408afa0 con 0x7f595415c3a0 2024-03-18T15:01:06.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.631+0000 7f59599a7640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 0x7f593806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:06.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.631+0000 7f59599a7640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 0x7f593806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5950003eb0 tx=0x7f5950009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:06.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.635+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5954069170 con 0x7f595415c3a0 2024-03-18T15:01:06.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.851+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f595404f5b0 con 0x7f595415c3a0 2024-03-18T15:01:06.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.852+0000 7f594a7fc640 1 -- 172.21.15.152:0/164835313 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f5944059960 con 0x7f595415c3a0 2024-03-18T15:01:06.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:06.852 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:06.853 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:06.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 msgr2=0x7f593806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 0x7f593806e090 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f5950003eb0 tx=0x7f5950009040 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 msgr2=0x7f59540cb100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f594400d5f0 tx=0x7f594400dab0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 shutdown_connections 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f593806bbd0 0x7f593806e090 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f595415c780 0x7f59540cb640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f595415c3a0 0x7f59540cb100 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 --2- 172.21.15.152:0/164835313 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f59540cef80 0x7f59541522e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 >> 172.21.15.152:0/164835313 conn(0x7f59540d1e60 msgr2=0x7f59540ce850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 shutdown_connections 2024-03-18T15:01:06.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:06.854+0000 7f595bc0b640 1 -- 172.21.15.152:0/164835313 wait complete. 2024-03-18T15:01:07.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T15:00:48.942367+0000', 'modified': '2024-03-18T15:00:50.948508+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4290}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4290': {'gid': 4290, 'name': 'c', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/2508554293', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 2508554293}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 2508554293}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4290, 'qdb_cluster': [4290]} 2024-03-18T15:01:07.268 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T15:01:07.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-18T15:01:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 Processor -- start 2024-03-18T15:01:07.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 -- start start 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 0x7fe2b80d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2b815c780 0x7fe2b80ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2b80cd510 con 0x7fe2b80cedb0 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b80cd7f0 con 0x7fe2b815c780 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.370+0000 7fe2befbc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe2b80cdad0 con 0x7fe2b815c3a0 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe2b815c780 0x7fe2b80ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2bd559640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe2b80cedb0 0x7fe2b80cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44056/0 (socket says 172.21.15.152:44056) 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2bd559640 1 -- 172.21.15.152:0/1609191006 learned_addr learned my addr 172.21.15.152:0/1609191006 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b7fff640 1 -- 172.21.15.152:0/1609191006 >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 msgr2=0x7fe2b80d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1609191006 >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 0x7fe2b80d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b77fe640 1 -- 172.21.15.152:0/1609191006 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3120851965 0 0) 0x7fe2b80cd510 con 0x7fe2b80cedb0 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1609191006 >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 0x7fe2b80d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b7fff640 1 -- 172.21.15.152:0/1609191006 >> v1:172.21.15.152:6789/0 conn(0x7fe2b80cedb0 legacy=0x7fe2b80cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2b7fff640 1 -- 172.21.15.152:0/1609191006 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b80cddb0 con 0x7fe2b815c780 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.371+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1609191006 >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 0x7fe2b80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1609191006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b80ce870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80722e0 tx=0x7fe2a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdc6fe43afa6221b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2b77fe640 1 -- 172.21.15.152:0/1609191006 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4035020 con 0x7fe2b815c780 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2b77fe640 1 -- 172.21.15.152:0/1609191006 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2a4031830 con 0x7fe2b815c780 2024-03-18T15:01:07.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2b77fe640 1 -- 172.21.15.152:0/1609191006 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a4031c00 con 0x7fe2b815c780 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 -- 172.21.15.152:0/1609191006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 msgr2=0x7fe2b80ce870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 --2- 172.21.15.152:0/1609191006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b80ce870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe2b80722e0 tx=0x7fe2a402b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 -- 172.21.15.152:0/1609191006 shutdown_connections 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 --2- 172.21.15.152:0/1609191006 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b80ce870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 --2- 172.21.15.152:0/1609191006 >> v2:172.21.15.186:3300/0 conn(0x7fe2b815c3a0 0x7fe2b80d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 -- 172.21.15.152:0/1609191006 >> 172.21.15.152:0/1609191006 conn(0x7fe2b80d1e60 msgr2=0x7fe2b80d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 -- 172.21.15.152:0/1609191006 shutdown_connections 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.372+0000 7fe2befbc640 1 -- 172.21.15.152:0/1609191006 wait complete. 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.373+0000 7fe2befbc640 1 Processor -- start 2024-03-18T15:01:07.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.373+0000 7fe2befbc640 1 -- start start 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2b80cedb0 0x7fe2b81f5ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 0x7fe2b8157bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b80b0190 con 0x7fe2b815c780 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b80b0010 con 0x7fe2b815c3a0 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2befbc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b80b0310 con 0x7fe2b80cedb0 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59762/0 (socket says 172.21.15.152:59762) 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.374+0000 7fe2bd559640 1 -- 172.21.15.152:0/2208359910 learned_addr learned my addr 172.21.15.152:0/2208359910 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 0x7fe2b8157bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2b80cedb0 0x7fe2b81f5ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 -- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2b80cedb0 msgr2=0x7fe2b81f5ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2b80cedb0 0x7fe2b81f5ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 -- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 msgr2=0x7fe2b8157bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 0x7fe2b8157bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 -- 172.21.15.152:0/2208359910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2b81f6410 con 0x7fe2b815c780 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 0x7fe2b8157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2bd559640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c700 tx=0x7fe2b000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2b57fa640 1 -- 172.21.15.152:0/2208359910 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0018070 con 0x7fe2b815c780 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2b57fa640 1 -- 172.21.15.152:0/2208359910 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b000ce10 con 0x7fe2b815c780 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2b81f22b0 con 0x7fe2b815c780 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2b57fa640 1 -- 172.21.15.152:0/2208359910 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b000a860 con 0x7fe2b815c780 2024-03-18T15:01:07.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.375+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2b81f2870 con 0x7fe2b815c780 2024-03-18T15:01:07.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.377+0000 7fe2b57fa640 1 -- 172.21.15.152:0/2208359910 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe2b001b070 con 0x7fe2b815c780 2024-03-18T15:01:07.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.377+0000 7fe2b57fa640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 0x7fe29c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.377+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 0x7fe29c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.377+0000 7fe2b57fa640 1 -- 172.21.15.152:0/2208359910 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2b008a060 con 0x7fe2b815c780 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.378+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 0x7fe29c06e090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00b840 tx=0x7fe2ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.378+0000 7fe2c1b9b740 1 Processor -- start 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.378+0000 7fe2c1b9b740 1 -- start start 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf32ae0 0x55888bee9d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf12040 0x55888beea270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55888be4dc80 con 0x55888bf32700 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55888bdf6aa0 con 0x55888bf32ae0 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55888be49d20 con 0x55888bf12040 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59766/0 (socket says 172.21.15.152:59766) 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 -- 172.21.15.152:0/1947864465 learned_addr learned my addr 172.21.15.152:0/1947864465 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf12040 0x55888beea270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf32ae0 0x55888bee9d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 -- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf12040 msgr2=0x55888beea270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf12040 0x55888beea270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 -- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf32ae0 msgr2=0x55888bee9d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf32ae0 0x55888bee9d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 -- 172.21.15.152:0/1947864465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888be18ff0 con 0x55888bf32700 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.379+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00dbc0 tx=0x7fe2ac010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97ee06f538600ada server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2a27fc640 1 -- 172.21.15.152:0/1947864465 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac019050 con 0x55888bf32700 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2a27fc640 1 -- 172.21.15.152:0/1947864465 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac023070 con 0x55888bf32700 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2a27fc640 1 -- 172.21.15.152:0/1947864465 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2ac012de0 con 0x55888bf32700 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1947864465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 msgr2=0x55888bf303c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00dbc0 tx=0x7fe2ac010000 comp rx=0 tx=0).stop 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1947864465 shutdown_connections 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf12040 0x55888beea270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf32ae0 0x55888bee9d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1947864465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32700 0x55888bf303c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1947864465 >> 172.21.15.152:0/1947864465 conn(0x55888bee6e90 msgr2=0x55888bf2fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1947864465 shutdown_connections 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.380+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1947864465 wait complete. 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.381+0000 7fe2c1b9b740 1 -- start start 2024-03-18T15:01:07.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.381+0000 7fe2c1b9b740 1 Processor -- start 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bf30240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf083c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55888bee54c0 con 0x55888bf32ae0 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55888be09ef0 con 0x55888bf01be0 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55888bee92c0 con 0x55888bf32700 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2c1b9b740 10 client.0 _ll_register_callbacks cb 0x55888be04dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2bcd58640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bf30240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59776/0 (socket says 172.21.15.152:59776) 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 -- 172.21.15.152:0/2485433976 learned_addr learned my addr 172.21.15.152:0/2485433976 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2bd559640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf083c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 -- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 msgr2=0x55888bf30240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bf30240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 -- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 msgr2=0x55888bf083c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf083c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 -- 172.21.15.152:0/2485433976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888be16a30 con 0x55888bf32ae0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402bee0 tx=0x7fe2a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f4b5f20bd78db4c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.382+0000 7fe2977fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a404a060 con 0x55888bf32ae0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2a4031cc0 con 0x55888bf32ae0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2ac023070 con 0x55888bf32ae0 2024-03-18T15:01:07.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe2a4050050 con 0x55888bf32ae0 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 10 client.4731 fetch_fsmap learned FSMap version 6 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55888bb622d0 con 0x55888bf32ae0 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2ac023070 con 0x55888bf32ae0 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7fe2a403b430 con 0x55888bf32ae0 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 10 client.4731 fetch_fsmap finished waiting for FSMap version 6 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 10 client.4731 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 20 client.4731 populate_metadata read hostname 'smithi152' 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf0f440 0x55888bf0f820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 4 client.4731 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 --> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55888be5b1c0 con 0x55888bf0f440 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.383+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf0f440 0x55888bf0f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2977fe640 10 client.4731 ms_handle_connect on v2:172.21.15.152:6835/2508554293 2024-03-18T15:01:07.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf0f440 0x55888bf0f820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6affb0e2c56ebef8 server_cookie=a3fab9abb37f2377 in_seq=0 out_seq=0 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2977fe640 1 -- 172.21.15.152:0/2485433976 <== mds.0 v2:172.21.15.152:6835/2508554293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x55888be5b1c0 con 0x55888bf0f440 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2977fe640 10 client.4731 handle_command_reply: tid=0 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 client.4731 shutdown 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 msgr2=0x55888bf05f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe2a402bee0 tx=0x7fe2a4004730 comp rx=0 tx=0).stop 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 shutdown_connections 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf0f440 0x55888bf0f820 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf083c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2977fe640 0 client.4731 ms_handle_reset on v2:172.21.15.152:6835/2508554293 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf05f90 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/2485433976 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bf30240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 >> 172.21.15.152:0/2485433976 conn(0x55888bf12040 msgr2=0x55888bee3af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.384+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 shutdown_connections 2024-03-18T15:01:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.385+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/2485433976 wait complete. 2024-03-18T15:01:07.392 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.385+0000 7fe2c1b9b740 20 client.4731 trim_cache size 0 max 16384 2024-03-18T15:01:07.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.402+0000 7fe2c1b9b740 1 Processor -- start 2024-03-18T15:01:07.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 -- start start 2024-03-18T15:01:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf4e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888beea6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b815d8d0 con 0x55888bf32ae0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe2b815cc30 con 0x55888bf01be0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe2b815d280 con 0x55888bf32700 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59778/0 (socket says 172.21.15.152:59778) 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2bd559640 1 -- 172.21.15.152:0/1923893348 learned_addr learned my addr 172.21.15.152:0/1923893348 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf4e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.403+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888beea6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 -- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 msgr2=0x55888beea6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888beea6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 -- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 msgr2=0x55888bf4e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf4e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 -- 172.21.15.152:0/1923893348 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55888bc2c6b0 con 0x55888bf32ae0 2024-03-18T15:01:07.406 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf4e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0007fd0 tx=0x7fe2b0054760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e92f11d07dd32a3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2a1ffb640 1 -- 172.21.15.152:0/1923893348 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b00701e0 con 0x55888bf32ae0 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2a1ffb640 1 -- 172.21.15.152:0/1923893348 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b0054a60 con 0x55888bf32ae0 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2a1ffb640 1 -- 172.21.15.152:0/1923893348 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0060890 con 0x55888bf32ae0 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1923893348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 msgr2=0x55888bf06b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0007fd0 tx=0x7fe2b0054760 comp rx=0 tx=0).stop 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1923893348 shutdown_connections 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf06b60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888beea6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1923893348 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bf4e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.404+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1923893348 >> 172.21.15.152:0/1923893348 conn(0x55888bf12040 msgr2=0x55888bf0ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.405+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1923893348 shutdown_connections 2024-03-18T15:01:07.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.405+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1923893348 wait complete. 2024-03-18T15:01:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.405+0000 7fe2c1b9b740 1 -- start start 2024-03-18T15:01:07.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.405+0000 7fe2c1b9b740 1 Processor -- start 2024-03-18T15:01:07.411 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bee9500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bee9a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x55888bf065c0 con 0x55888bf32ae0 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x55888bf30810 con 0x55888bf01be0 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x55888bf47660 con 0x55888bf32700 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2c1b9b740 10 client.0 _ll_register_callbacks cb 0x7fe2a4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59782/0 (socket says 172.21.15.152:59782) 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 -- 172.21.15.152:0/1659495140 learned_addr learned my addr 172.21.15.152:0/1659495140 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bee9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bee9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 -- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 msgr2=0x55888bee9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bee9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 -- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 msgr2=0x55888bee9500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bee9500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2bd559640 1 -- 172.21.15.152:0/1659495140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55888bf06d00 con 0x55888bf32ae0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.406+0000 7fe2b7fff640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bee9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2bd559640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0060cc0 tx=0x7fe2b0088400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319368e2c34930c5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b0075060 con 0x55888bf32ae0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe2b0057a40 con 0x55888bf32ae0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe2b0054a60 con 0x55888bf32ae0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) ==== 24+0+0 (secure 0 0 0) 0x7fe2b0058af0 con 0x55888bf32ae0 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 10 client.4737 fetch_fsmap learned FSMap version 6 2024-03-18T15:01:07.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) -- 0x55888bf31700 con 0x55888bf32ae0 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2b0054a60 con 0x55888bf32ae0 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 6) ==== 3494+0+0 (secure 0 0 0) 0x7fe2b0054140 con 0x55888bf32ae0 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 10 client.4737 fetch_fsmap finished waiting for FSMap version 6 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 10 client.4737 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 20 client.4737 populate_metadata read hostname 'smithi152' 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf30ed0 0x55888bf00500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 4 client.4737 mds_command: new command op to 4290 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 --> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] -- command(tid 0: {"prefix": "status"}) -- 0x55888bf11620 con 0x55888bf30ed0 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.407+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf30ed0 0x55888bf00500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2977fe640 10 client.4737 ms_handle_connect on v2:172.21.15.152:6835/2508554293 2024-03-18T15:01:07.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2bcd58640 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf30ed0 0x55888bf00500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2231cd055e777a0 server_cookie=73b0648eb473fd40 in_seq=0 out_seq=0 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2977fe640 1 -- 172.21.15.152:0/1659495140 <== mds.0 v2:172.21.15.152:6835/2508554293 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55888bf11620 con 0x55888bf30ed0 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2977fe640 10 client.4737 handle_command_reply: tid=0 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 client.4737 shutdown 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 msgr2=0x55888bf30990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe2b0060cc0 tx=0x7fe2b0088400 comp rx=0 tx=0).stop 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 shutdown_connections 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x55888bf32ae0 0x55888bf30990 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x55888bf32700 0x55888bee9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.152:6835/2508554293,v1:172.21.15.152:6837/2508554293] conn(0x55888bf30ed0 0x55888bf00500 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 --2- 172.21.15.152:0/1659495140 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x55888bf01be0 0x55888bee9500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 >> 172.21.15.152:0/1659495140 conn(0x55888bf12040 msgr2=0x55888bf0ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2977fe640 0 client.4737 ms_handle_reset on v2:172.21.15.152:6835/2508554293 2024-03-18T15:01:07.415 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 shutdown_connections 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 1 -- 172.21.15.152:0/1659495140 wait complete. 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.408+0000 7fe2c1b9b740 20 client.4737 trim_cache size 0 max 16384 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "ee22e391-802c-4342-9093-15071cbd8b50", 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 4290, 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-03-18T15:01:07.416 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 17.823295623, 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 6, 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 22, 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 22, 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 25.233942158000001 2024-03-18T15:01:07.417 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 msgr2=0x7fe29c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 0x7fe29c06e090 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac00b840 tx=0x7fe2ac008040 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 msgr2=0x7fe2b8158eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe2b000c700 tx=0x7fe2b000cbc0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 shutdown_connections 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe2b815c780 0x7fe2b8158eb0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe2b815c3a0 0x7fe2b8157bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe29c06bbd0 0x7fe29c06e090 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 --2- 172.21.15.152:0/2208359910 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe2b80cedb0 0x7fe2b81f5ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 >> 172.21.15.152:0/2208359910 conn(0x7fe2b80d1e60 msgr2=0x7fe2b80b0490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 shutdown_connections 2024-03-18T15:01:07.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.409+0000 7fe2befbc640 1 -- 172.21.15.152:0/2208359910 wait complete. 2024-03-18T15:01:07.420 INFO:teuthology.run_tasks:Running task kclient... 2024-03-18T15:01:07.449 INFO:tasks.kclient:Mounting kernel clients... 2024-03-18T15:01:07.449 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-03-18T15:01:07.449 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.449 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T15:01:07.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-03-18T15:01:07.533 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-03-18T15:01:07.534 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T15:01:07.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.535 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T15:01:07.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.591 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-03-18T15:01:07.661 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-03-18T15:01:07.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T15:01:07.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.663 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T15:01:07.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.683 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-03-18T15:01:07.758 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-03-18T15:01:07.759 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T15:01:07.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.760 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T15:01:07.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:07.817 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-03-18T15:01:07.888 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-03-18T15:01:07.889 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T15:01:07.889 INFO:tasks.kclient:client.0 config is {'syntax': 'v2'} 2024-03-18T15:01:07.889 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T15:01:07.890 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:07.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T15:01:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.991+0000 7efdd5612640 1 Processor -- start 2024-03-18T15:01:07.991 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.991+0000 7efdd5612640 1 -- start start 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdd5612640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efdd006fab0 0x7efdd006fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdd5612640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd00d0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdd5612640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efdd00b1750 con 0x7efdd00d1300 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdd5612640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7efdd01629b0 con 0x7efdd006fab0 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdd5612640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efdd0162ee0 con 0x7efdd006f2b0 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efdd006fab0 0x7efdd006fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7efdd006fab0 0x7efdd006fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59792/0 (socket says 172.21.15.152:59792) 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 -- 172.21.15.152:0/926400470 learned_addr learned my addr 172.21.15.152:0/926400470 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdc7fff640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd00d0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 -- 172.21.15.152:0/926400470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 msgr2=0x7efdd00d0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd00d0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 -- 172.21.15.152:0/926400470 >> v1:172.21.15.186:6789/0 conn(0x7efdd00d1300 legacy=0x7efdd00cc530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdceffd640 1 -- 172.21.15.152:0/926400470 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd00703d0 con 0x7efdd006fab0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.992+0000 7efdc7fff640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd00d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdceffd640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd006fab0 0x7efdd006fe90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009870 tx=0x7efdc002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af03919cea8e2f18 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdce7fc640 1 -- 172.21.15.152:0/926400470 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc0035020 con 0x7efdd006fab0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdce7fc640 1 -- 172.21.15.152:0/926400470 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc0031640 con 0x7efdd006fab0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdce7fc640 1 -- 172.21.15.152:0/926400470 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc002d040 con 0x7efdd006fab0 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdd5612640 1 -- 172.21.15.152:0/926400470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd006fab0 msgr2=0x7efdd006fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdd5612640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd006fab0 0x7efdd006fe90 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7efdc0009870 tx=0x7efdc002b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdd5612640 1 -- 172.21.15.152:0/926400470 shutdown_connections 2024-03-18T15:01:07.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdd5612640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd00d0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.993+0000 7efdd5612640 1 --2- 172.21.15.152:0/926400470 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd006fab0 0x7efdd006fe90 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:07.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.994+0000 7efdd5612640 1 -- 172.21.15.152:0/926400470 >> 172.21.15.152:0/926400470 conn(0x7efdd00d1ee0 msgr2=0x7efdd00d22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:07.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.994+0000 7efdd5612640 1 -- 172.21.15.152:0/926400470 shutdown_connections 2024-03-18T15:01:07.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.994+0000 7efdd5612640 1 -- 172.21.15.152:0/926400470 wait complete. 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 Processor -- start 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 -- start start 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdd006fab0 0x7efdd0153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efdd00d02e0 con 0x7efdd01f7a90 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efdd0161d70 con 0x7efdd006fab0 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdd5612640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efdd00d05c0 con 0x7efdd006f2b0 2024-03-18T15:01:07.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.995+0000 7efdcf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59800/0 (socket says 172.21.15.152:59800) 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 -- 172.21.15.152:0/2228026541 learned_addr learned my addr 172.21.15.152:0/2228026541 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdc7fff640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdd006fab0 0x7efdd0153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdceffd640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 -- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 msgr2=0x7efdd015a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd015a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 -- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdd006fab0 msgr2=0x7efdd0153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdd006fab0 0x7efdd0153ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 -- 172.21.15.152:0/2228026541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efdd015ab00 con 0x7efdd01f7a90 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdceffd640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdcf7fe640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c730 tx=0x7efdc800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:08.000 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc8016020 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efdc800aa50 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdc800ce40 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efdd015ade0 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.996+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efdd0155c20 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.997+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efdd004f5b0 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.998+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7efdc8019020 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.998+0000 7efdc77fe640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 0x7efdb006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.998+0000 7efdceffd640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 0x7efdb006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.998+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7efdc808a9e0 con 0x7efdd01f7a90 2024-03-18T15:01:08.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:07.999+0000 7efdceffd640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 0x7efdb006e0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efdc0036000 tx=0x7efdc0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:08.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.003+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7efdc8020030 con 0x7efdd01f7a90 2024-03-18T15:01:08.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.221+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7efdd006f890 con 0x7efdd01f7a90 2024-03-18T15:01:08.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.221+0000 7efdc77fe640 1 -- 172.21.15.152:0/2228026541 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7efdc80182c0 con 0x7efdd01f7a90 2024-03-18T15:01:08.222 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 msgr2=0x7efdb006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 0x7efdb006e0c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7efdc0036000 tx=0x7efdc0008030 comp rx=0 tx=0).stop 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 msgr2=0x7efdd01f7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7efdc800c730 tx=0x7efdc800cbf0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 shutdown_connections 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efdd01f7a90 0x7efdd01f7ee0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efdd006fab0 0x7efdd0153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efdb006bc00 0x7efdb006e0c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 --2- 172.21.15.152:0/2228026541 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efdd006f2b0 0x7efdd015a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 >> 172.21.15.152:0/2228026541 conn(0x7efdd00d1ee0 msgr2=0x7efdd00b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 shutdown_connections 2024-03-18T15:01:08.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08.223+0000 7efdd5612640 1 -- 172.21.15.152:0/2228026541 wait complete. 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T15:01:08.235 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T15:01:08.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:08.236 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:08.252 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42741sec preferred_lft 42741sec 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-03-18T15:01:08.253 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:08.254 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T15:01:08.254 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:08.254 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:08.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add name ceph-brx type bridge 2024-03-18T15:01:08.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr flush dev ceph-brx 2024-03-18T15:01:08.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set ceph-brx up 2024-03-18T15:01:08.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T15:01:08.255 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:08.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:08.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:08.460 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:08.460 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T15:01:08.488 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-03-18T15:01:08.489 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:08.489 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-03-18T15:01:08.558 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-03-18T15:01:08.559 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T15:01:08.559 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T15:01:08.559 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T15:01:08.559 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T15:01:08.559 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:08.559 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:08.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T15:01:08.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T15:01:08.560 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T15:01:08.560 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:08.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:08.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:08.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:08.847 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T15:01:08.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:08.863 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-03-18T15:01:08.917 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:08.917 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:08.917 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T15:01:08.917 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-18T15:01:08.917 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:09.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:09.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.043 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-18T15:01:09.043 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:09.043 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-18T15:01:09.044 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:09.091 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:09.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.182 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:09.182 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:09.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-03-18T15:01:09.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T15:01:09.182 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:09.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:09.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.265 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:09.265 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:09.291 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-18T15:01:09.291 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:09.291 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:09.346 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-18T15:01:09.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:09.346 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:09.431 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:09.431 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-03-18T15:01:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 0@ee22e391-802c-4342-9093-15071cbd8b50.cephfs=/ 2024-03-18T15:01:09.545 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.152:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-03-18T15:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-18T15:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-03-18T15:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T15:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T15:01:09.546 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T15:01:09.548 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T15:01:09.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:09.548 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:09.577 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:09.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:09.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.684 INFO:teuthology.orchestra.run.smithi152.stdout:client4466 2024-03-18T15:01:09.684 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:09.684 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:09.699 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:09.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:09.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.800 INFO:teuthology.orchestra.run.smithi152.stdout:client4466 2024-03-18T15:01:09.800 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:09.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:09.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.861 INFO:teuthology.orchestra.run.smithi152.stdout:client4466 2024-03-18T15:01:09.861 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ee22e391-802c-4342-9093-15071cbd8b50.client4466/status') 2024-03-18T15:01:09.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:09.925 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4466 (3)172.21.15.152:0/3245247891 2024-03-18T15:01:09.925 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-03-18T15:01:09.925 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-03-18T15:01:09.926 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-03-18T15:01:09.926 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 2.1415e-05 s, 3.3 MB/s 2024-03-18T15:01:09.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:09 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:09.932 INFO:tasks.kclient:client.2 config is {'syntax': 'v2'} 2024-03-18T15:01:09.932 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T15:01:09.933 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-18T15:01:09.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T15:01:10.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.033+0000 7f364b4a1640 1 Processor -- start 2024-03-18T15:01:10.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.033+0000 7f364b4a1640 1 -- start start 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f364b4a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f36440d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f364b4a1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36440cd510 con 0x7f36440cef80 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f364b4a1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36440cd7f0 con 0x7f364415c780 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f364b4a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f36440cdad0 con 0x7f364415c3a0 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f3649a3e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f36440cef80 0x7f36440af000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:44064/0 (socket says 172.21.15.152:44064) 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f3649a3e640 1 -- 172.21.15.152:0/2758399714 learned_addr learned my addr 172.21.15.152:0/2758399714 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f364923d640 1 --2- 172.21.15.152:0/2758399714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f36440d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.034+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1825488156 0 0) 0x7f36440cd510 con 0x7f36440cef80 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3630003520 con 0x7f36440cef80 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443093075 0 0) 0x7f36440cd7f0 con 0x7f364415c780 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f36440cd510 con 0x7f364415c780 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f364923d640 1 -- 172.21.15.152:0/2758399714 >> v1:172.21.15.186:6789/0 conn(0x7f364415c780 legacy=0x7f36440ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.036 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f364923d640 1 -- 172.21.15.152:0/2758399714 >> v1:172.21.15.152:6789/0 conn(0x7f36440cef80 legacy=0x7f36440af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f364923d640 1 -- 172.21.15.152:0/2758399714 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36440cddb0 con 0x7f364415c3a0 2024-03-18T15:01:10.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.035+0000 7f364923d640 1 --2- 172.21.15.152:0/2758399714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f36440d2980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364002bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dcb32af3fac8b967 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:10.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640039070 con 0x7f364415c3a0 2024-03-18T15:01:10.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f364002ccd0 con 0x7f364415c3a0 2024-03-18T15:01:10.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f363bfff640 1 -- 172.21.15.152:0/2758399714 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640034640 con 0x7f364415c3a0 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 -- 172.21.15.152:0/2758399714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 msgr2=0x7f36440d2980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 --2- 172.21.15.152:0/2758399714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f36440d2980 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f3640009dc0 tx=0x7f364002bf20 comp rx=0 tx=0).stop 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 -- 172.21.15.152:0/2758399714 shutdown_connections 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 --2- 172.21.15.152:0/2758399714 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f36440d2980 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 -- 172.21.15.152:0/2758399714 >> 172.21.15.152:0/2758399714 conn(0x7f36440d1e60 msgr2=0x7f36440d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 -- 172.21.15.152:0/2758399714 shutdown_connections 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.036+0000 7f364b4a1640 1 -- 172.21.15.152:0/2758399714 wait complete. 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.037+0000 7f364b4a1640 1 Processor -- start 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.037+0000 7f364b4a1640 1 -- start start 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:10.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f3644070280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f364415c780 0x7f36440b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36440cf590 con 0x7f36440cef80 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f36440cf410 con 0x7f364415c780 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364b4a1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f36440af710 con 0x7f364415c3a0 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364923d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364923d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:59814/0 (socket says 172.21.15.152:59814) 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364923d640 1 -- 172.21.15.152:0/1181056641 learned_addr learned my addr 172.21.15.152:0/1181056641 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f3648a3c640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f3644070280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f3649a3e640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f364415c780 0x7f36440b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.038+0000 7f364923d640 1 -- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 msgr2=0x7f3644070280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364923d640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f3644070280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364923d640 1 -- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f364415c780 msgr2=0x7f36440b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364923d640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f364415c780 0x7f36440b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364923d640 1 -- 172.21.15.152:0/1181056641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36440afb40 con 0x7f36440cef80 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364923d640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f3640004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640039050 con 0x7f36440cef80 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3640045070 con 0x7f36440cef80 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f364415b480 con 0x7f36440cef80 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3640009450 con 0x7f36440cef80 2024-03-18T15:01:10.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.039+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36440b00c0 con 0x7f36440cef80 2024-03-18T15:01:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.040+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f364404f5b0 con 0x7f36440cef80 2024-03-18T15:01:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.041+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f364003e830 con 0x7f36440cef80 2024-03-18T15:01:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.041+0000 7f3639ffb640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 0x7f362806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:10.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.041+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f36400ad600 con 0x7f36440cef80 2024-03-18T15:01:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.041+0000 7f3648a3c640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 0x7f362806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:10.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.042+0000 7f3648a3c640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 0x7f362806e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3634007fd0 tx=0x7f3634009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:10.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.050+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f364007bc80 con 0x7f36440cef80 2024-03-18T15:01:10.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.266+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f36440d27d0 con 0x7f36440cef80 2024-03-18T15:01:10.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.266+0000 7f3639ffb640 1 -- 172.21.15.152:0/1181056641 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7f364007fd20 con 0x7f36440cef80 2024-03-18T15:01:10.266 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 msgr2=0x7f362806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 0x7f362806e090 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3634007fd0 tx=0x7f3634009040 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 msgr2=0x7f36441f4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f3640000f80 tx=0x7f3640004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 shutdown_connections 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f364415c780 0x7f36440b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f362806bbd0 0x7f362806e090 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f364415c3a0 0x7f3644070280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 --2- 172.21.15.152:0/1181056641 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36440cef80 0x7f36441f4a90 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 >> 172.21.15.152:0/1181056641 conn(0x7f36440d1e60 msgr2=0x7f36440c7f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:10.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 shutdown_connections 2024-03-18T15:01:10.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10.268+0000 7f364b4a1640 1 -- 172.21.15.152:0/1181056641 wait complete. 2024-03-18T15:01:10.279 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T15:01:10.279 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T15:01:10.279 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-03-18T15:01:10.279 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-03-18T15:01:10.279 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-03-18T15:01:10.280 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T15:01:10.280 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T15:01:10.280 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T15:01:10.280 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-03-18T15:01:10.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.280 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-03-18T15:01:10.295 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42739sec preferred_lft 42739sec 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 3a:62:17:c1:f2:1d brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.296 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::b4fa:27ff:fee1:15eb/64 scope link 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run.smithi152.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 3a:62:17:c1:f2:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::3862:17ff:fec1:f21d/64 scope link tentative 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.297 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T15:01:10.360 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-03-18T15:01:10.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.361 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-03-18T15:01:10.417 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-03-18T15:01:10.417 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T15:01:10.417 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T15:01:10.417 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T15:01:10.417 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T15:01:10.417 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:10.418 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:10.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T15:01:10.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T15:01:10.418 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T15:01:10.418 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:10.505 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:10.547 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:10.553 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.554 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T15:01:10.568 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T15:01:10.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.569 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list-id 2024-03-18T15:01:10.625 INFO:teuthology.orchestra.run.smithi152.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-03-18T15:01:10.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:10.625 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:10.625 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T15:01:10.626 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-03-18T15:01:10.626 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:10.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:10.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:10.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-18T15:01:10.775 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.776 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether e6:78:5a:8e:23:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T15:01:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T15:01:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::e478:5aff:fe8e:2347/64 scope link tentative 2024-03-18T15:01:10.777 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:10.778 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether e6:78:5a:8e:23:47 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T15:01:10.845 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.846 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::e478:5aff:fe8e:2347/64 scope link tentative 2024-03-18T15:01:10.846 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:10.847 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-03-18T15:01:10.847 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:10.935 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:11.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.012 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:11.012 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:11.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.1 up 2024-03-18T15:01:11.012 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set dev brx.1 master ceph-brx 2024-03-18T15:01:11.012 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:11.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:11.092 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.098 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:11.098 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-03-18T15:01:11.113 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-03-18T15:01:11.113 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:11.113 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-03-18T15:01:11.167 INFO:tasks.cephfs.kernel_mount:mounting using device: 2@.cephfs=/ 2024-03-18T15:01:11.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:11.167 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 2@.cephfs=/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:11.252 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:11.252 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:11.263 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:11.263 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:11.263 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-03-18T15:01:11.263 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 2@ee22e391-802c-4342-9093-15071cbd8b50.cephfs=/ 2024-03-18T15:01:11.263 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,ms_mode=prefer-crc,key=2,mon_addr=172.21.15.152:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-03-18T15:01:11.264 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2024-03-18T15:01:11.264 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-03-18T15:01:11.264 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T15:01:11.264 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T15:01:11.265 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T15:01:11.266 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T15:01:11.266 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:11.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-03-18T15:01:11.293 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:11.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:11.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.407 INFO:teuthology.orchestra.run.smithi152.stdout:client4567 2024-03-18T15:01:11.407 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:11.407 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:11.422 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:11.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:11.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.519 INFO:teuthology.orchestra.run.smithi152.stdout:client4567 2024-03-18T15:01:11.520 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:11.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:11.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.575 INFO:teuthology.orchestra.run.smithi152.stdout:client4567 2024-03-18T15:01:11.575 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.2 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ee22e391-802c-4342-9093-15071cbd8b50.client4567/status') 2024-03-18T15:01:11.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:11.636 INFO:teuthology.orchestra.run.smithi152.stdout:instance: client.4567 (3)172.21.15.152:0/1616739893 2024-03-18T15:01:11.636 INFO:teuthology.orchestra.run.smithi152.stdout:blocklisted: false 2024-03-18T15:01:11.636 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records in 2024-03-18T15:01:11.636 INFO:teuthology.orchestra.run.smithi152.stderr:0+1 records out 2024-03-18T15:01:11.636 INFO:teuthology.orchestra.run.smithi152.stderr:71 bytes copied, 1.9652e-05 s, 3.6 MB/s 2024-03-18T15:01:11.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:11.643 INFO:tasks.kclient:client.1 config is {'syntax': 'v2'} 2024-03-18T15:01:11.643 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T15:01:11.643 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T15:01:11.643 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T15:01:11.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.746+0000 7fbaf85d4640 1 Processor -- start 2024-03-18T15:01:11.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.746+0000 7fbaf85d4640 1 -- start start 2024-03-18T15:01:11.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf85d4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fbaf00d10d0 0x7fbaf0162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf85d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbaf015ea90 0x7fbaf015eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf85d4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbaf00b3440 con 0x7fbaf01622b0 2024-03-18T15:01:11.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf85d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf00d16c0 con 0x7fbaf015ea90 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf85d4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fbaf00d2660 con 0x7fbaf00d10d0 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf6b71640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbaf015ea90 0x7fbaf015eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf6b71640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbaf015ea90 0x7fbaf015eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34688/0 (socket says 172.21.15.152:34688) 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.747+0000 7fbaf6b71640 1 -- 172.21.15.152:0/757562459 learned_addr learned my addr 172.21.15.152:0/757562459 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf5b6f640 1 --2- 172.21.15.152:0/757562459 >> v2:172.21.15.186:3300/0 conn(0x7fbaf00d10d0 0x7fbaf0162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf6b71640 1 -- 172.21.15.152:0/757562459 >> v2:172.21.15.186:3300/0 conn(0x7fbaf00d10d0 msgr2=0x7fbaf0162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf6b71640 1 --2- 172.21.15.152:0/757562459 >> v2:172.21.15.186:3300/0 conn(0x7fbaf00d10d0 0x7fbaf0162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf6b71640 1 -- 172.21.15.152:0/757562459 >> v1:172.21.15.186:6789/0 conn(0x7fbaf01622b0 legacy=0x7fbaf0162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf6b71640 1 -- 172.21.15.152:0/757562459 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf00d20a0 con 0x7fbaf015ea90 2024-03-18T15:01:11.749 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.748+0000 7fbaf6b71640 1 --2- 172.21.15.152:0/757562459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf015ea90 0x7fbaf015eee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec02bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93f7e4a39faa2515 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf536e640 1 -- 172.21.15.152:0/757562459 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec02c960 con 0x7fbaf015ea90 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf536e640 1 -- 172.21.15.152:0/757562459 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec02cb00 con 0x7fbaf015ea90 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf536e640 1 -- 172.21.15.152:0/757562459 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec0343f0 con 0x7fbaf015ea90 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 -- 172.21.15.152:0/757562459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf015ea90 msgr2=0x7fbaf015eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/757562459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf015ea90 0x7fbaf015eee0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec02bdc0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 -- 172.21.15.152:0/757562459 shutdown_connections 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/757562459 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf015ea90 0x7fbaf015eee0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/757562459 >> v2:172.21.15.186:3300/0 conn(0x7fbaf00d10d0 0x7fbaf0162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 -- 172.21.15.152:0/757562459 >> 172.21.15.152:0/757562459 conn(0x7fbaf00d4070 msgr2=0x7fbaf00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:11.751 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 -- 172.21.15.152:0/757562459 shutdown_connections 2024-03-18T15:01:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.749+0000 7fbaf85d4640 1 -- 172.21.15.152:0/757562459 wait complete. 2024-03-18T15:01:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.750+0000 7fbaf85d4640 1 Processor -- start 2024-03-18T15:01:11.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.750+0000 7fbaf85d4640 1 -- start start 2024-03-18T15:01:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf00d10d0 0x7fbaf0158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf015ea90 0x7fbaf01589b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.754 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf00cfc90 con 0x7fbaf01622b0 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbaf00d2ab0 con 0x7fbaf015ea90 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf85d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbaf00cfe10 con 0x7fbaf00d10d0 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf6b71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf6b71640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34692/0 (socket says 172.21.15.152:34692) 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf6b71640 1 -- 172.21.15.152:0/772027744 learned_addr learned my addr 172.21.15.152:0/772027744 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf5b6f640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf015ea90 0x7fbaf01589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.751+0000 7fbaf6370640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf00d10d0 0x7fbaf0158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 -- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf00d10d0 msgr2=0x7fbaf0158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf00d10d0 0x7fbaf0158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 -- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf015ea90 msgr2=0x7fbaf01589b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf015ea90 0x7fbaf01589b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:11.755 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 -- 172.21.15.152:0/772027744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbaf01f46b0 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf6b71640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec043020 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbaec03e450 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbaf01f4920 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbaec03e820 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.752+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbaf01f4ee0 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.753+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbaf004f5b0 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.753+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fbaec046020 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.754+0000 7fbae6ffd640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 0x7fbad406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.754+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fbaec0ad2b0 con 0x7fbaf01622b0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.754+0000 7fbaf6370640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 0x7fbad406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:11.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.754+0000 7fbaf6370640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 0x7fbad406e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbae8004f60 tx=0x7fbae8007e30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:11.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:11.758+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fbaec04d030 con 0x7fbaf01622b0 2024-03-18T15:01:12.147 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.147+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fbaf00d18d0 con 0x7fbaf01622b0 2024-03-18T15:01:12.148 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.147+0000 7fbae6ffd640 1 -- 172.21.15.152:0/772027744 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7fbaec07b6c0 con 0x7fbaf01622b0 2024-03-18T15:01:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 msgr2=0x7fbad406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 0x7fbad406e090 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbae8004f60 tx=0x7fbae8007e30 comp rx=0 tx=0).stop 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 msgr2=0x7fbaf00b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fbaec009e50 tx=0x7fbaec004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 shutdown_connections 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbaf01622b0 0x7fbaf00b4bb0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbaf015ea90 0x7fbaf01589b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbad406bbd0 0x7fbad406e090 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:12.151 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 --2- 172.21.15.152:0/772027744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbaf00d10d0 0x7fbaf0158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 >> 172.21.15.152:0/772027744 conn(0x7fbaf00d4070 msgr2=0x7fbaf006c830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 shutdown_connections 2024-03-18T15:01:12.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:12.150+0000 7fbaf85d4640 1 -- 172.21.15.152:0/772027744 wait complete. 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T15:01:12.165 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-18T15:01:12.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:12.166 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:12.185 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42735sec preferred_lft 42735sec 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::ec4:7aff:fe88:6df5/64 scope link 2024-03-18T15:01:12.186 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:12.187 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add name ceph-brx type bridge 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr flush dev ceph-brx 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set ceph-brx up 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-18T15:01:12.187 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:12.281 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:12.502 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:01:12.505 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:01:12.627 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:12.633 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:12.633 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T15:01:12.661 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-03-18T15:01:12.663 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:12.663 DEBUG:teuthology.orchestra.run.smithi186:> route 2024-03-18T15:01:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2024-03-18T15:01:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T15:01:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T15:01:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T15:01:12.729 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T15:01:12.730 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:12.817 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:12 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:13.023 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:13.029 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T15:01:13.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:13.044 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2024-03-18T15:01:13.098 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:13.098 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:13.098 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T15:01:13.098 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-18T15:01:13.098 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:13.186 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:13.214 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.220 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-18T15:01:13.220 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:13.220 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:13.220 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-18T15:01:13.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-18T15:01:13.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-18T15:01:13.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-18T15:01:13.221 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-18T15:01:13.221 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:13.269 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:13.353 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.360 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:13.360 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:13.361 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.0 up 2024-03-18T15:01:13.361 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.0 master ceph-brx 2024-03-18T15:01:13.361 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:13.410 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:13.437 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.443 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:13.444 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-18T15:01:13.458 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-18T15:01:13.459 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:13.459 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-18T15:01:13.513 INFO:tasks.cephfs.kernel_mount:mounting using device: 1@.cephfs=/ 2024-03-18T15:01:13.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:13.513 DEBUG:teuthology.orchestra.run.smithi186:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 1@.cephfs=/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:13.599 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:13.600 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:13.715 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:13.715 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:13.715 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: trying mount with new device syntax: 1@ee22e391-802c-4342-9093-15071cbd8b50.cephfs=/ 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,ms_mode=prefer-crc,key=1,mon_addr=172.21.15.152:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout: You just mounted a file system that supports labels which does not 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T15:01:13.716 INFO:teuthology.orchestra.run.smithi186.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T15:01:13.717 INFO:teuthology.orchestra.run.smithi186.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T15:01:13.718 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T15:01:13.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:13.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-18T15:01:13.786 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:13.875 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:13.877 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.882 INFO:teuthology.orchestra.run.smithi186.stdout:client4576 2024-03-18T15:01:13.882 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:13.883 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:13.898 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:13.985 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:13.987 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:13.993 INFO:teuthology.orchestra.run.smithi186.stdout:client4576 2024-03-18T15:01:13.993 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:14.041 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:14.043 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:14.048 INFO:teuthology.orchestra.run.smithi186.stdout:client4576 2024-03-18T15:01:14.049 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ee22e391-802c-4342-9093-15071cbd8b50.client4576/status') 2024-03-18T15:01:14.096 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:14.109 INFO:teuthology.orchestra.run.smithi186.stdout:instance: client.4576 (3)192.168.0.1:0/957649033 2024-03-18T15:01:14.110 INFO:teuthology.orchestra.run.smithi186.stdout:blocklisted: false 2024-03-18T15:01:14.110 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2024-03-18T15:01:14.110 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2024-03-18T15:01:14.110 INFO:teuthology.orchestra.run.smithi186.stderr:68 bytes copied, 2.1276e-05 s, 3.2 MB/s 2024-03-18T15:01:14.110 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:14.116 INFO:tasks.kclient:client.3 config is {'syntax': 'v2'} 2024-03-18T15:01:14.117 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-18T15:01:14.117 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-18T15:01:14.117 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T15:01:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.231+0000 7feece263640 1 Processor -- start 2024-03-18T15:01:14.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feece263640 1 -- start start 2024-03-18T15:01:14.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feece263640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7feec8162da0 0x7feec815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:14.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feece263640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec80b3440 con 0x7feec81622b0 2024-03-18T15:01:14.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feece263640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feec80d20a0 con 0x7feec80d10d0 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feece263640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7feec80d16c0 con 0x7feec8162da0 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.232+0000 7feec7fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7feec81622b0 0x7feec8162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37346/0 (socket says 172.21.15.152:37346) 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feec7fff640 1 -- 172.21.15.152:0/3930493187 learned_addr learned my addr 172.21.15.152:0/3930493187 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feecc800640 1 --2- 172.21.15.152:0/3930493187 >> v2:172.21.15.186:3300/0 conn(0x7feec8162da0 0x7feec815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feec6ffd640 1 -- 172.21.15.152:0/3930493187 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1879411265 0 0) 0x7feec80b3440 con 0x7feec81622b0 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feec6ffd640 1 -- 172.21.15.152:0/3930493187 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feeb0003520 con 0x7feec81622b0 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feecc800640 1 -- 172.21.15.152:0/3930493187 >> v1:172.21.15.186:6789/0 conn(0x7feec80d10d0 legacy=0x7feec815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feecc800640 1 -- 172.21.15.152:0/3930493187 >> v1:172.21.15.152:6789/0 conn(0x7feec81622b0 legacy=0x7feec8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.233+0000 7feecc800640 1 -- 172.21.15.152:0/3930493187 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80d2380 con 0x7feec8162da0 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.234+0000 7feecc800640 1 --2- 172.21.15.152:0/3930493187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec815f1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feec0009dc0 tx=0x7feec002be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea75aadafc7536f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.234+0000 7feec6ffd640 1 -- 172.21.15.152:0/3930493187 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0039070 con 0x7feec8162da0 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.234+0000 7feec6ffd640 1 -- 172.21.15.152:0/3930493187 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec002cbb0 con 0x7feec8162da0 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.234+0000 7feec6ffd640 1 -- 172.21.15.152:0/3930493187 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec0034440 con 0x7feec8162da0 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 -- 172.21.15.152:0/3930493187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 msgr2=0x7feec815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 --2- 172.21.15.152:0/3930493187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec815f1a0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7feec0009dc0 tx=0x7feec002be00 comp rx=0 tx=0).stop 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 -- 172.21.15.152:0/3930493187 shutdown_connections 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 --2- 172.21.15.152:0/3930493187 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec815f1a0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 -- 172.21.15.152:0/3930493187 >> 172.21.15.152:0/3930493187 conn(0x7feec80d4070 msgr2=0x7feec80d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 -- 172.21.15.152:0/3930493187 shutdown_connections 2024-03-18T15:01:14.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.235+0000 7feece263640 1 -- 172.21.15.152:0/3930493187 wait complete. 2024-03-18T15:01:14.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.237+0000 7feece263640 1 Processor -- start 2024-03-18T15:01:14.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.237+0000 7feece263640 1 -- start start 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feec80d10d0 0x7feec8156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec80d4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feec81631f0 con 0x7feec81622b0 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feec80d2660 con 0x7feec8162da0 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feece263640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feec80cfc90 con 0x7feec80d10d0 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34708/0 (socket says 172.21.15.152:34708) 2024-03-18T15:01:14.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec77fe640 1 -- 172.21.15.152:0/3515128888 learned_addr learned my addr 172.21.15.152:0/3515128888 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec7fff640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feec80d10d0 0x7feec8156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feecc800640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec80d4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec77fe640 1 -- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feec80d10d0 msgr2=0x7feec8156750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.238+0000 7feec77fe640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feec80d10d0 0x7feec8156750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec77fe640 1 -- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 msgr2=0x7feec80d4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec77fe640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec80d4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec77fe640 1 -- 172.21.15.152:0/3515128888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec815f630 con 0x7feec81622b0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec77fe640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c3c0 tx=0x7feeb800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb80052d0 con 0x7feec81622b0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feeb8005490 con 0x7feec81622b0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec815f910 con 0x7feec81622b0 2024-03-18T15:01:14.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8007260 con 0x7feec81622b0 2024-03-18T15:01:14.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.239+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec815fed0 con 0x7feec81622b0 2024-03-18T15:01:14.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.240+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec804f5b0 con 0x7feec81622b0 2024-03-18T15:01:14.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.240+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feeb8007400 con 0x7feec81622b0 2024-03-18T15:01:14.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.241+0000 7feec4ff9640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 0x7feeb406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:14.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.241+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7feeb8089de0 con 0x7feec81622b0 2024-03-18T15:01:14.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.241+0000 7feec7fff640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 0x7feeb406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:14.243 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.241+0000 7feec7fff640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 0x7feeb406e0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feebc0011e0 tx=0x7feebc007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:14.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.245+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7feeb8058280 con 0x7feec81622b0 2024-03-18T15:01:14.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.460+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7feec80d18d0 con 0x7feec81622b0 2024-03-18T15:01:14.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.460+0000 7feec4ff9640 1 -- 172.21.15.152:0/3515128888 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) ==== 53+0+73 (secure 0 0 0) 0x7feeb805c320 con 0x7feec81622b0 2024-03-18T15:01:14.461 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T15:01:14.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 msgr2=0x7feeb406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 0x7feeb406e0c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feebc0011e0 tx=0x7feebc007d30 comp rx=0 tx=0).stop 2024-03-18T15:01:14.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 msgr2=0x7feec806d460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c3c0 tx=0x7feeb800c880 comp rx=0 tx=0).stop 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 shutdown_connections 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feec8162da0 0x7feec80d4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feec81622b0 0x7feec806d460 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feeb406bc00 0x7feeb406e0c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 --2- 172.21.15.152:0/3515128888 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feec80d10d0 0x7feec8156750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 >> 172.21.15.152:0/3515128888 conn(0x7feec80d4070 msgr2=0x7feec815ab00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 shutdown_connections 2024-03-18T15:01:14.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:14.462+0000 7feece263640 1 -- 172.21.15.152:0/3515128888 wait complete. 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T15:01:14.478 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-03-18T15:01:14.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.479 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:14.495 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42733sec preferred_lft 42733sec 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::ec4:7aff:fe88:6df5/64 scope link 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 9e:40:10:60:5e:45 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::808:5ff:feb0:479a/64 scope link tentative 2024-03-18T15:01:14.496 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.497 INFO:teuthology.orchestra.run.smithi186.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T15:01:14.497 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 9e:40:10:60:5e:45 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T15:01:14.497 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::9c40:10ff:fe60:5e45/64 scope link tentative 2024-03-18T15:01:14.497 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.497 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T15:01:14.562 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-03-18T15:01:14.563 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.564 DEBUG:teuthology.orchestra.run.smithi186:> route 2024-03-18T15:01:14.620 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2024-03-18T15:01:14.620 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T15:01:14.620 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T15:01:14.620 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T15:01:14.620 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T15:01:14.620 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:14.620 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:14.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T15:01:14.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T15:01:14.621 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T15:01:14.621 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:14.709 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:14.750 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:14.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.757 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T15:01:14.771 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-18T15:01:14.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.771 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2024-03-18T15:01:14.826 INFO:teuthology.orchestra.run.smithi186.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-03-18T15:01:14.826 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:14.826 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:14.826 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-18T15:01:14.826 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-03-18T15:01:14.826 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:14.914 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:14.942 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:14.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-18T15:01:14.974 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:14.974 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 56:99:66:e4:f6:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::5499:66ff:fee4:f6f1/64 scope link tentative 2024-03-18T15:01:14.975 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:14.976 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:14.976 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 56:99:66:e4:f6:f1 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-03-18T15:01:15.043 INFO:teuthology.orchestra.run.smithi186.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-03-18T15:01:15.044 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:15.044 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::5499:66ff:fee4:f6f1/64 scope link tentative 2024-03-18T15:01:15.044 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:15.045 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-03-18T15:01:15.045 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-03-18T15:01:15.046 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-03-18T15:01:15.046 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:15.133 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:15.222 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.228 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:15.229 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-03-18T15:01:15.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.1 up 2024-03-18T15:01:15.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.1 master ceph-brx 2024-03-18T15:01:15.229 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-03-18T15:01:15.277 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:15.304 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.310 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:15.310 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-03-18T15:01:15.325 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-03-18T15:01:15.325 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:15.325 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-03-18T15:01:15.380 INFO:tasks.cephfs.kernel_mount:mounting using device: 3@.cephfs=/ 2024-03-18T15:01:15.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:15.380 DEBUG:teuthology.orchestra.run.smithi186:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 3@.cephfs=/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:15.465 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:15.465 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: trying mount with new device syntax: 3@ee22e391-802c-4342-9093-15071cbd8b50.cephfs=/ 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,ms_mode=prefer-crc,key=3,mon_addr=172.21.15.152:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout: You just mounted a file system that supports labels which does not 2024-03-18T15:01:15.472 INFO:teuthology.orchestra.run.smithi186.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T15:01:15.473 INFO:teuthology.orchestra.run.smithi186.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T15:01:15.473 INFO:teuthology.orchestra.run.smithi186.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T15:01:15.474 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T15:01:15.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:15.474 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-03-18T15:01:15.500 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:15.589 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:15.590 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.596 INFO:teuthology.orchestra.run.smithi186.stdout:client4588 2024-03-18T15:01:15.596 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:15.596 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:15.611 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:15.699 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:15.700 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.706 INFO:teuthology.orchestra.run.smithi186.stdout:client4588 2024-03-18T15:01:15.706 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:15.754 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:15.756 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.761 INFO:teuthology.orchestra.run.smithi186.stdout:client4588 2024-03-18T15:01:15.762 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest/mnt.3 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/ee22e391-802c-4342-9093-15071cbd8b50.client4588/status') 2024-03-18T15:01:15.809 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:15.822 INFO:teuthology.orchestra.run.smithi186.stdout:instance: client.4588 (3)192.168.0.2:0/1918386017 2024-03-18T15:01:15.822 INFO:teuthology.orchestra.run.smithi186.stdout:blocklisted: false 2024-03-18T15:01:15.822 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records in 2024-03-18T15:01:15.822 INFO:teuthology.orchestra.run.smithi186.stderr:0+1 records out 2024-03-18T15:01:15.822 INFO:teuthology.orchestra.run.smithi186.stderr:69 bytes copied, 2.0056e-05 s, 3.4 MB/s 2024-03-18T15:01:15.823 INFO:teuthology.orchestra.run.smithi186.stderr:2024-03-18T15:01:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:15.829 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-03-18T15:01:15.847 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:15.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.949+0000 7f8db3d89640 1 Processor -- start 2024-03-18T15:01:15.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.949+0000 7f8db3d89640 1 -- start start 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db3d89640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8dac0d10d0 0x7f8dac162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db3d89640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac0b3440 con 0x7f8dac1622b0 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db3d89640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8dac0d20a0 con 0x7f8dac15ea90 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db3d89640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8dac0d16c0 con 0x7f8dac0d10d0 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8dac0d10d0 0x7f8dac162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8dac0d10d0 0x7f8dac162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34712/0 (socket says 172.21.15.152:34712) 2024-03-18T15:01:15.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 -- 172.21.15.152:0/4132336607 learned_addr learned my addr 172.21.15.152:0/4132336607 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1b25640 1 --1- 172.21.15.152:0/4132336607 >> v1:172.21.15.152:6789/0 conn(0x7f8dac1622b0 0x7f8dac162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37362/0 (socket says 172.21.15.152:37362) 2024-03-18T15:01:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 -- 172.21.15.152:0/4132336607 >> v1:172.21.15.186:6789/0 conn(0x7f8dac15ea90 legacy=0x7f8dac15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 -- 172.21.15.152:0/4132336607 >> v1:172.21.15.152:6789/0 conn(0x7f8dac1622b0 legacy=0x7f8dac162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:15.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.950+0000 7f8db1324640 1 -- 172.21.15.152:0/4132336607 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac0d2380 con 0x7f8dac0d10d0 2024-03-18T15:01:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.951+0000 7f8db1324640 1 --2- 172.21.15.152:0/4132336607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac0d10d0 0x7f8dac162da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0098a0 tx=0x7f8d9c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e847c233df55e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.951+0000 7f8db0b23640 1 -- 172.21.15.152:0/4132336607 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c035020 con 0x7f8dac0d10d0 2024-03-18T15:01:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.951+0000 7f8db0b23640 1 -- 172.21.15.152:0/4132336607 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d9c031640 con 0x7f8dac0d10d0 2024-03-18T15:01:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.951+0000 7f8db0b23640 1 -- 172.21.15.152:0/4132336607 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d9c02d040 con 0x7f8dac0d10d0 2024-03-18T15:01:15.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 -- 172.21.15.152:0/4132336607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac0d10d0 msgr2=0x7f8dac162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 --2- 172.21.15.152:0/4132336607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac0d10d0 0x7f8dac162da0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0098a0 tx=0x7f8d9c02b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 -- 172.21.15.152:0/4132336607 shutdown_connections 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 --2- 172.21.15.152:0/4132336607 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac0d10d0 0x7f8dac162da0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 -- 172.21.15.152:0/4132336607 >> 172.21.15.152:0/4132336607 conn(0x7f8dac0d4070 msgr2=0x7f8dac0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 -- 172.21.15.152:0/4132336607 shutdown_connections 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.952+0000 7f8db3d89640 1 -- 172.21.15.152:0/4132336607 wait complete. 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.953+0000 7f8db3d89640 1 Processor -- start 2024-03-18T15:01:15.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.953+0000 7f8db3d89640 1 -- start start 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dac0d10d0 0x7f8dac155970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dac15ea90 0x7f8dac14fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0cfc90 con 0x7f8dac1622b0 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8dac0d2660 con 0x7f8dac15ea90 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db3d89640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8dac0cfe10 con 0x7f8dac0d10d0 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34722/0 (socket says 172.21.15.152:34722) 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 -- 172.21.15.152:0/2182886136 learned_addr learned my addr 172.21.15.152:0/2182886136 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db1b25640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dac0d10d0 0x7f8dac155970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db1324640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dac15ea90 0x7f8dac14fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 -- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dac0d10d0 msgr2=0x7f8dac155970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:15.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dac0d10d0 0x7f8dac155970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 -- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dac15ea90 msgr2=0x7f8dac14fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dac15ea90 0x7f8dac14fe50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 -- 172.21.15.152:0/2182886136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8dac1548d0 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.954+0000 7f8db2326640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8da4001eb0 tx=0x7f8da400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.955+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4017070 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.955+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8da40052d0 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.955+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8da4003810 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.955+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8dac154bb0 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.955+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8dac155170 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.956+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8dac04f5b0 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.956+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8da401a070 con 0x7f8dac1622b0 2024-03-18T15:01:15.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.957+0000 7f8da27fc640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 0x7f8d9006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:15.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.957+0000 7f8db1b25640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 0x7f8d9006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:15.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.957+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8da4089d30 con 0x7f8dac1622b0 2024-03-18T15:01:15.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.957+0000 7f8db1b25640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 0x7f8d9006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8da80012e0 tx=0x7f8da80016f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:15.961 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:15.961+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8da40581d0 con 0x7f8dac1622b0 2024-03-18T15:01:16.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.140+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8dac0d18d0 con 0x7f8dac1622b0 2024-03-18T15:01:16.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.141+0000 7f8da27fc640 1 -- 172.21.15.152:0/2182886136 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f8da405c270 con 0x7f8dac1622b0 2024-03-18T15:01:16.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:16.142 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 msgr2=0x7f8d9006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 0x7f8d9006e090 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8da80012e0 tx=0x7f8da80016f0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 msgr2=0x7f8dac15d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f8da4001eb0 tx=0x7f8da400c890 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 shutdown_connections 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8dac1622b0 0x7f8dac15d370 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8dac15ea90 0x7f8dac14fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8d9006bbd0 0x7f8d9006e090 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 --2- 172.21.15.152:0/2182886136 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8dac0d10d0 0x7f8dac155970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.144 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 >> 172.21.15.152:0/2182886136 conn(0x7f8dac0d4070 msgr2=0x7f8dac06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 shutdown_connections 2024-03-18T15:01:16.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.143+0000 7f8db3d89640 1 -- 172.21.15.152:0/2182886136 wait complete. 2024-03-18T15:01:16.155 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:16.155 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.258+0000 7f0701ede640 1 Processor -- start 2024-03-18T15:01:16.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.258+0000 7f0701ede640 1 -- start start 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f0701ede640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f06fc161890 0x7f06fc0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f0701ede640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06fc0cffe0 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f0701ede640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06fc0cfa20 con 0x7f06fc0d1070 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f0701ede640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f06fc0cfd00 con 0x7f06fc161890 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f06faffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f06fc0b4ec0 0x7f06fc0d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37378/0 (socket says 172.21.15.152:37378) 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.259+0000 7f06faffd640 1 -- 172.21.15.152:0/2018793731 learned_addr learned my addr 172.21.15.152:0/2018793731 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/2018793731 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161890 0x7f06fc0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 446922440 0 0) 0x7f06fc0cffe0 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f06e4003520 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 878078149 0 0) 0x7f06e4003520 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161890 msgr2=0x7f06fc0d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 --2- 172.21.15.152:0/2018793731 >> v2:172.21.15.186:3300/0 conn(0x7f06fc161890 0x7f06fc0d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 >> v1:172.21.15.186:6789/0 conn(0x7f06fc0d1070 legacy=0x7f06fc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc0cf710 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f06ec001670 con 0x7f06fc0b4ec0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 >> v1:172.21.15.152:6789/0 conn(0x7f06fc0b4ec0 legacy=0x7f06fc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 0x7f06e4003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e4004800 0x7f06e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06e40051c0 0x7f06e400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0cfd00 con 0x7f06e40039b0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06e400c060 con 0x7f06e40051c0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f06e400c260 con 0x7f06e4004800 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 0x7f06e4003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06faffd640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e4004800 0x7f06e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fbfff640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06e40051c0 0x7f06e400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 -- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e4004800 msgr2=0x7f06e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e4004800 0x7f06e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 -- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06e40051c0 msgr2=0x7f06e400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06e40051c0 0x7f06e400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fb7fe640 1 -- 172.21.15.152:0/2018793731 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06e4003520 con 0x7f06e40039b0 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fbfff640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06e40051c0 0x7f06e400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.260+0000 7f06fbfff640 1 -- 172.21.15.152:0/2018793731 reap_dead start 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.261+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 0x7f06e4003dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ac0 tx=0x7f06e4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5dd8c4d50d8ac95 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.261+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0039070 con 0x7f06e40039b0 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.261+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06f002c6b0 con 0x7f06e40039b0 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.261+0000 7f06fa7fc640 1 -- 172.21.15.152:0/2018793731 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06f0009690 con 0x7f06e40039b0 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 -- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 msgr2=0x7f06e4003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 0x7f06e4003dd0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009ac0 tx=0x7f06e4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 -- 172.21.15.152:0/2018793731 shutdown_connections 2024-03-18T15:01:16.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 --2- 172.21.15.152:0/2018793731 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06e40039b0 0x7f06e4003dd0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 -- 172.21.15.152:0/2018793731 >> 172.21.15.152:0/2018793731 conn(0x7f06fc0d4090 msgr2=0x7f06fc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 -- 172.21.15.152:0/2018793731 shutdown_connections 2024-03-18T15:01:16.266 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.262+0000 7f0701ede640 1 -- 172.21.15.152:0/2018793731 wait complete. 2024-03-18T15:01:16.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.263+0000 7f0701ede640 1 Processor -- start 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 -- start start 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e40039b0 0x7f06fc1489e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 0x7f06fc157680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0d4bb0 con 0x7f06fc148f20 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f06fc0b5580 con 0x7f06fc0c9440 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f0701ede640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f06fc0d4d30 con 0x7f06e40039b0 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f06faffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f06faffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34736/0 (socket says 172.21.15.152:34736) 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.264+0000 7f06faffd640 1 -- 172.21.15.152:0/479937705 learned_addr learned my addr 172.21.15.152:0/479937705 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e40039b0 0x7f06fc1489e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06fbfff640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 0x7f06fc157680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 -- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e40039b0 msgr2=0x7f06fc1489e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e40039b0 0x7f06fc1489e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 -- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 msgr2=0x7f06fc157680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 0x7f06fc157680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 -- 172.21.15.152:0/479937705 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06fc149450 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06fbfff640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 0x7f06fc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06faffd640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007290 tx=0x7f06ec007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec01a070 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06ec00fa20 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00fdf0 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06fc149730 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.265+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06fc157bc0 con 0x7f06fc148f20 2024-03-18T15:01:16.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.266+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06fc04f540 con 0x7f06fc148f20 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.266+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f06ec01d360 con 0x7f06fc148f20 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.267+0000 7f06e3fff640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 0x7f06e806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.267+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f06ec08a490 con 0x7f06fc148f20 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.267+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 0x7f06e806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.267+0000 7f06fb7fe640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 0x7f06e806e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f0036000 tx=0x7f06f0030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.271+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f06ec059010 con 0x7f06fc148f20 2024-03-18T15:01:16.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.448+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f06fc08d7e0 con 0x7f06fc148f20 2024-03-18T15:01:16.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.448+0000 7f06e3fff640 1 -- 172.21.15.152:0/479937705 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f06ec058910 con 0x7f06fc148f20 2024-03-18T15:01:16.448 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:16.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 msgr2=0x7f06e806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 0x7f06e806e090 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f0036000 tx=0x7f06f0030000 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 msgr2=0x7f06fc0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06ec007290 tx=0x7f06ec007750 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 shutdown_connections 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f06fc0c9440 0x7f06fc157680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f06fc148f20 0x7f06fc0c8f00 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f06e806bbd0 0x7f06e806e090 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 --2- 172.21.15.152:0/479937705 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f06e40039b0 0x7f06fc1489e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 >> 172.21.15.152:0/479937705 conn(0x7f06fc0d4090 msgr2=0x7f06fc0b6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 shutdown_connections 2024-03-18T15:01:16.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.450+0000 7f0701ede640 1 -- 172.21.15.152:0/479937705 wait complete. 2024-03-18T15:01:16.465 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.568+0000 7f3a87a87640 1 Processor -- start 2024-03-18T15:01:16.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.568+0000 7f3a87a87640 1 -- start start 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800ceee0 0x7f3a8006cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3a8006d000 0x7f3a800d0540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a800d0a80 0x7f3a80161e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3a80161c70 con 0x7f3a800d0a80 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3a800d1590 con 0x7f3a8006d000 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a87a87640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3a800ccc00 con 0x7f3a800ceee0 2024-03-18T15:01:16.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a800d0a80 0x7f3a80161e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3a800d0a80 0x7f3a80161e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34752/0 (socket says 172.21.15.152:34752) 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 -- 172.21.15.152:0/2433755669 learned_addr learned my addr 172.21.15.152:0/2433755669 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a85823640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800ceee0 0x7f3a8006cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a85022640 1 --2- 172.21.15.152:0/2433755669 >> v2:172.21.15.186:3300/0 conn(0x7f3a8006d000 0x7f3a800d0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 -- 172.21.15.152:0/2433755669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800ceee0 msgr2=0x7f3a8006cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800ceee0 0x7f3a8006cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 -- 172.21.15.152:0/2433755669 >> v2:172.21.15.186:3300/0 conn(0x7f3a8006d000 msgr2=0x7f3a800d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 --2- 172.21.15.152:0/2433755669 >> v2:172.21.15.186:3300/0 conn(0x7f3a8006d000 0x7f3a800d0540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.569+0000 7f3a86024640 1 -- 172.21.15.152:0/2433755669 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a800cf2c0 con 0x7f3a800d0a80 2024-03-18T15:01:16.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.570+0000 7f3a86024640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800d0a80 0x7f3a80161e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a80073280 tx=0x7f3a7802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11ed1b6b039201f8 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.570+0000 7f3a84821640 1 -- 172.21.15.152:0/2433755669 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7802c9e0 con 0x7f3a800d0a80 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.570+0000 7f3a84821640 1 -- 172.21.15.152:0/2433755669 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7802cb80 con 0x7f3a800d0a80 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.570+0000 7f3a84821640 1 -- 172.21.15.152:0/2433755669 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a780343f0 con 0x7f3a800d0a80 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 -- 172.21.15.152:0/2433755669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800d0a80 msgr2=0x7f3a80161e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800d0a80 0x7f3a80161e80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f3a80073280 tx=0x7f3a7802be40 comp rx=0 tx=0).stop 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 -- 172.21.15.152:0/2433755669 shutdown_connections 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800d0a80 0x7f3a80161e80 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 --2- 172.21.15.152:0/2433755669 >> v2:172.21.15.186:3300/0 conn(0x7f3a8006d000 0x7f3a800d0540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 --2- 172.21.15.152:0/2433755669 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800ceee0 0x7f3a8006cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 -- 172.21.15.152:0/2433755669 >> 172.21.15.152:0/2433755669 conn(0x7f3a8009b160 msgr2=0x7f3a800d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 -- 172.21.15.152:0/2433755669 shutdown_connections 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.571+0000 7f3a87a87640 1 -- 172.21.15.152:0/2433755669 wait complete. 2024-03-18T15:01:16.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.572+0000 7f3a87a87640 1 Processor -- start 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.572+0000 7f3a87a87640 1 -- start start 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a8006d000 0x7f3a8014e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800d0a80 0x7f3a8014bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800cc5b0 con 0x7f3a800ceee0 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3a800d12b0 con 0x7f3a8006d000 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a87a87640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3a800cc890 con 0x7f3a800d0a80 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34762/0 (socket says 172.21.15.152:34762) 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 -- 172.21.15.152:0/1508104089 learned_addr learned my addr 172.21.15.152:0/1508104089 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a86024640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800d0a80 0x7f3a8014bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85823640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a8006d000 0x7f3a8014e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 -- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800d0a80 msgr2=0x7f3a8014bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800d0a80 0x7f3a8014bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 -- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a8006d000 msgr2=0x7f3a8014e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a8006d000 0x7f3a8014e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.573+0000 7f3a85022640 1 -- 172.21.15.152:0/1508104089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a8014d5e0 con 0x7f3a800ceee0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a85022640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000e9b0 tx=0x7f3a7000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a70017070 con 0x7f3a800ceee0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a7000c9a0 con 0x7f3a800ceee0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a8014d8c0 con 0x7f3a800ceee0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a7000cd90 con 0x7f3a800ceee0 2024-03-18T15:01:16.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.574+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a8014de80 con 0x7f3a800ceee0 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.575+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a8004f540 con 0x7f3a800ceee0 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.576+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3a7001a070 con 0x7f3a800ceee0 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.576+0000 7f3a767fc640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 0x7f3a6406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.576+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f3a7008ada0 con 0x7f3a800ceee0 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.576+0000 7f3a85823640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 0x7f3a6406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.577+0000 7f3a85823640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 0x7f3a6406e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a8015be80 tx=0x7f3a7c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.581+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3a70059240 con 0x7f3a800ceee0 2024-03-18T15:01:16.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.760+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3a800cf4b0 con 0x7f3a800ceee0 2024-03-18T15:01:16.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.761+0000 7f3a767fc640 1 -- 172.21.15.152:0/1508104089 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f3a7005d2e0 con 0x7f3a800ceee0 2024-03-18T15:01:16.761 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:16.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 msgr2=0x7f3a6406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 0x7f3a6406e090 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3a8015be80 tx=0x7f3a7c009190 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 msgr2=0x7f3a8014b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3a7000e9b0 tx=0x7f3a7000ee70 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 shutdown_connections 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3a6406bbd0 0x7f3a6406e090 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3a800d0a80 0x7f3a8014bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3a800ceee0 0x7f3a8014b980 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 --2- 172.21.15.152:0/1508104089 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3a8006d000 0x7f3a8014e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 >> 172.21.15.152:0/1508104089 conn(0x7f3a8009b160 msgr2=0x7f3a800c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 shutdown_connections 2024-03-18T15:01:16.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.763+0000 7f3a87a87640 1 -- 172.21.15.152:0/1508104089 wait complete. 2024-03-18T15:01:16.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:16.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 Processor -- start 2024-03-18T15:01:16.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 -- start start 2024-03-18T15:01:16.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41dc06cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f41dc0d0c50 0x7f41dc0cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f41dc0cf2c0 con 0x7f41dc06d000 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f41dc161c70 con 0x7f41dc0d0c50 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.879+0000 7f41e2ab8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0d1590 con 0x7f41dc0ceee0 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41dbfff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f41dc06d000 0x7f41dc0d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37380/0 (socket says 172.21.15.152:37380) 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41dbfff640 1 -- 172.21.15.152:0/1235896428 learned_addr learned my addr 172.21.15.152:0/1235896428 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41e0854640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41dc06cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735445677 0 0) 0x7f41dc0cf2c0 con 0x7f41dc06d000 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41e1055640 1 --2- 172.21.15.152:0/1235896428 >> v2:172.21.15.186:3300/0 conn(0x7f41dc0d0c50 0x7f41dc0cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f41cc003520 con 0x7f41dc06d000 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 412902320 0 0) 0x7f41cc003520 con 0x7f41dc06d000 2024-03-18T15:01:16.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 msgr2=0x7f41dc06cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41dc06cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 >> v2:172.21.15.186:3300/0 conn(0x7f41dc0d0c50 msgr2=0x7f41dc0cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 --2- 172.21.15.152:0/1235896428 >> v2:172.21.15.186:3300/0 conn(0x7f41dc0d0c50 0x7f41dc0cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc06d440 con 0x7f41dc06d000 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f41c8001670 con 0x7f41dc06d000 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 >> v1:172.21.15.152:6789/0 conn(0x7f41dc06d000 legacy=0x7f41dc0d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41cc004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc161c70 con 0x7f41cc004d40 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0d1590 con 0x7f41cc0039b0 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f41cc00b9c0 con 0x7f41dc0ceee0 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41e1055640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41e0854640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.880+0000 7f41dbfff640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41cc004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 -- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 msgr2=0x7f41cc004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc0ceee0 0x7f41cc004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 -- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 msgr2=0x7f41cc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41cc0039b0 0x7f41cc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 -- 172.21.15.152:0/1235896428 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41cc003520 con 0x7f41cc004d40 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41e1055640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009fc0 tx=0x7f41cc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aadb4bef9b65601 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4039070 con 0x7f41cc004d40 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d402cc60 con 0x7f41cc004d40 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.881+0000 7f41db7fe640 1 -- 172.21.15.152:0/1235896428 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d4009c10 con 0x7f41cc004d40 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1235896428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 msgr2=0x7f41cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1235896428 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41cc0051c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f41d4009fc0 tx=0x7f41cc005830 comp rx=0 tx=0).stop 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e1055640 1 -- 172.21.15.152:0/1235896428 reap_dead start 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1235896428 shutdown_connections 2024-03-18T15:01:16.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1235896428 >> 172.21.15.152:0/1235896428 conn(0x7f41dc09b160 msgr2=0x7f41dc0d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:16.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1235896428 shutdown_connections 2024-03-18T15:01:16.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.882+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1235896428 wait complete. 2024-03-18T15:01:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.883+0000 7f41e2ab8640 1 Processor -- start 2024-03-18T15:01:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.883+0000 7f41e2ab8640 1 -- start start 2024-03-18T15:01:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc09f510 0x7f41dc1533e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41dc0aeac0 0x7f41dc09e890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0cc5b0 con 0x7f41cc004d40 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f41dc0ccc00 con 0x7f41dc0aeac0 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e2ab8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f41dc0cc890 con 0x7f41dc09f510 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34766/0 (socket says 172.21.15.152:34766) 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 -- 172.21.15.152:0/1837733822 learned_addr learned my addr 172.21.15.152:0/1837733822 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41dbfff640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc09f510 0x7f41dc1533e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e1055640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41dc0aeac0 0x7f41dc09e890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 -- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc09f510 msgr2=0x7f41dc1533e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc09f510 0x7f41dc1533e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 -- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41dc0aeac0 msgr2=0x7f41dc09e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41dc0aeac0 0x7f41dc09e890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:16.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.884+0000 7f41e0854640 1 -- 172.21.15.152:0/1837733822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41dc0af2b0 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41e0854640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d0011910 tx=0x7f41d0011d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d000f9d0 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f41d000fb70 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41d0014440 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41dc0af590 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.885+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41dc0afb50 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.886+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41dc0cdf30 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.886+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f41d0012040 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.887+0000 7f41d97fa640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 0x7f41c006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.887+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f41d008aee0 con 0x7f41cc004d40 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.887+0000 7f41dbfff640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 0x7f41c006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:16.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.887+0000 7f41dbfff640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 0x7f41c006e0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41dc1f7670 tx=0x7f41c8007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:16.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:16.895+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f41dc0cdf30 con 0x7f41cc004d40 2024-03-18T15:01:17.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.079+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f41dc04f540 con 0x7f41cc004d40 2024-03-18T15:01:17.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.080+0000 7f41d97fa640 1 -- 172.21.15.152:0/1837733822 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f41d0019030 con 0x7f41cc004d40 2024-03-18T15:01:17.080 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 msgr2=0x7f41c006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 0x7f41c006e0c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f41dc1f7670 tx=0x7f41c8007970 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 msgr2=0x7f41dc0b0350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f41d0011910 tx=0x7f41d0011d10 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 shutdown_connections 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f41dc0aeac0 0x7f41dc09e890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f41c006bc00 0x7f41c006e0c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f41dc09f510 0x7f41dc1533e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 --2- 172.21.15.152:0/1837733822 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f41cc004d40 0x7f41dc0b0350 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 >> 172.21.15.152:0/1837733822 conn(0x7f41dc09b160 msgr2=0x7f41dc0c8f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 shutdown_connections 2024-03-18T15:01:17.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.082+0000 7f41e2ab8640 1 -- 172.21.15.152:0/1837733822 wait complete. 2024-03-18T15:01:17.093 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:17.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.197+0000 7f27b97d4640 1 Processor -- start 2024-03-18T15:01:17.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.197+0000 7f27b97d4640 1 -- start start 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.198+0000 7f27b97d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27b415ad40 0x7f27b40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.198+0000 7f27b97d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b40d07f0 0x7f27b40722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.198+0000 7f27b97d4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f27b415ee60 con 0x7f27b40b3400 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.198+0000 7f27b97d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f27b415f140 con 0x7f27b415ad40 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.198+0000 7f27b97d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f27b415f420 con 0x7f27b40d07f0 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27b415ad40 0x7f27b40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f27b415ad40 0x7f27b40ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34772/0 (socket says 172.21.15.152:34772) 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 -- 172.21.15.152:0/3479799577 learned_addr learned my addr 172.21.15.152:0/3479799577 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:17.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b37fe640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b40d07f0 0x7f27b40722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 -- 172.21.15.152:0/3479799577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b40d07f0 msgr2=0x7f27b40722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b40d07f0 0x7f27b40722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 -- 172.21.15.152:0/3479799577 >> v1:172.21.15.186:6789/0 conn(0x7f27b40b3400 legacy=0x7f27b40d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.199+0000 7f27b2ffd640 1 -- 172.21.15.152:0/3479799577 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b415f700 con 0x7f27b415ad40 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b2ffd640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b415ad40 0x7f27b40ad800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009870 tx=0x7f27a402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31cae3673740ac3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b27fc640 1 -- 172.21.15.152:0/3479799577 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4035020 con 0x7f27b415ad40 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b27fc640 1 -- 172.21.15.152:0/3479799577 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a4031640 con 0x7f27b415ad40 2024-03-18T15:01:17.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b27fc640 1 -- 172.21.15.152:0/3479799577 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a402d040 con 0x7f27b415ad40 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b97d4640 1 -- 172.21.15.152:0/3479799577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b415ad40 msgr2=0x7f27b40ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.200+0000 7f27b97d4640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b415ad40 0x7f27b40ad800 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f27a4009870 tx=0x7f27a402b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 -- 172.21.15.152:0/3479799577 shutdown_connections 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b40d07f0 0x7f27b40722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 --2- 172.21.15.152:0/3479799577 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b415ad40 0x7f27b40ad800 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 -- 172.21.15.152:0/3479799577 >> 172.21.15.152:0/3479799577 conn(0x7f27b406b5e0 msgr2=0x7f27b406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 -- 172.21.15.152:0/3479799577 shutdown_connections 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.201+0000 7f27b97d4640 1 -- 172.21.15.152:0/3479799577 wait complete. 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 Processor -- start 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 -- start start 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 0x7f27b409c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 0x7f27b409c800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f27b415eb90 con 0x7f27b40b3400 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f27b415ea10 con 0x7f27b40d07f0 2024-03-18T15:01:17.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.202+0000 7f27b97d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f27b40b3860 con 0x7f27b415ad40 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34780/0 (socket says 172.21.15.152:34780) 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 -- 172.21.15.152:0/1070342983 learned_addr learned my addr 172.21.15.152:0/1070342983 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b37fe640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 0x7f27b409c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27abfff640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 0x7f27b409c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 -- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 msgr2=0x7f27b409c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 0x7f27b409c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 -- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 msgr2=0x7f27b409c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 0x7f27b409c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 -- 172.21.15.152:0/1070342983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27b409cd40 con 0x7f27b40b3400 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b37fe640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 0x7f27b409c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:17.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27abfff640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 0x7f27b409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b2ffd640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27a4000c00 tx=0x7f27a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4040070 con 0x7f27b40b3400 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f27a40399f0 con 0x7f27b40b3400 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27b41e4940 con 0x7f27b40b3400 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27a4035040 con 0x7f27b40b3400 2024-03-18T15:01:17.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.203+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27b41e4f00 con 0x7f27b40b3400 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.204+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27b404f5b0 con 0x7f27b40b3400 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.205+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f27a404b060 con 0x7f27b40b3400 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.205+0000 7f27ab7fe640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 0x7f279406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.205+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f27a40ac320 con 0x7f27b40b3400 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.205+0000 7f27abfff640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 0x7f279406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.206+0000 7f27abfff640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 0x7f279406e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27b41565d0 tx=0x7f279c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.214+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f27a407ae10 con 0x7f27b40b3400 2024-03-18T15:01:17.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.395+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f27b4071ad0 con 0x7f27b40b3400 2024-03-18T15:01:17.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.396+0000 7f27ab7fe640 1 -- 172.21.15.152:0/1070342983 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f27a40a9120 con 0x7f27b40b3400 2024-03-18T15:01:17.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:17.397 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 msgr2=0x7f279406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 0x7f279406e090 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f27b41565d0 tx=0x7f279c009040 comp rx=0 tx=0).stop 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 msgr2=0x7f27b40b1c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f27a4000c00 tx=0x7f27a40046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 shutdown_connections 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f279406bbd0 0x7f279406e090 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f27b415ad40 0x7f27b409c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f27b40d07f0 0x7f27b409c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 --2- 172.21.15.152:0/1070342983 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f27b40b3400 0x7f27b40b1c30 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.398+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 >> 172.21.15.152:0/1070342983 conn(0x7f27b406b5e0 msgr2=0x7f27b4157190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.399+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 shutdown_connections 2024-03-18T15:01:17.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.399+0000 7f27b97d4640 1 -- 172.21.15.152:0/1070342983 wait complete. 2024-03-18T15:01:17.410 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:17.411 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:17.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.519+0000 7f307ce0b640 1 Processor -- start 2024-03-18T15:01:17.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.519+0000 7f307ce0b640 1 -- start start 2024-03-18T15:01:17.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307ce0b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f30780cd410 0x7f30780cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307ce0b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780cc370 con 0x7f307815b120 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307ce0b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f30780cc650 con 0x7f30780cfca0 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307ce0b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f30780cc930 con 0x7f30780cd410 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307659c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f307815b120 0x7f30780cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37388/0 (socket says 172.21.15.152:37388) 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307659c640 1 -- 172.21.15.152:0/3130383500 learned_addr learned my addr 172.21.15.152:0/3130383500 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f3075d9b640 1 --2- 172.21.15.152:0/3130383500 >> v2:172.21.15.186:3300/0 conn(0x7f30780cd410 0x7f30780cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2424854416 0 0) 0x7f30780cc370 con 0x7f307815b120 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3060003520 con 0x7f307815b120 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3747044837 0 0) 0x7f30780cc650 con 0x7f30780cfca0 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f30780cc370 con 0x7f30780cfca0 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f3075d9b640 1 -- 172.21.15.152:0/3130383500 >> v1:172.21.15.186:6789/0 conn(0x7f30780cfca0 legacy=0x7f307806ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f3075d9b640 1 -- 172.21.15.152:0/3130383500 >> v1:172.21.15.152:6789/0 conn(0x7f307815b120 legacy=0x7f30780cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.520+0000 7f3075d9b640 1 -- 172.21.15.152:0/3130383500 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780ccc10 con 0x7f30780cd410 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.521+0000 7f3075d9b640 1 --2- 172.21.15.152:0/3130383500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cd410 0x7f30780cbd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097a0 tx=0x7f306c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=653309dbdecddbff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.521+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c035020 con 0x7f30780cd410 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.521+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f306c031830 con 0x7f30780cd410 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.521+0000 7f307559a640 1 -- 172.21.15.152:0/3130383500 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306c031be0 con 0x7f30780cd410 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 -- 172.21.15.152:0/3130383500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cd410 msgr2=0x7f30780cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 --2- 172.21.15.152:0/3130383500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cd410 0x7f30780cbd00 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f306c0097a0 tx=0x7f306c02b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 -- 172.21.15.152:0/3130383500 shutdown_connections 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 --2- 172.21.15.152:0/3130383500 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cd410 0x7f30780cbd00 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 -- 172.21.15.152:0/3130383500 >> 172.21.15.152:0/3130383500 conn(0x7f30780d0da0 msgr2=0x7f30780d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 -- 172.21.15.152:0/3130383500 shutdown_connections 2024-03-18T15:01:17.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.522+0000 7f307ce0b640 1 -- 172.21.15.152:0/3130383500 wait complete. 2024-03-18T15:01:17.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 Processor -- start 2024-03-18T15:01:17.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 -- start start 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30780cd410 0x7f30780b53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cfca0 0x7f30781f3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f30780cf1e0 con 0x7f307815b120 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f30780cf060 con 0x7f30780cfca0 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f307ce0b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3078071d60 con 0x7f30780cd410 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f3076d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f3076d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34782/0 (socket says 172.21.15.152:34782) 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.524+0000 7f3076d9d640 1 -- 172.21.15.152:0/2194364602 learned_addr learned my addr 172.21.15.152:0/2194364602 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:17.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3075d9b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cfca0 0x7f30781f3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f307659c640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30780cd410 0x7f30780b53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 -- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30780cd410 msgr2=0x7f30780b53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30780cd410 0x7f30780b53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 -- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cfca0 msgr2=0x7f30781f3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cfca0 0x7f30781f3980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 -- 172.21.15.152:0/2194364602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30780c82c0 con 0x7f307815b120 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3076d9d640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f307000c730 tx=0x7f307000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3070003b70 con 0x7f307815b120 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3070003d10 con 0x7f307815b120 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30780c85a0 con 0x7f307815b120 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f307000aa90 con 0x7f307815b120 2024-03-18T15:01:17.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.525+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30780c8b60 con 0x7f307815b120 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.527+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f307804f540 con 0x7f307815b120 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.527+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f307000ac30 con 0x7f307815b120 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.528+0000 7f3066ffd640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 0x7f305806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.528+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f307008a860 con 0x7f307815b120 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.528+0000 7f307659c640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 0x7f305806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.528+0000 7f307659c640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 0x7f305806e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30680011e0 tx=0x7f3068007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.532 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.532+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3070058d00 con 0x7f307815b120 2024-03-18T15:01:17.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.716+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f3078074600 con 0x7f307815b120 2024-03-18T15:01:17.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.716+0000 7f3066ffd640 1 -- 172.21.15.152:0/2194364602 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f307008a070 con 0x7f307815b120 2024-03-18T15:01:17.717 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.718+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 msgr2=0x7f305806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.718+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 0x7f305806e090 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f30680011e0 tx=0x7f3068007d30 comp rx=0 tx=0).stop 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.718+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 msgr2=0x7f30781f6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.718+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f307000c730 tx=0x7f307000cbf0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 shutdown_connections 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f307815b120 0x7f30781f6ef0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f30780cfca0 0x7f30781f3980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f305806bbd0 0x7f305806e090 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 --2- 172.21.15.152:0/2194364602 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f30780cd410 0x7f30780b53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 >> 172.21.15.152:0/2194364602 conn(0x7f30780d0da0 msgr2=0x7f307815a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 shutdown_connections 2024-03-18T15:01:17.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.719+0000 7f307ce0b640 1 -- 172.21.15.152:0/2194364602 wait complete. 2024-03-18T15:01:17.730 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:17.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.842+0000 7f8ebc987640 1 Processor -- start 2024-03-18T15:01:17.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.842+0000 7f8ebc987640 1 -- start start 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.843+0000 7f8ebc987640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8eb80cdef0 0x7f8eb80d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.843+0000 7f8ebc987640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 0x7f8eb80b1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.843+0000 7f8ebc987640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8eb80b20e0 con 0x7f8eb80b1cd0 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.843+0000 7f8ebc987640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb80ce2d0 con 0x7f8eb80cdef0 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.843+0000 7f8ebc987640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8eb806c970 con 0x7f8eb806c490 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8eb80cdef0 0x7f8eb80d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8eb80cdef0 0x7f8eb80d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34798/0 (socket says 172.21.15.152:34798) 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 -- 172.21.15.152:0/3877205618 learned_addr learned my addr 172.21.15.152:0/3877205618 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/3877205618 >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 0x7f8eb80b1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 -- 172.21.15.152:0/3877205618 >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 msgr2=0x7f8eb80b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:17.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 --2- 172.21.15.152:0/3877205618 >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 0x7f8eb80b1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 -- 172.21.15.152:0/3877205618 >> v1:172.21.15.186:6789/0 conn(0x7f8eb80b1cd0 legacy=0x7f8eb80ce720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:17.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eb659c640 1 -- 172.21.15.152:0/3877205618 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb806cc50 con 0x7f8eb80cdef0 2024-03-18T15:01:17.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.844+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/3877205618 >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 0x7f8eb80b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.845+0000 7f8eb659c640 1 --2- 172.21.15.152:0/3877205618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb80cdef0 0x7f8eb80d29c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8073430 tx=0x7f8ea802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b760f92ba1ad271 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.845+0000 7f8eb5d9b640 1 -- 172.21.15.152:0/3877205618 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8035020 con 0x7f8eb80cdef0 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.845+0000 7f8eb5d9b640 1 -- 172.21.15.152:0/3877205618 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea8031870 con 0x7f8eb80cdef0 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.845+0000 7f8eb5d9b640 1 -- 172.21.15.152:0/3877205618 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8031c40 con 0x7f8eb80cdef0 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 -- 172.21.15.152:0/3877205618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb80cdef0 msgr2=0x7f8eb80d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 --2- 172.21.15.152:0/3877205618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb80cdef0 0x7f8eb80d29c0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8073430 tx=0x7f8ea802b910 comp rx=0 tx=0).stop 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 -- 172.21.15.152:0/3877205618 shutdown_connections 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 --2- 172.21.15.152:0/3877205618 >> v2:172.21.15.186:3300/0 conn(0x7f8eb806c490 0x7f8eb80b1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 --2- 172.21.15.152:0/3877205618 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb80cdef0 0x7f8eb80d29c0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 -- 172.21.15.152:0/3877205618 >> 172.21.15.152:0/3877205618 conn(0x7f8eb80d1ea0 msgr2=0x7f8eb80d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 -- 172.21.15.152:0/3877205618 shutdown_connections 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.846+0000 7f8ebc987640 1 -- 172.21.15.152:0/3877205618 wait complete. 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.847+0000 7f8ebc987640 1 Processor -- start 2024-03-18T15:01:17.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.847+0000 7f8ebc987640 1 -- start start 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 0x7f8eb81f3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8eb80cdef0 0x7f8eb81604d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb806d4f0 con 0x7f8eb806c490 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8eb806d210 con 0x7f8eb80cdef0 2024-03-18T15:01:17.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8ebc987640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8eb80d1390 con 0x7f8eb80b1cd0 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34810/0 (socket says 172.21.15.152:34810) 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 -- 172.21.15.152:0/1394210166 learned_addr learned my addr 172.21.15.152:0/1394210166 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 0x7f8eb81f3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb6d9d640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8eb80cdef0 0x7f8eb81604d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 -- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 msgr2=0x7f8eb81f3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 0x7f8eb81f3340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 -- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8eb80cdef0 msgr2=0x7f8eb81604d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8eb80cdef0 0x7f8eb81604d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eb659c640 1 -- 172.21.15.152:0/1394210166 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8eb80ca500 con 0x7f8eb806c490 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.848+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 0x7f8eb81f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8eb659c640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802b950 tx=0x7f8ea80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8040070 con 0x7f8eb806c490 2024-03-18T15:01:17.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ea803a420 con 0x7f8eb806c490 2024-03-18T15:01:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8eb80ca7e0 con 0x7f8eb806c490 2024-03-18T15:01:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ea8035040 con 0x7f8eb806c490 2024-03-18T15:01:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.849+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8eb80b6590 con 0x7f8eb806c490 2024-03-18T15:01:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.850+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8eb804f540 con 0x7f8eb806c490 2024-03-18T15:01:17.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.851+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8ea8038020 con 0x7f8eb806c490 2024-03-18T15:01:17.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.852+0000 7f8eaf7fe640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 0x7f8e9806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:17.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.852+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8ea80acfa0 con 0x7f8eb806c490 2024-03-18T15:01:17.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.852+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 0x7f8e9806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:17.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.852+0000 7f8eadd9b640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 0x7f8e9806e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8157f70 tx=0x7f8ea0008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:17.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:17.859+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8ea807bb70 con 0x7f8eb806c490 2024-03-18T15:01:18.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.040+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8eb80b1940 con 0x7f8eb806c490 2024-03-18T15:01:18.041 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.041+0000 7f8eaf7fe640 1 -- 172.21.15.152:0/1394210166 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f8ea807b470 con 0x7f8eb806c490 2024-03-18T15:01:18.041 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:18.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.042+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 msgr2=0x7f8e9806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.042+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 0x7f8e9806e090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8157f70 tx=0x7f8ea0008040 comp rx=0 tx=0).stop 2024-03-18T15:01:18.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.042+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 msgr2=0x7f8eb80c9cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.042+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f8ea802b950 tx=0x7f8ea80046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.043 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 shutdown_connections 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8eb80cdef0 0x7f8eb81604d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e9806bbd0 0x7f8e9806e090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8eb80b1cd0 0x7f8eb81f3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 --2- 172.21.15.152:0/1394210166 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8eb806c490 0x7f8eb80c9cd0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 >> 172.21.15.152:0/1394210166 conn(0x7f8eb80d1ea0 msgr2=0x7f8eb80b3990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 shutdown_connections 2024-03-18T15:01:18.044 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.043+0000 7f8ebc987640 1 -- 172.21.15.152:0/1394210166 wait complete. 2024-03-18T15:01:18.054 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:18.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 Processor -- start 2024-03-18T15:01:18.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 -- start start 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7280d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd7280b4ec0 0x7fd7280b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7280cffe0 con 0x7fd728161890 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd7280cfa20 con 0x7fd7280b4ec0 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.159+0000 7fd72e1a9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280cfd00 con 0x7fd7280d1070 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd726ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7280d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd727fff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd7280b4ec0 0x7fd7280b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd726ffd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7280d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:58864/0 (socket says 172.21.15.152:58864) 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd7277fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fd728161890 0x7fd7280d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:56098/0 (socket says 172.21.15.152:56098) 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd726ffd640 1 -- 172.21.15.152:0/2568794841 learned_addr learned my addr 172.21.15.152:0/2568794841 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd727fff640 1 -- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 msgr2=0x7fd7280d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:18.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd727fff640 1 --2- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7280d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd727fff640 1 -- 172.21.15.152:0/2568794841 >> v1:172.21.15.186:6789/0 conn(0x7fd728161890 legacy=0x7fd7280d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd727fff640 1 -- 172.21.15.152:0/2568794841 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7280cf710 con 0x7fd7280b4ec0 2024-03-18T15:01:18.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.160+0000 7fd7267fc640 1 -- 172.21.15.152:0/2568794841 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2581953379 0 0) 0x7fd7280cffe0 con 0x7fd728161890 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.161+0000 7fd727fff640 1 --2- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7280b4ec0 0x7fd7280b6ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de977c3cdc609572 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd7267fc640 1 -- 172.21.15.152:0/2568794841 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720039070 con 0x7fd7280b4ec0 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd7267fc640 1 -- 172.21.15.152:0/2568794841 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd72002cc50 con 0x7fd7280b4ec0 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd7267fc640 1 -- 172.21.15.152:0/2568794841 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd720034440 con 0x7fd7280b4ec0 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 -- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7280b4ec0 msgr2=0x7fd7280b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7280b4ec0 0x7fd7280b6ee0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fd720009d90 tx=0x7fd72002bea0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 -- 172.21.15.152:0/2568794841 shutdown_connections 2024-03-18T15:01:18.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7280d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/2568794841 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd7280b4ec0 0x7fd7280b6ee0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 -- 172.21.15.152:0/2568794841 >> 172.21.15.152:0/2568794841 conn(0x7fd7280d4090 msgr2=0x7fd7280d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 -- 172.21.15.152:0/2568794841 shutdown_connections 2024-03-18T15:01:18.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.162+0000 7fd72e1a9640 1 -- 172.21.15.152:0/2568794841 wait complete. 2024-03-18T15:01:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.163+0000 7fd72e1a9640 1 Processor -- start 2024-03-18T15:01:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 -- start start 2024-03-18T15:01:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7281503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728161890 0x7fd72815cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280d2220 con 0x7fd7280b4ec0 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd7280b5580 con 0x7fd728161890 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd72e1a9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd7280d23a0 con 0x7fd7280d1070 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd7277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd7277fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34826/0 (socket says 172.21.15.152:34826) 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.164+0000 7fd7277fe640 1 -- 172.21.15.152:0/3134168991 learned_addr learned my addr 172.21.15.152:0/3134168991 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd727fff640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728161890 0x7fd72815cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd726ffd640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7281503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 -- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 msgr2=0x7fd7281503a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7281503a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 -- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728161890 msgr2=0x7fd72815cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728161890 0x7fd72815cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 -- 172.21.15.152:0/3134168991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7280c7910 con 0x7fd7280b4ec0 2024-03-18T15:01:18.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd7277fe640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c460 tx=0x7fd71800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718018070 con 0x7fd7280b4ec0 2024-03-18T15:01:18.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd718007500 con 0x7fd7280b4ec0 2024-03-18T15:01:18.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7280c7bf0 con 0x7fd7280b4ec0 2024-03-18T15:01:18.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd718004a20 con 0x7fd7280b4ec0 2024-03-18T15:01:18.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.165+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7280c81b0 con 0x7fd7280b4ec0 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.166+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd72804f540 con 0x7fd7280b4ec0 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.167+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd71801b070 con 0x7fd7280b4ec0 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.167+0000 7fd70ffff640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 0x7fd71406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.167+0000 7fd726ffd640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 0x7fd71406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.167+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd718089d70 con 0x7fd7280b4ec0 2024-03-18T15:01:18.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.168+0000 7fd726ffd640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 0x7fd71406e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7280b4e90 tx=0x7fd71c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.172 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.172+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd7180587d0 con 0x7fd7280b4ec0 2024-03-18T15:01:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.372+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd72806c360 con 0x7fd7280b4ec0 2024-03-18T15:01:18.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.373+0000 7fd70ffff640 1 -- 172.21.15.152:0/3134168991 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fd7180580d0 con 0x7fd7280b4ec0 2024-03-18T15:01:18.373 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 msgr2=0x7fd71406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 0x7fd71406e0c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fd7280b4e90 tx=0x7fd71c008040 comp rx=0 tx=0).stop 2024-03-18T15:01:18.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 msgr2=0x7fd7280cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fd71800c460 tx=0x7fd71800c920 comp rx=0 tx=0).stop 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 shutdown_connections 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd728161890 0x7fd72815cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd71406bc00 0x7fd71406e0c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd7280d1070 0x7fd7281503a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 --2- 172.21.15.152:0/3134168991 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd7280b4ec0 0x7fd7280cb590 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 >> 172.21.15.152:0/3134168991 conn(0x7fd7280d4090 msgr2=0x7fd7280b6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 shutdown_connections 2024-03-18T15:01:18.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.375+0000 7fd72e1a9640 1 -- 172.21.15.152:0/3134168991 wait complete. 2024-03-18T15:01:18.386 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:18.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.488+0000 7f0f00790640 1 Processor -- start 2024-03-18T15:01:18.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.488+0000 7f0f00790640 1 -- start start 2024-03-18T15:01:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0f00790640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0ef815ad40 0x7f0ef80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0f00790640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef815ee60 con 0x7f0ef80b3400 2024-03-18T15:01:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0f00790640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0ef815f140 con 0x7f0ef80d07f0 2024-03-18T15:01:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0f00790640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0ef815f420 con 0x7f0ef815ad40 2024-03-18T15:01:18.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0efdd2b640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0ef80b3400 0x7f0ef80d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37394/0 (socket says 172.21.15.152:37394) 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0efdd2b640 1 -- 172.21.15.152:0/2956002961 learned_addr learned my addr 172.21.15.152:0/2956002961 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0efe52c640 1 --2- 172.21.15.152:0/2956002961 >> v2:172.21.15.186:3300/0 conn(0x7f0ef815ad40 0x7f0ef80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4243716446 0 0) 0x7f0ef815ee60 con 0x7f0ef80b3400 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.489+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0ee4003520 con 0x7f0ef80b3400 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1809221638 0 0) 0x7f0ee4003520 con 0x7f0ef80b3400 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 >> v2:172.21.15.186:3300/0 conn(0x7f0ef815ad40 msgr2=0x7f0ef80ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 --2- 172.21.15.152:0/2956002961 >> v2:172.21.15.186:3300/0 conn(0x7f0ef815ad40 0x7f0ef80ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 >> v1:172.21.15.186:6789/0 conn(0x7f0ef80d07f0 legacy=0x7f0ef80722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef815f700 con 0x7f0ef80b3400 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f0ee8001670 con 0x7f0ef80b3400 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 >> v1:172.21.15.152:6789/0 conn(0x7f0ef80b3400 legacy=0x7f0ef80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4003a20 0x7f0ee4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ee4004800 0x7f0ee4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 0x7f0ee400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef815f420 con 0x7f0ee4005230 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0ee400c190 con 0x7f0ee4004800 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0ee400c390 con 0x7f0ee4003a20 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 0x7f0ee400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efe52c640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4003a20 0x7f0ee4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efdd2b640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ee4004800 0x7f0ee4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 -- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4003a20 msgr2=0x7f0ee4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4003a20 0x7f0ee4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 -- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ee4004800 msgr2=0x7f0ee4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ee4004800 0x7f0ee4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.490+0000 7f0efed2d640 1 -- 172.21.15.152:0/2956002961 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ee4003520 con 0x7f0ee4005230 2024-03-18T15:01:18.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.491+0000 7f0efed2d640 1 -- 172.21.15.152:0/2956002961 reap_dead start 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.491+0000 7f0efed2d640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 0x7f0ee400b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0001e50 tx=0x7f0ee4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=745161d0c495f8f9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.491+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0034070 con 0x7f0ee4005230 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.491+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ef0003bb0 con 0x7f0ee4005230 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.491+0000 7f0efd52a640 1 -- 172.21.15.152:0/2956002961 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ef0001a70 con 0x7f0ee4005230 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 -- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 msgr2=0x7f0ee400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 0x7f0ee400b9c0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0ef0001e50 tx=0x7f0ee4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 -- 172.21.15.152:0/2956002961 shutdown_connections 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 --2- 172.21.15.152:0/2956002961 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ee4005230 0x7f0ee400b9c0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 -- 172.21.15.152:0/2956002961 >> 172.21.15.152:0/2956002961 conn(0x7f0ef806b5e0 msgr2=0x7f0ef806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 -- 172.21.15.152:0/2956002961 shutdown_connections 2024-03-18T15:01:18.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.492+0000 7f0f00790640 1 -- 172.21.15.152:0/2956002961 wait complete. 2024-03-18T15:01:18.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.493+0000 7f0f00790640 1 Processor -- start 2024-03-18T15:01:18.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.493+0000 7f0f00790640 1 -- start start 2024-03-18T15:01:18.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4005230 0x7f0ef81e6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.498 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 0x7f0ef81f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef815ea10 con 0x7f0ef80b0a00 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0ef815b330 con 0x7f0ef81550b0 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0ef815eb90 con 0x7f0ee4005230 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34836/0 (socket says 172.21.15.152:34836) 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 -- 172.21.15.152:0/3403313905 learned_addr learned my addr 172.21.15.152:0/3403313905 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efe52c640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4005230 0x7f0ef81e6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efed2d640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 0x7f0ef81f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 -- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4005230 msgr2=0x7f0ef81e6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4005230 0x7f0ef81e6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 -- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 msgr2=0x7f0ef81f5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 0x7f0ef81f5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.499 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 -- 172.21.15.152:0/3403313905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ef81e7010 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efed2d640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 0x7f0ef81f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0efdd2b640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8004f70 tx=0x7f0ee80074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee8007740 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ee8018070 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ef81e72f0 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ee800fb80 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.494+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ef81533a0 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.495+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0ef804f5b0 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.496+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0ee800fd20 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.496+0000 7f0eeeffd640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 0x7f0edc06e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.496+0000 7f0efe52c640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 0x7f0edc06e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.496+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0ee808a9d0 con 0x7f0ef80b0a00 2024-03-18T15:01:18.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.497+0000 7f0efe52c640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 0x7f0edc06e230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009a80 tx=0x7f0ef4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.501 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.501+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0ee8059610 con 0x7f0ef80b0a00 2024-03-18T15:01:18.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.678+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0ef8155490 con 0x7f0ef80b0a00 2024-03-18T15:01:18.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.679+0000 7f0eeeffd640 1 -- 172.21.15.152:0/3403313905 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f0ee8058f10 con 0x7f0ef80b0a00 2024-03-18T15:01:18.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:18.679 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:18.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 msgr2=0x7f0edc06e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 0x7f0edc06e230 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f0ef4009a80 tx=0x7f0ef4008040 comp rx=0 tx=0).stop 2024-03-18T15:01:18.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 msgr2=0x7f0ef8154b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0ee8004f70 tx=0x7f0ee80074f0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 shutdown_connections 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0ef81550b0 0x7f0ef81f5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0ef80b0a00 0x7f0ef8154b70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0edc06bd70 0x7f0edc06e230 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 --2- 172.21.15.152:0/3403313905 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0ee4005230 0x7f0ef81e6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 >> 172.21.15.152:0/3403313905 conn(0x7f0ef806b5e0 msgr2=0x7f0ef80d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 shutdown_connections 2024-03-18T15:01:18.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.681+0000 7f0f00790640 1 -- 172.21.15.152:0/3403313905 wait complete. 2024-03-18T15:01:18.692 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:18.693 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:18.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.797+0000 7f719cb37640 1 Processor -- start 2024-03-18T15:01:18.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.797+0000 7f719cb37640 1 -- start start 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719cb37640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 0x7f719815b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719cb37640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71980c4a90 0x7f719806e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719cb37640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f719806d3c0 con 0x7f719806eca0 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719cb37640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7198158d80 con 0x7f71980c4a90 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719cb37640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f719806f0f0 con 0x7f71981589a0 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71980c4a90 0x7f719806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f71980c4a90 0x7f719806e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34844/0 (socket says 172.21.15.152:34844) 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 -- 172.21.15.152:0/1807704291 learned_addr learned my addr 172.21.15.152:0/1807704291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:18.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719659c640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 0x7f719815b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 -- 172.21.15.152:0/1807704291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 msgr2=0x7f719815b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 0x7f719815b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 -- 172.21.15.152:0/1807704291 >> v1:172.21.15.186:6789/0 conn(0x7f719806eca0 legacy=0x7f719815e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f718ffff640 1 -- 172.21.15.152:0/1807704291 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71980cc190 con 0x7f71980c4a90 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.798+0000 7f719659c640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 0x7f719815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:18.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.799+0000 7f718ffff640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980c4a90 0x7f719806e760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1a9975dc39753e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.799+0000 7f7195d9b640 1 -- 172.21.15.152:0/1807704291 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180034070 con 0x7f71980c4a90 2024-03-18T15:01:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.799+0000 7f7195d9b640 1 -- 172.21.15.152:0/1807704291 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7180030840 con 0x7f71980c4a90 2024-03-18T15:01:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.799+0000 7f7195d9b640 1 -- 172.21.15.152:0/1807704291 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180030c10 con 0x7f71980c4a90 2024-03-18T15:01:18.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 -- 172.21.15.152:0/1807704291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980c4a90 msgr2=0x7f719806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980c4a90 0x7f719806e760 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f7180009870 tx=0x7f718002b980 comp rx=0 tx=0).stop 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 -- 172.21.15.152:0/1807704291 shutdown_connections 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71980c4a90 0x7f719806e760 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 --2- 172.21.15.152:0/1807704291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71981589a0 0x7f719815b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 -- 172.21.15.152:0/1807704291 >> 172.21.15.152:0/1807704291 conn(0x7f71980cfbf0 msgr2=0x7f71980cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 -- 172.21.15.152:0/1807704291 shutdown_connections 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.800+0000 7f719cb37640 1 -- 172.21.15.152:0/1807704291 wait complete. 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.801+0000 7f719cb37640 1 Processor -- start 2024-03-18T15:01:18.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.801+0000 7f719cb37640 1 -- start start 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f719806eca0 0x7f719814c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 0x7f71980c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71980c5680 con 0x7f71981589a0 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f71980c53a0 con 0x7f71980c4a90 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f71980c5960 con 0x7f719806eca0 2024-03-18T15:01:18.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34858/0 (socket says 172.21.15.152:34858) 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 -- 172.21.15.152:0/4246843502 learned_addr learned my addr 172.21.15.152:0/4246843502 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f718ffff640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 0x7f71980c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719659c640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f719806eca0 0x7f719814c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 -- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f719806eca0 msgr2=0x7f719814c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f719806eca0 0x7f719814c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 -- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 msgr2=0x7f71980c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 0x7f71980c8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 -- 172.21.15.152:0/4246843502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71980c8680 con 0x7f71981589a0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f718ffff640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 0x7f71980c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f7196d9d640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f719000ea00 tx=0x7f719000eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719000cd80 con 0x7f71981589a0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7190003990 con 0x7f71981589a0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7198154960 con 0x7f71981589a0 2024-03-18T15:01:18.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.802+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190003dc0 con 0x7f71981589a0 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.803+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7198154f20 con 0x7f71981589a0 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.804+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719804f540 con 0x7f71981589a0 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.804+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f71900050d0 con 0x7f71981589a0 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.804+0000 7f718effd640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 0x7f717806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.805+0000 7f719659c640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 0x7f717806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:18.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.805+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f719008cfe0 con 0x7f71981589a0 2024-03-18T15:01:18.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.805+0000 7f719659c640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 0x7f717806e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7188006fd0 tx=0x7f7188008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:18.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.809+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7190016020 con 0x7f71981589a0 2024-03-18T15:01:18.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.984+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7198073520 con 0x7f71981589a0 2024-03-18T15:01:18.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.984+0000 7f718effd640 1 -- 172.21.15.152:0/4246843502 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f719005bb60 con 0x7f71981589a0 2024-03-18T15:01:18.985 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 msgr2=0x7f717806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 0x7f717806e090 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7188006fd0 tx=0x7f7188008040 comp rx=0 tx=0).stop 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 msgr2=0x7f71980c9160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f719000ea00 tx=0x7f719000eec0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 shutdown_connections 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f71981589a0 0x7f71980c9160 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71980c4a90 0x7f71980c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f717806bbd0 0x7f717806e090 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 --2- 172.21.15.152:0/4246843502 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f719806eca0 0x7f719814c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:18.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.986+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 >> 172.21.15.152:0/4246843502 conn(0x7f71980cfbf0 msgr2=0x7f71980c5ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:18.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.987+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 shutdown_connections 2024-03-18T15:01:18.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:18.987+0000 7f719cb37640 1 -- 172.21.15.152:0/4246843502 wait complete. 2024-03-18T15:01:18.998 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:19.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.102+0000 7f4f5bac6640 1 Processor -- start 2024-03-18T15:01:19.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.102+0000 7f4f5bac6640 1 -- start start 2024-03-18T15:01:19.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f5bac6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4f540cc5b0 0x7f4f5406b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.106 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f5bac6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f54071ee0 con 0x7f4f540b0150 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f5bac6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4f540721c0 con 0x7f4f5406b1c0 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f5bac6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4f54072af0 con 0x7f4f540cc5b0 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f59862640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f4f540b0150 0x7f4f540ce970 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37402/0 (socket says 172.21.15.152:37402) 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f59862640 1 -- 172.21.15.152:0/1521872270 learned_addr learned my addr 172.21.15.152:0/1521872270 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4186911662 0 0) 0x7f4f54071ee0 con 0x7f4f540b0150 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4f40003520 con 0x7f4f540b0150 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.103+0000 7f4f5a063640 1 --2- 172.21.15.152:0/1521872270 >> v2:172.21.15.186:3300/0 conn(0x7f4f540cc5b0 0x7f4f5406b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1822466083 0 0) 0x7f4f40003520 con 0x7f4f540b0150 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 >> v2:172.21.15.186:3300/0 conn(0x7f4f540cc5b0 msgr2=0x7f4f5406b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 --2- 172.21.15.152:0/1521872270 >> v2:172.21.15.186:3300/0 conn(0x7f4f540cc5b0 0x7f4f5406b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 >> v1:172.21.15.186:6789/0 conn(0x7f4f5406b1c0 legacy=0x7f4f5415da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.107 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f540724a0 con 0x7f4f540b0150 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f4f50001670 con 0x7f4f540b0150 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 >> v1:172.21.15.152:6789/0 conn(0x7f4f540b0150 legacy=0x7f4f540ce970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 0x7f4f40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f40004800 0x7f4f40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f400051c0 0x7f4f4000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4000c130 con 0x7f4f400039b0 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4f4000c2e0 con 0x7f4f400051c0 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4f4000c4e0 con 0x7f4f40004800 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 0x7f4f40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f5a063640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f400051c0 0x7f4f4000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59061640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f40004800 0x7f4f40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 -- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f40004800 msgr2=0x7f4f40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f40004800 0x7f4f40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.108 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 -- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f400051c0 msgr2=0x7f4f4000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f400051c0 0x7f4f4000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f59862640 1 -- 172.21.15.152:0/1521872270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f40003520 con 0x7f4f400039b0 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f5a063640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f400051c0 0x7f4f4000b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.104+0000 7f4f5a063640 1 -- 172.21.15.152:0/1521872270 reap_dead start 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f59862640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 0x7f4f40003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c240 tx=0x7f4f40005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cd46300040dfd39 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50007cf0 con 0x7f4f400039b0 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f50030070 con 0x7f4f400039b0 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f58860640 1 -- 172.21.15.152:0/1521872270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f50005d70 con 0x7f4f400039b0 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f5bac6640 1 -- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 msgr2=0x7f4f40003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 0x7f4f40003dd0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f4f5000c240 tx=0x7f4f40005830 comp rx=0 tx=0).stop 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f5bac6640 1 -- 172.21.15.152:0/1521872270 shutdown_connections 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.105+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/1521872270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f400039b0 0x7f4f40003dd0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.109 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.106+0000 7f4f5bac6640 1 -- 172.21.15.152:0/1521872270 >> 172.21.15.152:0/1521872270 conn(0x7f4f540d0da0 msgr2=0x7f4f540d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:19.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.106+0000 7f4f5bac6640 1 -- 172.21.15.152:0/1521872270 shutdown_connections 2024-03-18T15:01:19.110 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.106+0000 7f4f5bac6640 1 -- 172.21.15.152:0/1521872270 wait complete. 2024-03-18T15:01:19.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 Processor -- start 2024-03-18T15:01:19.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 -- start start 2024-03-18T15:01:19.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f400039b0 0x7f4f541e9590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f540b0830 0x7f4f540b0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540b0530 con 0x7f4f5414d5d0 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4f540d0900 con 0x7f4f540b0830 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.107+0000 7f4f5bac6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4f540b06b0 con 0x7f4f400039b0 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34880/0 (socket says 172.21.15.152:34880) 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 -- 172.21.15.152:0/718466631 learned_addr learned my addr 172.21.15.152:0/718466631 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f5a063640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f540b0830 0x7f4f540b0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59862640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f400039b0 0x7f4f541e9590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 -- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f400039b0 msgr2=0x7f4f541e9590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f400039b0 0x7f4f541e9590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 -- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f540b0830 msgr2=0x7f4f540b0cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f540b0830 0x7f4f540b0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 -- 172.21.15.152:0/718466631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f5415a850 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f59061640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e4d0 tx=0x7f4f4400e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f440053a0 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4f44018070 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f44003810 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f540ca3a0 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.108+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f540ca920 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.109+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f540b11f0 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.110+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4f440039b0 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.110+0000 7f4f4a7fc640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 0x7f4f3806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.110+0000 7f4f59862640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 0x7f4f3806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.110+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f4f4408a680 con 0x7f4f5414d5d0 2024-03-18T15:01:19.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.111+0000 7f4f59862640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 0x7f4f3806e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f50034000 tx=0x7f4f50039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.115+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4f5415a850 con 0x7f4f5414d5d0 2024-03-18T15:01:19.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.325+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4f5404f540 con 0x7f4f5414d5d0 2024-03-18T15:01:19.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.326+0000 7f4f4a7fc640 1 -- 172.21.15.152:0/718466631 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f4f44059170 con 0x7f4f5414d5d0 2024-03-18T15:01:19.326 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 msgr2=0x7f4f3806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 0x7f4f3806e090 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f4f50034000 tx=0x7f4f50039040 comp rx=0 tx=0).stop 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 msgr2=0x7f4f540c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f4f4400e4d0 tx=0x7f4f4400e990 comp rx=0 tx=0).stop 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 shutdown_connections 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4f540b0830 0x7f4f540b0cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4f5414d5d0 0x7f4f540c8880 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4f3806bbd0 0x7f4f3806e090 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 --2- 172.21.15.152:0/718466631 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4f400039b0 0x7f4f541e9590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 >> 172.21.15.152:0/718466631 conn(0x7f4f540d0da0 msgr2=0x7f4f5415aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:19.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 shutdown_connections 2024-03-18T15:01:19.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.328+0000 7f4f5bac6640 1 -- 172.21.15.152:0/718466631 wait complete. 2024-03-18T15:01:19.339 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:19.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.443+0000 7f0095776640 1 Processor -- start 2024-03-18T15:01:19.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.444+0000 7f0095776640 1 -- start start 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f0095776640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0090161890 0x7f00900d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f0095776640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f00900d1070 0x7f00900b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f0095776640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00900cffe0 con 0x7f00900b4ec0 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f0095776640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f00900cfa20 con 0x7f00900d1070 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f0095776640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f00900cfd00 con 0x7f0090161890 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f00900d1070 0x7f00900b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f00900d1070 0x7f00900b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34888/0 (socket says 172.21.15.152:34888) 2024-03-18T15:01:19.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 -- 172.21.15.152:0/2902155103 learned_addr learned my addr 172.21.15.152:0/2902155103 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:19.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008effd640 1 --2- 172.21.15.152:0/2902155103 >> v2:172.21.15.186:3300/0 conn(0x7f0090161890 0x7f00900d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 -- 172.21.15.152:0/2902155103 >> v2:172.21.15.186:3300/0 conn(0x7f0090161890 msgr2=0x7f00900d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:19.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 --2- 172.21.15.152:0/2902155103 >> v2:172.21.15.186:3300/0 conn(0x7f0090161890 0x7f00900d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 -- 172.21.15.152:0/2902155103 >> v1:172.21.15.186:6789/0 conn(0x7f00900b4ec0 legacy=0x7f00900d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.445+0000 7f008f7fe640 1 -- 172.21.15.152:0/2902155103 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00900cf710 con 0x7f00900d1070 2024-03-18T15:01:19.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.446+0000 7f008f7fe640 1 --2- 172.21.15.152:0/2902155103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900d1070 0x7f00900b6ee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f009006bb90 tx=0x7f008802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=802a60dc3bd2e29a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.446+0000 7f008dffb640 1 -- 172.21.15.152:0/2902155103 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f008802cb20 con 0x7f00900d1070 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.446+0000 7f008dffb640 1 -- 172.21.15.152:0/2902155103 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f008802ccc0 con 0x7f00900d1070 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.446+0000 7f008dffb640 1 -- 172.21.15.152:0/2902155103 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0088034610 con 0x7f00900d1070 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 -- 172.21.15.152:0/2902155103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900d1070 msgr2=0x7f00900b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 --2- 172.21.15.152:0/2902155103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900d1070 0x7f00900b6ee0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f009006bb90 tx=0x7f008802bf80 comp rx=0 tx=0).stop 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 -- 172.21.15.152:0/2902155103 shutdown_connections 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 --2- 172.21.15.152:0/2902155103 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900d1070 0x7f00900b6ee0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 --2- 172.21.15.152:0/2902155103 >> v2:172.21.15.186:3300/0 conn(0x7f0090161890 0x7f00900d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 -- 172.21.15.152:0/2902155103 >> 172.21.15.152:0/2902155103 conn(0x7f00900d4090 msgr2=0x7f00900d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 -- 172.21.15.152:0/2902155103 shutdown_connections 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.447+0000 7f0095776640 1 -- 172.21.15.152:0/2902155103 wait complete. 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.448+0000 7f0095776640 1 Processor -- start 2024-03-18T15:01:19.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.448+0000 7f0095776640 1 -- start start 2024-03-18T15:01:19.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 0x7f00901f51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0090161890 0x7f0090157c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f00900d2220 con 0x7f00900b4ec0 2024-03-18T15:01:19.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f00900b5580 con 0x7f00900d1070 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f0095776640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f00900d23a0 con 0x7f0090161890 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f008effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f008effd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34894/0 (socket says 172.21.15.152:34894) 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f008effd640 1 -- 172.21.15.152:0/228109202 learned_addr learned my addr 172.21.15.152:0/228109202 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f008f7fe640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0090161890 0x7f0090157c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.449+0000 7f008e7fc640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 0x7f00901f51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 -- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0090161890 msgr2=0x7f0090157c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0090161890 0x7f0090157c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 -- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 msgr2=0x7f00901f51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 0x7f00901f51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 -- 172.21.15.152:0/228109202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00901f5940 con 0x7f00900b4ec0 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008e7fc640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 0x7f00901f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:19.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f008effd640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f008400d5f0 tx=0x7f008400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840125f0 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0084019070 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00840129d0 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00901f5c20 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.450+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00901f61e0 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.451+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00900b71e0 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.451+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0084012b70 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.452+0000 7f00777fe640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 0x7f007c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.452+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f008408ad60 con 0x7f00900b4ec0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.452+0000 7f008e7fc640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 0x7f007c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.452+0000 7f008e7fc640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 0x7f007c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0090160a70 tx=0x7f0080009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.456+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f00900b71e0 con 0x7f00900b4ec0 2024-03-18T15:01:19.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.679+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f00900b6fc0 con 0x7f00900b4ec0 2024-03-18T15:01:19.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.679+0000 7f00777fe640 1 -- 172.21.15.152:0/228109202 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f00900b6fc0 con 0x7f00900b4ec0 2024-03-18T15:01:19.680 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:19.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 msgr2=0x7f007c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 0x7f007c06e090 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0090160a70 tx=0x7f0080009040 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 msgr2=0x7f009015a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f008400d5f0 tx=0x7f008400dab0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 shutdown_connections 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f007c06bbd0 0x7f007c06e090 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0090161890 0x7f0090157c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f00900d1070 0x7f00901f51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 --2- 172.21.15.152:0/228109202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f00900b4ec0 0x7f009015a500 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 >> 172.21.15.152:0/228109202 conn(0x7f00900d4090 msgr2=0x7f00900d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 shutdown_connections 2024-03-18T15:01:19.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.682+0000 7f0095776640 1 -- 172.21.15.152:0/228109202 wait complete. 2024-03-18T15:01:19.693 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:19.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.794+0000 7fa2bcb5b640 1 Processor -- start 2024-03-18T15:01:19.795 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.794+0000 7fa2bcb5b640 1 -- start start 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2bcb5b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa2b8162da0 0x7fa2b815f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2bcb5b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b80b3440 con 0x7fa2b80d10d0 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2bcb5b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa2b80d20a0 con 0x7fa2b81622b0 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2bcb5b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa2b80d16c0 con 0x7fa2b8162da0 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2affff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa2b80d10d0 0x7fa2b815ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37418/0 (socket says 172.21.15.152:37418) 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2affff640 1 -- 172.21.15.152:0/646389302 learned_addr learned my addr 172.21.15.152:0/646389302 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:19.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b6d9d640 1 --2- 172.21.15.152:0/646389302 >> v2:172.21.15.186:3300/0 conn(0x7fa2b8162da0 0x7fa2b815f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3229945248 0 0) 0x7fa2b80b3440 con 0x7fa2b80d10d0 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2a4003520 con 0x7fa2b80d10d0 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3216251680 0 0) 0x7fa2b80d20a0 con 0x7fa2b81622b0 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa2b80b3440 con 0x7fa2b81622b0 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b6d9d640 1 -- 172.21.15.152:0/646389302 >> v1:172.21.15.186:6789/0 conn(0x7fa2b81622b0 legacy=0x7fa2b8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b6d9d640 1 -- 172.21.15.152:0/646389302 >> v1:172.21.15.152:6789/0 conn(0x7fa2b80d10d0 legacy=0x7fa2b815ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.795+0000 7fa2b6d9d640 1 -- 172.21.15.152:0/646389302 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b80d2380 con 0x7fa2b8162da0 2024-03-18T15:01:19.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.796+0000 7fa2b6d9d640 1 --2- 172.21.15.152:0/646389302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b815f1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009dc0 tx=0x7fa2b002be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6853d0168bb75d43 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.796+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0039070 con 0x7fa2b8162da0 2024-03-18T15:01:19.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2b002cbb0 con 0x7fa2b8162da0 2024-03-18T15:01:19.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2b5d9b640 1 -- 172.21.15.152:0/646389302 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2b0034440 con 0x7fa2b8162da0 2024-03-18T15:01:19.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/646389302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 msgr2=0x7fa2b815f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/646389302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b815f1a0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0009dc0 tx=0x7fa2b002be00 comp rx=0 tx=0).stop 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/646389302 shutdown_connections 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/646389302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b815f1a0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/646389302 >> 172.21.15.152:0/646389302 conn(0x7fa2b80d4070 msgr2=0x7fa2b80d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/646389302 shutdown_connections 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.797+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/646389302 wait complete. 2024-03-18T15:01:19.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.799+0000 7fa2bcb5b640 1 Processor -- start 2024-03-18T15:01:19.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.799+0000 7fa2bcb5b640 1 -- start start 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 0x7fa2b81607f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b8154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b81631f0 con 0x7fa2b80d10d0 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80d2660 con 0x7fa2b8162da0 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2bcb5b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b80cfc90 con 0x7fa2b81622b0 2024-03-18T15:01:19.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2b659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2b659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34898/0 (socket says 172.21.15.152:34898) 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.800+0000 7fa2b659c640 1 -- 172.21.15.152:0/1147436315 learned_addr learned my addr 172.21.15.152:0/1147436315 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b6d9d640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b8154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2affff640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 0x7fa2b81607f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 -- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 msgr2=0x7fa2b81607f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 0x7fa2b81607f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 -- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 msgr2=0x7fa2b8154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b8154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 -- 172.21.15.152:0/1147436315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b8154c80 con 0x7fa2b80d10d0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2affff640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 0x7fa2b81607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2b659c640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c430 tx=0x7fa2a800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8017070 con 0x7fa2b80d10d0 2024-03-18T15:01:19.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa2a80052f0 con 0x7fa2b80d10d0 2024-03-18T15:01:19.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b8154f60 con 0x7fa2b80d10d0 2024-03-18T15:01:19.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8003830 con 0x7fa2b80d10d0 2024-03-18T15:01:19.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.801+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b8155520 con 0x7fa2b80d10d0 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.802+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b8155720 con 0x7fa2b80d10d0 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.803+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa2a801a070 con 0x7fa2b80d10d0 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.803+0000 7fa2aeffd640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 0x7fa29806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.803+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa2a8089dc0 con 0x7fa2b80d10d0 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.803+0000 7fa2affff640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 0x7fa29806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:19.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.803+0000 7fa2affff640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 0x7fa29806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b2900 tx=0x7fa2a0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:19.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:19.811+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa2b8155720 con 0x7fa2b80d10d0 2024-03-18T15:01:20.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.004+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa2b804f5b0 con 0x7fa2b80d10d0 2024-03-18T15:01:20.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.006+0000 7fa2aeffd640 1 -- 172.21.15.152:0/1147436315 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fa2a8058270 con 0x7fa2b80d10d0 2024-03-18T15:01:20.007 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:20.007 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:20.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 msgr2=0x7fa29806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 0x7fa29806e090 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b2900 tx=0x7fa2a0009040 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 msgr2=0x7fa2b815f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c430 tx=0x7fa2a800c8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 shutdown_connections 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa2b8162da0 0x7fa2b8154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa29806bbd0 0x7fa29806e090 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa2b81622b0 0x7fa2b81607f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 --2- 172.21.15.152:0/1147436315 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa2b80d10d0 0x7fa2b815f4a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 >> 172.21.15.152:0/1147436315 conn(0x7fa2b80d4070 msgr2=0x7fa2b8162690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 shutdown_connections 2024-03-18T15:01:20.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.008+0000 7fa2bcb5b640 1 -- 172.21.15.152:0/1147436315 wait complete. 2024-03-18T15:01:20.019 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:20.020 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:20.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.124+0000 7f20dbeff640 1 Processor -- start 2024-03-18T15:01:20.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20dbeff640 1 -- start start 2024-03-18T15:01:20.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20dbeff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f20d40d1070 0x7f20d40d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20dbeff640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40cffe0 con 0x7f20d4161890 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20dbeff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f20d40cfa20 con 0x7f20d40b4ec0 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20dbeff640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f20d40cfd00 con 0x7f20d40d1070 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20d9c9b640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f20d4161890 0x7f20d40d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37430/0 (socket says 172.21.15.152:37430) 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.125+0000 7f20d9c9b640 1 -- 172.21.15.152:0/2113674785 learned_addr learned my addr 172.21.15.152:0/2113674785 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d949a640 1 --2- 172.21.15.152:0/2113674785 >> v2:172.21.15.186:3300/0 conn(0x7f20d40d1070 0x7f20d40d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 765719029 0 0) 0x7f20d40cffe0 con 0x7f20d4161890 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f20c0003520 con 0x7f20d4161890 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4179677281 0 0) 0x7f20c0003520 con 0x7f20d4161890 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 >> v2:172.21.15.186:3300/0 conn(0x7f20d40d1070 msgr2=0x7f20d40d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 --2- 172.21.15.152:0/2113674785 >> v2:172.21.15.186:3300/0 conn(0x7f20d40d1070 0x7f20d40d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 >> v1:172.21.15.186:6789/0 conn(0x7f20d40b4ec0 legacy=0x7f20d40d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d40cf710 con 0x7f20d4161890 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f20c8001670 con 0x7f20d4161890 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 >> v1:172.21.15.152:6789/0 conn(0x7f20d4161890 legacy=0x7f20d40d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 0x7f20c0003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c0004800 0x7f20c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c00051c0 0x7f20c000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40cfd00 con 0x7f20c00039b0 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20c000c060 con 0x7f20c0004800 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f20c000c260 con 0x7f20c00051c0 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 0x7f20c0003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d949a640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c0004800 0x7f20c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20da49c640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c00051c0 0x7f20c000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 -- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c00051c0 msgr2=0x7f20c000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:20.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20c00051c0 0x7f20c000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 -- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c0004800 msgr2=0x7f20c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c0004800 0x7f20c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20d9c9b640 1 -- 172.21.15.152:0/2113674785 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20c0003520 con 0x7f20c00039b0 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.126+0000 7f20da49c640 1 -- 172.21.15.152:0/2113674785 reap_dead start 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.127+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 0x7f20c0003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c210 tx=0x7f20c0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7dcd08e4490508b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.127+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c8007d30 con 0x7f20c00039b0 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.127+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20c8030070 con 0x7f20c00039b0 2024-03-18T15:01:20.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.127+0000 7f20d8c99640 1 -- 172.21.15.152:0/2113674785 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20c802cda0 con 0x7f20c00039b0 2024-03-18T15:01:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 -- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 msgr2=0x7f20c0003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 0x7f20c0003dd0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f20c800c210 tx=0x7f20c0005830 comp rx=0 tx=0).stop 2024-03-18T15:01:20.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 -- 172.21.15.152:0/2113674785 shutdown_connections 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 --2- 172.21.15.152:0/2113674785 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20c00039b0 0x7f20c0003dd0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 -- 172.21.15.152:0/2113674785 >> 172.21.15.152:0/2113674785 conn(0x7f20d40d4090 msgr2=0x7f20d40d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 -- 172.21.15.152:0/2113674785 shutdown_connections 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.128+0000 7f20dbeff640 1 -- 172.21.15.152:0/2113674785 wait complete. 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.129+0000 7f20dbeff640 1 Processor -- start 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.129+0000 7f20dbeff640 1 -- start start 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c00039b0 0x7f20d4159b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d41565e0 0x7f20d4155110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40d4bb0 con 0x7f20d4151620 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f20d40b5580 con 0x7f20c00039b0 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20dbeff640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f20d40d4d30 con 0x7f20d41565e0 2024-03-18T15:01:20.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34904/0 (socket says 172.21.15.152:34904) 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 -- 172.21.15.152:0/1574640589 learned_addr learned my addr 172.21.15.152:0/1574640589 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c00039b0 0x7f20d4159b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20da49c640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d41565e0 0x7f20d4155110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 -- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d41565e0 msgr2=0x7f20d4155110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d41565e0 0x7f20d4155110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 -- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c00039b0 msgr2=0x7f20d4159b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c00039b0 0x7f20d4159b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.130+0000 7f20d949a640 1 -- 172.21.15.152:0/1574640589 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20d4156ee0 con 0x7f20d4151620 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20d949a640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20d0011a70 tx=0x7f20d0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d000fb50 con 0x7f20d4151620 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f20d000fcf0 con 0x7f20d4151620 2024-03-18T15:01:20.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20d41571c0 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20d000fea0 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.131+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20d4157780 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.132+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20d404f540 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.132+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f20d0012040 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.133+0000 7f20c67fc640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 0x7f20b806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.133+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f20d008b360 con 0x7f20d4151620 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.133+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 0x7f20b806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.133+0000 7f20d9c9b640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 0x7f20b806e0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f20c8034000 tx=0x7f20c8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.137 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.137+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f20d0019030 con 0x7f20d4151620 2024-03-18T15:01:20.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.315+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f20d40cb950 con 0x7f20d4151620 2024-03-18T15:01:20.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.316+0000 7f20c67fc640 1 -- 172.21.15.152:0/1574640589 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f20d00598e0 con 0x7f20d4151620 2024-03-18T15:01:20.316 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:20.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 msgr2=0x7f20b806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 0x7f20b806e0c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f20c8034000 tx=0x7f20c8009030 comp rx=0 tx=0).stop 2024-03-18T15:01:20.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 msgr2=0x7f20d415c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f20d0011a70 tx=0x7f20d0011f30 comp rx=0 tx=0).stop 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 shutdown_connections 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f20b806bc00 0x7f20b806e0c0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f20d41565e0 0x7f20d4155110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f20d4151620 0x7f20d415c690 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 --2- 172.21.15.152:0/1574640589 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f20c00039b0 0x7f20d4159b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 >> 172.21.15.152:0/1574640589 conn(0x7f20d40d4090 msgr2=0x7f20d40d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 shutdown_connections 2024-03-18T15:01:20.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.318+0000 7f20dbeff640 1 -- 172.21.15.152:0/1574640589 wait complete. 2024-03-18T15:01:20.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:20.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.437+0000 7fd6984dc640 1 Processor -- start 2024-03-18T15:01:20.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.437+0000 7fd6984dc640 1 -- start start 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd6984dc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd6900ce840 0x7fd6900ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd6984dc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 0x7fd6900b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd6984dc640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6900cce20 con 0x7fd69015c140 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd6984dc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd6900cf1e0 con 0x7fd6900ce840 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd6984dc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd6900cd100 con 0x7fd6900b7110 2024-03-18T15:01:20.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd695a77640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd6900ce840 0x7fd6900ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd696278640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd69015c140 0x7fd6900d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37434/0 (socket says 172.21.15.152:37434) 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.438+0000 7fd696278640 1 -- 172.21.15.152:0/1329569864 learned_addr learned my addr 172.21.15.152:0/1329569864 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd696a79640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 0x7fd6900b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695a77640 1 -- 172.21.15.152:0/1329569864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 msgr2=0x7fd6900b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695a77640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 0x7fd6900b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695a77640 1 -- 172.21.15.152:0/1329569864 >> v1:172.21.15.152:6789/0 conn(0x7fd69015c140 legacy=0x7fd6900d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695a77640 1 -- 172.21.15.152:0/1329569864 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6900cd3e0 con 0x7fd6900ce840 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695276640 1 -- 172.21.15.152:0/1329569864 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1054865419 0 0) 0x7fd6900cce20 con 0x7fd69015c140 2024-03-18T15:01:20.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd696a79640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 0x7fd6900b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.439+0000 7fd695a77640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900ce840 0x7fd6900ceca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6800097a0 tx=0x7fd68002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e29f815722ccfd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd695276640 1 -- 172.21.15.152:0/1329569864 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680035020 con 0x7fd6900ce840 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd695276640 1 -- 172.21.15.152:0/1329569864 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd680031830 con 0x7fd6900ce840 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd695276640 1 -- 172.21.15.152:0/1329569864 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd680031c00 con 0x7fd6900ce840 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 -- 172.21.15.152:0/1329569864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900ce840 msgr2=0x7fd6900ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900ce840 0x7fd6900ceca0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fd6800097a0 tx=0x7fd68002b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 -- 172.21.15.152:0/1329569864 shutdown_connections 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900b7110 0x7fd6900b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 --2- 172.21.15.152:0/1329569864 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900ce840 0x7fd6900ceca0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 -- 172.21.15.152:0/1329569864 >> 172.21.15.152:0/1329569864 conn(0x7fd69009b160 msgr2=0x7fd6900d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 -- 172.21.15.152:0/1329569864 shutdown_connections 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.440+0000 7fd6984dc640 1 -- 172.21.15.152:0/1329569864 wait complete. 2024-03-18T15:01:20.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.441+0000 7fd6984dc640 1 Processor -- start 2024-03-18T15:01:20.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.441+0000 7fd6984dc640 1 -- start start 2024-03-18T15:01:20.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 0x7fd6900b66f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 0x7fd690148ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900d2710 con 0x7fd6900b7110 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd6900cd9a0 con 0x7fd69015c140 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd6984dc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd6900d2890 con 0x7fd6900ce840 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd696278640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd696278640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34930/0 (socket says 172.21.15.152:34930) 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd696278640 1 -- 172.21.15.152:0/2580653755 learned_addr learned my addr 172.21.15.152:0/2580653755 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd695a77640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 0x7fd6900b66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.442+0000 7fd696a79640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 0x7fd690148ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 -- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 msgr2=0x7fd6900b66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 0x7fd6900b66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 -- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 msgr2=0x7fd690148ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 0x7fd690148ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 -- 172.21.15.152:0/2580653755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6901f22c0 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd695a77640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 0x7fd6900b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696a79640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 0x7fd690148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd696278640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c430 tx=0x7fd68800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6880074e0 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6880047e0 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6901f25a0 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd688004bd0 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.443+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6901f2b60 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.444+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69004f540 con 0x7fd6900b7110 2024-03-18T15:01:20.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.444+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd688011070 con 0x7fd6900b7110 2024-03-18T15:01:20.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.445+0000 7fd686ffd640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 0x7fd67406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.445+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd68808a7c0 con 0x7fd6900b7110 2024-03-18T15:01:20.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.445+0000 7fd695a77640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 0x7fd67406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.445+0000 7fd695a77640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 0x7fd67406e0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd680036000 tx=0x7fd680008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.453+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd688059220 con 0x7fd6900b7110 2024-03-18T15:01:20.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.639+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fd6900ce620 con 0x7fd6900b7110 2024-03-18T15:01:20.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.639+0000 7fd686ffd640 1 -- 172.21.15.152:0/2580653755 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7fd688058b20 con 0x7fd6900b7110 2024-03-18T15:01:20.640 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 msgr2=0x7fd67406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 0x7fd67406e0c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd680036000 tx=0x7fd680008030 comp rx=0 tx=0).stop 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 msgr2=0x7fd6900c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c430 tx=0x7fd68800c8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 shutdown_connections 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69015c140 0x7fd690148ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.641+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd67406bc00 0x7fd67406e0c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.642+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6900ce840 0x7fd6900b66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.642+0000 7fd6984dc640 1 --2- 172.21.15.152:0/2580653755 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6900b7110 0x7fd6900c8f00 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.642+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 >> 172.21.15.152:0/2580653755 conn(0x7fd69009b160 msgr2=0x7fd6900b4dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.642+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 shutdown_connections 2024-03-18T15:01:20.643 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.642+0000 7fd6984dc640 1 -- 172.21.15.152:0/2580653755 wait complete. 2024-03-18T15:01:20.653 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:20.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.756+0000 7f5bb3ff4640 1 Processor -- start 2024-03-18T15:01:20.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.756+0000 7f5bb3ff4640 1 -- start start 2024-03-18T15:01:20.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb3ff4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5bac0d1070 0x7f5bac0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb3ff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 0x7f5bac0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb3ff4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5bac0cffe0 con 0x7f5bac161890 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb3ff4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5bac0cfa20 con 0x7f5bac0d1070 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb3ff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac0cfd00 con 0x7f5bac0b4ec0 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb158f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5bac0d1070 0x7f5bac0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb158f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5bac0d1070 0x7f5bac0d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36064/0 (socket says 172.21.15.152:36064) 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.757+0000 7f5bb158f640 1 -- 172.21.15.152:0/1957874481 learned_addr learned my addr 172.21.15.152:0/1957874481 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb2591640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 0x7f5bac0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb158f640 1 -- 172.21.15.152:0/1957874481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 msgr2=0x7f5bac0b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb158f640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 0x7f5bac0b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb158f640 1 -- 172.21.15.152:0/1957874481 >> v1:172.21.15.186:6789/0 conn(0x7f5bac161890 legacy=0x7f5bac0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb158f640 1 -- 172.21.15.152:0/1957874481 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac0cf710 con 0x7f5bac0d1070 2024-03-18T15:01:20.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.758+0000 7f5bb2591640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 0x7f5bac0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.759+0000 7f5bb158f640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac0d1070 0x7f5bac0d4bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009870 tx=0x7f5b9c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e3488fadd823df server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.759+0000 7f5bb0d8e640 1 -- 172.21.15.152:0/1957874481 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c034070 con 0x7f5bac0d1070 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.759+0000 7f5bb0d8e640 1 -- 172.21.15.152:0/1957874481 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5b9c030840 con 0x7f5bac0d1070 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.759+0000 7f5bb0d8e640 1 -- 172.21.15.152:0/1957874481 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b9c030c10 con 0x7f5bac0d1070 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/1957874481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac0d1070 msgr2=0x7f5bac0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac0d1070 0x7f5bac0d4bb0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5b9c009870 tx=0x7f5b9c02b980 comp rx=0 tx=0).stop 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/1957874481 shutdown_connections 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0b4ec0 0x7f5bac0b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/1957874481 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac0d1070 0x7f5bac0d4bb0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/1957874481 >> 172.21.15.152:0/1957874481 conn(0x7f5bac0d4090 msgr2=0x7f5bac0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/1957874481 shutdown_connections 2024-03-18T15:01:20.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.760+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/1957874481 wait complete. 2024-03-18T15:01:20.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.761+0000 7f5bb3ff4640 1 Processor -- start 2024-03-18T15:01:20.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.761+0000 7f5bb3ff4640 1 -- start start 2024-03-18T15:01:20.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 0x7f5bac155ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 0x7f5bac0cde90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac0d2220 con 0x7f5bac161890 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5bac0b5580 con 0x7f5bac0b4ec0 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5bac0d23a0 con 0x7f5bac0d1070 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36074/0 (socket says 172.21.15.152:36074) 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 -- 172.21.15.152:0/3649344870 learned_addr learned my addr 172.21.15.152:0/3649344870 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb1d90640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 0x7f5bac155ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb158f640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 0x7f5bac0cde90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 -- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 msgr2=0x7f5bac0cde90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 0x7f5bac0cde90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 -- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 msgr2=0x7f5bac155ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 0x7f5bac155ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 -- 172.21.15.152:0/3649344870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bac15e230 con 0x7f5bac161890 2024-03-18T15:01:20.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb1d90640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 0x7f5bac155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb158f640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 0x7f5bac0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb2591640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4007ef0 tx=0x7f5ba400d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba401a070 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ba4003b90 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ba4004030 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bac15bbd0 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.762+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bac15c190 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.764+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bac0b6a10 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.764+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5ba401d070 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.764+0000 7f5ba27fc640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 0x7f5b9006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.764+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f5ba408ac50 con 0x7f5bac161890 2024-03-18T15:01:20.766 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.764+0000 7f5bb1d90640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 0x7f5b9006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:20.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.765+0000 7f5bb1d90640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 0x7f5b9006e0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001660 tx=0x7f5ba8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:20.769 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.769+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5bac0b6a10 con 0x7f5bac161890 2024-03-18T15:01:20.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.948+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5bac0b8160 con 0x7f5bac161890 2024-03-18T15:01:20.949 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.948+0000 7f5ba27fc640 1 -- 172.21.15.152:0/3649344870 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f5ba4090020 con 0x7f5bac161890 2024-03-18T15:01:20.949 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 msgr2=0x7f5b9006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 0x7f5b9006e0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8001660 tx=0x7f5ba8009040 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 msgr2=0x7f5bac156d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f5ba4007ef0 tx=0x7f5ba400d4a0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 shutdown_connections 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5bac161890 0x7f5bac156d00 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5b9006bc00 0x7f5b9006e0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5bac0d1070 0x7f5bac0cde90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 --2- 172.21.15.152:0/3649344870 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5bac0b4ec0 0x7f5bac155ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 >> 172.21.15.152:0/3649344870 conn(0x7f5bac0d4090 msgr2=0x7f5bac0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 shutdown_connections 2024-03-18T15:01:20.952 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:20.951+0000 7f5bb3ff4640 1 -- 172.21.15.152:0/3649344870 wait complete. 2024-03-18T15:01:20.972 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T15:01:20.972 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:21.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.073+0000 7fdb4d5e6640 1 Processor -- start 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.073+0000 7fdb4d5e6640 1 -- start start 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb4d5e6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb4815ad40 0x7fdb480ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb4d5e6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4815ee60 con 0x7fdb480b3400 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb4d5e6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdb4815f140 con 0x7fdb480d07f0 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb4d5e6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdb4815f420 con 0x7fdb4815ad40 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb46ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdb4815ad40 0x7fdb480ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb467fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdb480b3400 0x7fdb480d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38372/0 (socket says 172.21.15.152:38372) 2024-03-18T15:01:21.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.074+0000 7fdb467fc640 1 -- 172.21.15.152:0/449591286 learned_addr learned my addr 172.21.15.152:0/449591286 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.075+0000 7fdb46ffd640 1 -- 172.21.15.152:0/449591286 >> v1:172.21.15.186:6789/0 conn(0x7fdb480d07f0 legacy=0x7fdb480722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.075+0000 7fdb46ffd640 1 -- 172.21.15.152:0/449591286 >> v1:172.21.15.152:6789/0 conn(0x7fdb480b3400 legacy=0x7fdb480d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.075+0000 7fdb45ffb640 1 -- 172.21.15.152:0/449591286 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3701223487 0 0) 0x7fdb4815ee60 con 0x7fdb480b3400 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.075+0000 7fdb46ffd640 1 -- 172.21.15.152:0/449591286 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb4815f700 con 0x7fdb4815ad40 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb46ffd640 1 --2- 172.21.15.152:0/449591286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4815ad40 0x7fdb480ad800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb380097a0 tx=0x7fdb3802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f588a71667049dff server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb45ffb640 1 -- 172.21.15.152:0/449591286 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38035020 con 0x7fdb4815ad40 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb45ffb640 1 -- 172.21.15.152:0/449591286 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb38031830 con 0x7fdb4815ad40 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb45ffb640 1 -- 172.21.15.152:0/449591286 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38031c00 con 0x7fdb4815ad40 2024-03-18T15:01:21.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/449591286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4815ad40 msgr2=0x7fdb480ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/449591286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4815ad40 0x7fdb480ad800 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdb380097a0 tx=0x7fdb3802b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/449591286 shutdown_connections 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/449591286 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb4815ad40 0x7fdb480ad800 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/449591286 >> 172.21.15.152:0/449591286 conn(0x7fdb4806b5e0 msgr2=0x7fdb4806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/449591286 shutdown_connections 2024-03-18T15:01:21.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.076+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/449591286 wait complete. 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 Processor -- start 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 -- start start 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480d07f0 0x7fdb480b0d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815ad40 0x7fdb480b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815eb90 con 0x7fdb480b3400 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdb4815ea10 con 0x7fdb4815ad40 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb4d5e6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdb480b3860 con 0x7fdb480d07f0 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb46ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb46ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36096/0 (socket says 172.21.15.152:36096) 2024-03-18T15:01:21.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.078+0000 7fdb46ffd640 1 -- 172.21.15.152:0/1736246465 learned_addr learned my addr 172.21.15.152:0/1736246465 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 -- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480d07f0 msgr2=0x7fdb480b0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480d07f0 0x7fdb480b0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 -- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815ad40 msgr2=0x7fdb480b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815ad40 0x7fdb480b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 -- 172.21.15.152:0/1736246465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb480af890 con 0x7fdb480b3400 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb46ffd640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098c0 tx=0x7fdb380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38040070 con 0x7fdb480b3400 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdb38039a00 con 0x7fdb480b3400 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb480afb00 con 0x7fdb480b3400 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb38035040 con 0x7fdb480b3400 2024-03-18T15:01:21.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.079+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb480b00c0 con 0x7fdb480b3400 2024-03-18T15:01:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.080+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb480cf070 con 0x7fdb480b3400 2024-03-18T15:01:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.081+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdb38038020 con 0x7fdb480b3400 2024-03-18T15:01:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.081+0000 7fdb2f7fe640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 0x7fdb3406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.081+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fdb380ac440 con 0x7fdb480b3400 2024-03-18T15:01:21.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.081+0000 7fdb467fc640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 0x7fdb3406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.082+0000 7fdb467fc640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 0x7fdb3406e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007fd0 tx=0x7fdb3c007900 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.085 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.085+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdb480cf070 con 0x7fdb480b3400 2024-03-18T15:01:21.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.265+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fdb480b08a0 con 0x7fdb480b3400 2024-03-18T15:01:21.267 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.266+0000 7fdb2f7fe640 1 -- 172.21.15.152:0/1736246465 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fdb480b08a0 con 0x7fdb480b3400 2024-03-18T15:01:21.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:21.267 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 msgr2=0x7fdb3406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 0x7fdb3406e090 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdb3c007fd0 tx=0x7fdb3c007900 comp rx=0 tx=0).stop 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 msgr2=0x7fdb48141680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fdb380098c0 tx=0x7fdb380046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 shutdown_connections 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdb4815ad40 0x7fdb480b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdb3406bbd0 0x7fdb3406e090 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.269 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdb480d07f0 0x7fdb480b0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 --2- 172.21.15.152:0/1736246465 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdb480b3400 0x7fdb48141680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 >> 172.21.15.152:0/1736246465 conn(0x7fdb4806b5e0 msgr2=0x7fdb48155ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 shutdown_connections 2024-03-18T15:01:21.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.268+0000 7fdb4d5e6640 1 -- 172.21.15.152:0/1736246465 wait complete. 2024-03-18T15:01:21.280 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:21.280 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:21.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.383+0000 7f0f178dc640 1 Processor -- start 2024-03-18T15:01:21.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.384+0000 7f0f178dc640 1 -- start start 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.384+0000 7f0f178dc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0f10161890 0x7f0f100d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.384+0000 7f0f178dc640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f100cffe0 con 0x7f0f100b4ec0 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.384+0000 7f0f178dc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f100cfa20 con 0x7f0f100d1070 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.384+0000 7f0f178dc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0f100cfd00 con 0x7f0f10161890 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f14e77640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0f100b4ec0 0x7f0f100d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38384/0 (socket says 172.21.15.152:38384) 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f14e77640 1 -- 172.21.15.152:0/800673874 learned_addr learned my addr 172.21.15.152:0/800673874 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:21.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3110585434 0 0) 0x7f0f100cffe0 con 0x7f0f100b4ec0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f15678640 1 --2- 172.21.15.152:0/800673874 >> v2:172.21.15.186:3300/0 conn(0x7f0f10161890 0x7f0f100d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0efc003520 con 0x7f0f100b4ec0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2893528988 0 0) 0x7f0efc003520 con 0x7f0f100b4ec0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 >> v2:172.21.15.186:3300/0 conn(0x7f0f10161890 msgr2=0x7f0f100d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 --2- 172.21.15.152:0/800673874 >> v2:172.21.15.186:3300/0 conn(0x7f0f10161890 0x7f0f100d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 >> v1:172.21.15.186:6789/0 conn(0x7f0f100d1070 legacy=0x7f0f100d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f100cf710 con 0x7f0f100b4ec0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f0f00001670 con 0x7f0f100b4ec0 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 >> v1:172.21.15.152:6789/0 conn(0x7f0f100b4ec0 legacy=0x7f0f100d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0efc0039b0 0x7f0efc003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0efc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0efc0051c0 0x7f0efc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f100cfd00 con 0x7f0efc004800 2024-03-18T15:01:21.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0efc00c110 con 0x7f0efc0039b0 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0efc00c310 con 0x7f0efc0051c0 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f14e77640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0efc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f15678640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0efc0039b0 0x7f0efc003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.385+0000 7f0f15e79640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0efc0051c0 0x7f0efc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 -- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0efc0051c0 msgr2=0x7f0efc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0efc0051c0 0x7f0efc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 -- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0efc0039b0 msgr2=0x7f0efc003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0efc0039b0 0x7f0efc003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 -- 172.21.15.152:0/800673874 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0efc003520 con 0x7f0efc004800 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f15e79640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0efc0051c0 0x7f0efc00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f15e79640 1 -- 172.21.15.152:0/800673874 reap_dead start 2024-03-18T15:01:21.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f14e77640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0efc004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c240 tx=0x7f0efc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42eea50b77732b6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.386+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f00007d10 con 0x7f0efc004800 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f00030070 con 0x7f0efc004800 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f07fff640 1 -- 172.21.15.152:0/800673874 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f0002cdc0 con 0x7f0efc004800 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 -- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 msgr2=0x7f0efc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0efc004c80 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0f0000c240 tx=0x7f0efc005830 comp rx=0 tx=0).stop 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 -- 172.21.15.152:0/800673874 shutdown_connections 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 --2- 172.21.15.152:0/800673874 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0efc004c80 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 -- 172.21.15.152:0/800673874 >> 172.21.15.152:0/800673874 conn(0x7f0f100d4090 msgr2=0x7f0f100d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 -- 172.21.15.152:0/800673874 shutdown_connections 2024-03-18T15:01:21.391 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.387+0000 7f0f178dc640 1 -- 172.21.15.152:0/800673874 wait complete. 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.388+0000 7f0f178dc640 1 Processor -- start 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.388+0000 7f0f178dc640 1 -- start start 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 0x7f0f100ce1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 0x7f0f1015d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0f100d4bb0 con 0x7f0efc004800 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0f100b5580 con 0x7f0f1015d500 2024-03-18T15:01:21.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f178dc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0f100d4d30 con 0x7f0f100cdd70 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f15678640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f15678640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36108/0 (socket says 172.21.15.152:36108) 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f15678640 1 -- 172.21.15.152:0/2273411354 learned_addr learned my addr 172.21.15.152:0/2273411354 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f15e79640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 0x7f0f1015d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f14e77640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 0x7f0f100ce1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.389+0000 7f0f15678640 1 -- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 msgr2=0x7f0f100ce1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15678640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 0x7f0f100ce1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15678640 1 -- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 msgr2=0x7f0f1015d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15678640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 0x7f0f1015d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15678640 1 -- 172.21.15.152:0/2273411354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f1015b540 con 0x7f0efc004800 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15e79640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 0x7f0f1015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f14e77640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 0x7f0f100ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:21.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f15678640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f08003ef0 tx=0x7f0f08007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08015420 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f0801a070 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f1015b820 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f08015800 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.390+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f1015bde0 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.391+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f10154f00 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.392+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0f080159a0 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.392+0000 7f0f05ffb640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 0x7f0ef406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.392+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0f0808b6b0 con 0x7f0efc004800 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.392+0000 7f0f14e77640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 0x7f0ef406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.392+0000 7f0f14e77640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 0x7f0ef406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f00034000 tx=0x7f0f00039040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.401 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.400+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0f08024020 con 0x7f0efc004800 2024-03-18T15:01:21.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.572+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0f1004f540 con 0x7f0efc004800 2024-03-18T15:01:21.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.572+0000 7f0f05ffb640 1 -- 172.21.15.152:0/2273411354 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f0f0805a230 con 0x7f0efc004800 2024-03-18T15:01:21.573 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:21.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 msgr2=0x7f0ef406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 0x7f0ef406e090 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f0f00034000 tx=0x7f0f00039040 comp rx=0 tx=0).stop 2024-03-18T15:01:21.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 msgr2=0x7f0f100c97c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f0f08003ef0 tx=0x7f0f08007700 comp rx=0 tx=0).stop 2024-03-18T15:01:21.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 shutdown_connections 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0f1015d500 0x7f0f1015d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0ef406bbd0 0x7f0ef406e090 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0f100cdd70 0x7f0f100ce1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.574+0000 7f0f178dc640 1 --2- 172.21.15.152:0/2273411354 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0efc004800 0x7f0f100c97c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.575+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 >> 172.21.15.152:0/2273411354 conn(0x7f0f100d4090 msgr2=0x7f0f100b8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.575+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 shutdown_connections 2024-03-18T15:01:21.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.575+0000 7f0f178dc640 1 -- 172.21.15.152:0/2273411354 wait complete. 2024-03-18T15:01:21.586 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:21.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.692+0000 7f36d6412640 1 Processor -- start 2024-03-18T15:01:21.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.692+0000 7f36d6412640 1 -- start start 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d6412640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d00d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d6412640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36d00d1070 0x7f36d00b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d6412640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36d00cffe0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d6412640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f36d00cfa20 con 0x7f36d00d1070 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d6412640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f36d00cfd00 con 0x7f36d0161890 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d49af640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f36d00d1070 0x7f36d00b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36cf7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f36d00b4ec0 0x7f36d00d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38396/0 (socket says 172.21.15.152:38396) 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36cf7fe640 1 -- 172.21.15.152:0/3165825064 learned_addr learned my addr 172.21.15.152:0/3165825064 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36cffff640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d00d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d49af640 1 -- 172.21.15.152:0/3165825064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 msgr2=0x7f36d00d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d49af640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d00d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d49af640 1 -- 172.21.15.152:0/3165825064 >> v1:172.21.15.152:6789/0 conn(0x7f36d00b4ec0 legacy=0x7f36d00d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36d49af640 1 -- 172.21.15.152:0/3165825064 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d00cf710 con 0x7f36d00d1070 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36ceffd640 1 -- 172.21.15.152:0/3165825064 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1424044048 0 0) 0x7f36d00cffe0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.693+0000 7f36cffff640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d00d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.694+0000 7f36d49af640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00d1070 0x7f36d00b6ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009d90 tx=0x7f36c802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f71326c2b862ccf1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.694+0000 7f36ceffd640 1 -- 172.21.15.152:0/3165825064 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8039070 con 0x7f36d00d1070 2024-03-18T15:01:21.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.694+0000 7f36ceffd640 1 -- 172.21.15.152:0/3165825064 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36c802cc50 con 0x7f36d00d1070 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.694+0000 7f36ceffd640 1 -- 172.21.15.152:0/3165825064 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36c8034440 con 0x7f36d00d1070 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 -- 172.21.15.152:0/3165825064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00d1070 msgr2=0x7f36d00b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00d1070 0x7f36d00b6ee0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f36c8009d90 tx=0x7f36c802bea0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 -- 172.21.15.152:0/3165825064 shutdown_connections 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00d1070 0x7f36d00b6ee0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 --2- 172.21.15.152:0/3165825064 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d00d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 -- 172.21.15.152:0/3165825064 >> 172.21.15.152:0/3165825064 conn(0x7f36d00d4090 msgr2=0x7f36d00d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 -- 172.21.15.152:0/3165825064 shutdown_connections 2024-03-18T15:01:21.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.695+0000 7f36d6412640 1 -- 172.21.15.152:0/3165825064 wait complete. 2024-03-18T15:01:21.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.696+0000 7f36d6412640 1 Processor -- start 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.696+0000 7f36d6412640 1 -- start start 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 0x7f36d01f41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d015b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f36d00d2220 con 0x7f36d00b4ec0 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f36d00b5580 con 0x7f36d00d1070 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d6412640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f36d00d23a0 con 0x7f36d0161890 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36122/0 (socket says 172.21.15.152:36122) 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 -- 172.21.15.152:0/1888029196 learned_addr learned my addr 172.21.15.152:0/1888029196 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:21.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36d49af640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d015b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cf7fe640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 0x7f36d01f41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 -- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 msgr2=0x7f36d015b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d015b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 -- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 msgr2=0x7f36d01f41a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 0x7f36d01f41a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 -- 172.21.15.152:0/1888029196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36d01587d0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cf7fe640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 0x7f36d01f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.697+0000 7f36cffff640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d800 tx=0x7f36b800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.698+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b8004030 con 0x7f36d00b4ec0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.698+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36d0158ab0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.698+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36b80041d0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.698+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36b80096a0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.698+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36d0159070 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.699+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36d004f540 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.700+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f36b8009840 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.700+0000 7f36ccff9640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 0x7f36b006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.700+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f36b808acc0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.700+0000 7f36cf7fe640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 0x7f36b006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:21.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.700+0000 7f36cf7fe640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 0x7f36b006e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ce160 tx=0x7f36c0007c10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:21.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.709+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f36b8059730 con 0x7f36d00b4ec0 2024-03-18T15:01:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.910+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f36d008d7e0 con 0x7f36d00b4ec0 2024-03-18T15:01:21.911 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.910+0000 7f36ccff9640 1 -- 172.21.15.152:0/1888029196 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f36b8059030 con 0x7f36d00b4ec0 2024-03-18T15:01:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 msgr2=0x7f36b006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 0x7f36b006e0c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f36d00ce160 tx=0x7f36c0007c10 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 msgr2=0x7f36d0156760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f36b800d800 tx=0x7f36b800dcc0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 shutdown_connections 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f36b006bc00 0x7f36b006e0c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f36d0161890 0x7f36d015b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f36d00d1070 0x7f36d01f41a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 --2- 172.21.15.152:0/1888029196 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f36d00b4ec0 0x7f36d0156760 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 >> 172.21.15.152:0/1888029196 conn(0x7f36d00d4090 msgr2=0x7f36d00d0200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 shutdown_connections 2024-03-18T15:01:21.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:21.913+0000 7f36d6412640 1 -- 172.21.15.152:0/1888029196 wait complete. 2024-03-18T15:01:21.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.028+0000 7ff230d62640 1 Processor -- start 2024-03-18T15:01:22.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.028+0000 7ff230d62640 1 -- start start 2024-03-18T15:01:22.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff230d62640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff22c161890 0x7ff22c0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff230d62640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff22c0d1070 0x7ff22c0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff230d62640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff22c0cffe0 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff230d62640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff22c0cfa20 con 0x7ff22c0d1070 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff230d62640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff22c0cfd00 con 0x7ff22c161890 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff22c0d1070 0x7ff22c0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff22c0d1070 0x7ff22c0b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36126/0 (socket says 172.21.15.152:36126) 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 -- 172.21.15.152:0/1388051140 learned_addr learned my addr 172.21.15.152:0/1388051140 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 -- 172.21.15.152:0/1388051140 >> v2:172.21.15.186:3300/0 conn(0x7ff22c161890 msgr2=0x7ff22c0d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 --2- 172.21.15.152:0/1388051140 >> v2:172.21.15.186:3300/0 conn(0x7ff22c161890 0x7ff22c0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 -- 172.21.15.152:0/1388051140 >> v1:172.21.15.186:6789/0 conn(0x7ff22c0b4ec0 legacy=0x7ff22c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:22.031 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.029+0000 7ff22ad9d640 1 -- 172.21.15.152:0/1388051140 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c0cf710 con 0x7ff22c0d1070 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.030+0000 7ff22ad9d640 1 --2- 172.21.15.152:0/1388051140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0d1070 0x7ff22c0b6ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff22c06bb90 tx=0x7ff21c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f026a28b305be5a6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.030+0000 7ff22959a640 1 -- 172.21.15.152:0/1388051140 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c02ca80 con 0x7ff22c0d1070 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.030+0000 7ff22959a640 1 -- 172.21.15.152:0/1388051140 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21c02cc20 con 0x7ff22c0d1070 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.030+0000 7ff22959a640 1 -- 172.21.15.152:0/1388051140 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff21c0343f0 con 0x7ff22c0d1070 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 -- 172.21.15.152:0/1388051140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0d1070 msgr2=0x7ff22c0b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 --2- 172.21.15.152:0/1388051140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0d1070 0x7ff22c0b6ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ff22c06bb90 tx=0x7ff21c02bee0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 -- 172.21.15.152:0/1388051140 shutdown_connections 2024-03-18T15:01:22.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 --2- 172.21.15.152:0/1388051140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0d1070 0x7ff22c0b6ee0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 --2- 172.21.15.152:0/1388051140 >> v2:172.21.15.186:3300/0 conn(0x7ff22c161890 0x7ff22c0d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 -- 172.21.15.152:0/1388051140 >> 172.21.15.152:0/1388051140 conn(0x7ff22c0d4090 msgr2=0x7ff22c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 -- 172.21.15.152:0/1388051140 shutdown_connections 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.031+0000 7ff230d62640 1 -- 172.21.15.152:0/1388051140 wait complete. 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.033+0000 7ff230d62640 1 Processor -- start 2024-03-18T15:01:22.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.033+0000 7ff230d62640 1 -- start start 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 0x7ff22c157780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22c161890 0x7ff22c157cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c0d2220 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff22c0b5580 con 0x7ff22c0d1070 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff230d62640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff22c0d23a0 con 0x7ff22c161890 2024-03-18T15:01:22.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff22a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff22a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36142/0 (socket says 172.21.15.152:36142) 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.034+0000 7ff22a59c640 1 -- 172.21.15.152:0/3331229528 learned_addr learned my addr 172.21.15.152:0/3331229528 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22ad9d640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22c161890 0x7ff22c157cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff229d9b640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 0x7ff22c157780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 -- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22c161890 msgr2=0x7ff22c157cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22c161890 0x7ff22c157cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 -- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 msgr2=0x7ff22c157780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 0x7ff22c157780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 -- 172.21.15.152:0/3331229528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff22c0c9f50 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff229d9b640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 0x7ff22c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff22a59c640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff22400b440 tx=0x7ff22400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.038 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224015020 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff224011890 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff224011c80 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff22c0ca230 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.035+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff22c0cbf40 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.036+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff22c04f540 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.039 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.037+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff224018020 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.037+0000 7ff21affd640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 0x7ff20c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.037+0000 7ff229d9b640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 0x7ff20c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.037+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7ff22408acb0 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.040 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.038+0000 7ff229d9b640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 0x7ff20c06e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff220009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.042 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.041+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff22401f020 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.219+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff22c08d7e0 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.220+0000 7ff21affd640 1 -- 172.21.15.152:0/3331229528 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7ff22400d040 con 0x7ff22c0b4ec0 2024-03-18T15:01:22.221 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 msgr2=0x7ff20c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 0x7ff20c06e090 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff220007fd0 tx=0x7ff220009040 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 msgr2=0x7ff22c14a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ff22400b440 tx=0x7ff22400b900 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 shutdown_connections 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff20c06bbd0 0x7ff20c06e090 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff22c161890 0x7ff22c157cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff22c0d1070 0x7ff22c157780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 --2- 172.21.15.152:0/3331229528 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff22c0b4ec0 0x7ff22c14a590 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 >> 172.21.15.152:0/3331229528 conn(0x7ff22c0d4090 msgr2=0x7ff22c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 shutdown_connections 2024-03-18T15:01:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.222+0000 7ff230d62640 1 -- 172.21.15.152:0/3331229528 wait complete. 2024-03-18T15:01:22.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-18T15:01:22.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.334+0000 7f2d9cf22640 1 Processor -- start 2024-03-18T15:01:22.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.334+0000 7f2d9cf22640 1 -- start start 2024-03-18T15:01:22.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d9cf22640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2d9815e5a0 0x7f2d980d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d9cf22640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980d1200 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d9cf22640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2d980d14e0 con 0x7f2d980d1e40 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d9cf22640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f2d980cff90 con 0x7f2d9815e5a0 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d96d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2d980d2d50 0x7f2d980b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38406/0 (socket says 172.21.15.152:38406) 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.335+0000 7f2d96d9d640 1 -- 172.21.15.152:0/2188475817 learned_addr learned my addr 172.21.15.152:0/2188475817 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d9659c640 1 --2- 172.21.15.152:0/2188475817 >> v2:172.21.15.186:3300/0 conn(0x7f2d9815e5a0 0x7f2d980d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048642362 0 0) 0x7f2d980d1200 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2d84003520 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 376437352 0 0) 0x7f2d84003520 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 >> v2:172.21.15.186:3300/0 conn(0x7f2d9815e5a0 msgr2=0x7f2d980d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 --2- 172.21.15.152:0/2188475817 >> v2:172.21.15.186:3300/0 conn(0x7f2d9815e5a0 0x7f2d980d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 >> v1:172.21.15.186:6789/0 conn(0x7f2d980d1e40 legacy=0x7f2d980d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d980d17c0 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f2d900019f0 con 0x7f2d980d2d50 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 >> v1:172.21.15.152:6789/0 conn(0x7f2d980d2d50 legacy=0x7f2d980b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d84003a20 0x7f2d84003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84004800 0x7f2d84004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 0x7f2d8400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8400c160 con 0x7f2d84005230 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d8400c310 con 0x7f2d84003a20 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2d8400c510 con 0x7f2d84004800 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 0x7f2d8400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d9659c640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d84003a20 0x7f2d84003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d8ffff640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84004800 0x7f2d84004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 -- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84004800 msgr2=0x7f2d84004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84004800 0x7f2d84004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 -- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d84003a20 msgr2=0x7f2d84003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d84003a20 0x7f2d84003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.336+0000 7f2d96d9d640 1 -- 172.21.15.152:0/2188475817 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d84003520 con 0x7f2d84005230 2024-03-18T15:01:22.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.337+0000 7f2d96d9d640 1 -- 172.21.15.152:0/2188475817 reap_dead start 2024-03-18T15:01:22.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.337+0000 7f2d96d9d640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 0x7f2d8400b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000a850 tx=0x7f2d84005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de82b0733215909e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.337+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9000a4a0 con 0x7f2d84005230 2024-03-18T15:01:22.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.337+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d90034650 con 0x7f2d84005230 2024-03-18T15:01:22.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.337+0000 7f2d95d9b640 1 -- 172.21.15.152:0/2188475817 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d90034a40 con 0x7f2d84005230 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 -- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 msgr2=0x7f2d8400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 0x7f2d8400b9c0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f2d9000a850 tx=0x7f2d84005830 comp rx=0 tx=0).stop 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 -- 172.21.15.152:0/2188475817 shutdown_connections 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/2188475817 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d84005230 0x7f2d8400b9c0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 -- 172.21.15.152:0/2188475817 >> 172.21.15.152:0/2188475817 conn(0x7f2d980d4060 msgr2=0x7f2d980d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 -- 172.21.15.152:0/2188475817 shutdown_connections 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.338+0000 7f2d9cf22640 1 -- 172.21.15.152:0/2188475817 wait complete. 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.339+0000 7f2d9cf22640 1 Processor -- start 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.339+0000 7f2d9cf22640 1 -- start start 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 0x7f2d9815bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d98160ef0 0x7f2d98161370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d4f10 con 0x7f2d9815c500 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2d980d4d90 con 0x7f2d98160ef0 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9cf22640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2d980b34d0 con 0x7f2d84005230 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36158/0 (socket says 172.21.15.152:36158) 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 -- 172.21.15.152:0/4230170376 learned_addr learned my addr 172.21.15.152:0/4230170376 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9659c640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 0x7f2d9815bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d96d9d640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d98160ef0 0x7f2d98161370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 -- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 msgr2=0x7f2d9815bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 0x7f2d9815bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 -- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d98160ef0 msgr2=0x7f2d98161370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d98160ef0 0x7f2d98161370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d8ffff640 1 -- 172.21.15.152:0/4230170376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d9815ebd0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.340+0000 7f2d9659c640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 0x7f2d9815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d8ffff640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f620 tx=0x7f2d8000fae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d800052e0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2d80018070 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d9815eeb0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d80003810 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.341+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d981618b0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.342+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d9804f5b0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.343+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2d800039b0 con 0x7f2d9815c500 2024-03-18T15:01:22.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.343+0000 7f2d8effd640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 0x7f2d7806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:22.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.343+0000 7f2d9659c640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 0x7f2d7806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:22.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.343+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f2d8008a6c0 con 0x7f2d9815c500 2024-03-18T15:01:22.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.343+0000 7f2d9659c640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 0x7f2d7806e0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009b40 tx=0x7f2d88008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:22.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.347+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2d80059240 con 0x7f2d9815c500 2024-03-18T15:01:22.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.615+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f2d9815db00 con 0x7f2d9815c500 2024-03-18T15:01:22.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.884+0000 7f2d8effd640 1 -- 172.21.15.152:0/4230170376 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v54) ==== 147+0+0 (secure 0 0 0) 0x7f2d80058b40 con 0x7f2d9815c500 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 msgr2=0x7f2d7806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 0x7f2d7806e0c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f2d88009b40 tx=0x7f2d88008040 comp rx=0 tx=0).stop 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 msgr2=0x7f2d9815f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000f620 tx=0x7f2d8000fae0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 shutdown_connections 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2d98160ef0 0x7f2d98161370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2d9815c500 0x7f2d9815f330 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2d7806bc00 0x7f2d7806e0c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 --2- 172.21.15.152:0/4230170376 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2d84005230 0x7f2d9815bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 >> 172.21.15.152:0/4230170376 conn(0x7f2d980d4060 msgr2=0x7f2d9815d2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 shutdown_connections 2024-03-18T15:01:22.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:22.886+0000 7f2d9cf22640 1 -- 172.21.15.152:0/4230170376 wait complete. 2024-03-18T15:01:22.899 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-03-18T15:01:23.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 Processor -- start 2024-03-18T15:01:23.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 -- start start 2024-03-18T15:01:23.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb96415fad0 0x7fb9640ce920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9640cdbe0 0x7fb9640b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9640d00b0 con 0x7fb9640cee60 2024-03-18T15:01:23.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb9640b5170 con 0x7fb9640cdbe0 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.002+0000 7fb96b1c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640cf2a0 con 0x7fb96415fad0 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9640cdbe0 0x7fb9640b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9640cdbe0 0x7fb9640b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36166/0 (socket says 172.21.15.152:36166) 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 -- 172.21.15.152:0/946846966 learned_addr learned my addr 172.21.15.152:0/946846966 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb968f62640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb96415fad0 0x7fb9640ce920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 -- 172.21.15.152:0/946846966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb96415fad0 msgr2=0x7fb9640ce920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb96415fad0 0x7fb9640ce920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 -- 172.21.15.152:0/946846966 >> v1:172.21.15.186:6789/0 conn(0x7fb9640cee60 legacy=0x7fb9640b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.003+0000 7fb969763640 1 -- 172.21.15.152:0/946846966 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640d2ad0 con 0x7fb9640cdbe0 2024-03-18T15:01:23.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.004+0000 7fb969763640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640cdbe0 0x7fb9640b5d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d688612d4d29cc33 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.004+0000 7fb9637fe640 1 -- 172.21.15.152:0/946846966 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c02cb00 con 0x7fb9640cdbe0 2024-03-18T15:01:23.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.004+0000 7fb9637fe640 1 -- 172.21.15.152:0/946846966 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c02cca0 con 0x7fb9640cdbe0 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.004+0000 7fb9637fe640 1 -- 172.21.15.152:0/946846966 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c034610 con 0x7fb9640cdbe0 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 -- 172.21.15.152:0/946846966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640cdbe0 msgr2=0x7fb9640b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640cdbe0 0x7fb9640b5d10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c02bf60 comp rx=0 tx=0).stop 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 -- 172.21.15.152:0/946846966 shutdown_connections 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9640cdbe0 0x7fb9640b5d10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/946846966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb96415fad0 0x7fb9640ce920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 -- 172.21.15.152:0/946846966 >> 172.21.15.152:0/946846966 conn(0x7fb9640d1f10 msgr2=0x7fb9640d2320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 -- 172.21.15.152:0/946846966 shutdown_connections 2024-03-18T15:01:23.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.005+0000 7fb96b1c6640 1 -- 172.21.15.152:0/946846966 wait complete. 2024-03-18T15:01:23.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.006+0000 7fb96b1c6640 1 Processor -- start 2024-03-18T15:01:23.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.006+0000 7fb96b1c6640 1 -- start start 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9640cdbe0 0x7fb964151ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 0x7fb9640b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640ce070 con 0x7fb96415fad0 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb9640b4e00 con 0x7fb9640cee60 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb96b1c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb9640cfcf0 con 0x7fb9640cdbe0 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb969763640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb969763640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36174/0 (socket says 172.21.15.152:36174) 2024-03-18T15:01:23.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.007+0000 7fb969763640 1 -- 172.21.15.152:0/2128049964 learned_addr learned my addr 172.21.15.152:0/2128049964 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb968f62640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9640cdbe0 0x7fb964151ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb963fff640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 0x7fb9640b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 -- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9640cdbe0 msgr2=0x7fb964151ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9640cdbe0 0x7fb964151ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 -- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 msgr2=0x7fb9640b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 0x7fb9640b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 -- 172.21.15.152:0/2128049964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9640c8fe0 con 0x7fb96415fad0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb963fff640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 0x7fb9640b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb969763640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c043020 con 0x7fb96415fad0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb95c02ce50 con 0x7fb96415fad0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95c009510 con 0x7fb96415fad0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9640c9280 con 0x7fb96415fad0 2024-03-18T15:01:23.011 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.008+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9640c9840 con 0x7fb96415fad0 2024-03-18T15:01:23.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.009+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb96404f540 con 0x7fb96415fad0 2024-03-18T15:01:23.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.010+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb95c046020 con 0x7fb96415fad0 2024-03-18T15:01:23.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.010+0000 7fb9617fa640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 0x7fb94806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.010+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fb95c0ad0d0 con 0x7fb96415fad0 2024-03-18T15:01:23.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.010+0000 7fb968f62640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 0x7fb94806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.011+0000 7fb968f62640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 0x7fb94806e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb958009ad0 tx=0x7fb958008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.019+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb95c04d030 con 0x7fb96415fad0 2024-03-18T15:01:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.196+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb9640b5850 con 0x7fb96415fad0 2024-03-18T15:01:23.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.199+0000 7fb9617fa640 1 -- 172.21.15.152:0/2128049964 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) ==== 122+0+0 (secure 0 0 0) 0x7fb95c03c350 con 0x7fb96415fad0 2024-03-18T15:01:23.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.201+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 msgr2=0x7fb94806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.201+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 0x7fb94806e090 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb958009ad0 tx=0x7fb958008040 comp rx=0 tx=0).stop 2024-03-18T15:01:23.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.201+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 msgr2=0x7fb9640b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.201+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fb95c009e50 tx=0x7fb95c004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:23.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 shutdown_connections 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb96415fad0 0x7fb9640b64f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb9640cee60 0x7fb9640b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb94806bbd0 0x7fb94806e090 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 --2- 172.21.15.152:0/2128049964 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9640cdbe0 0x7fb964151ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 >> 172.21.15.152:0/2128049964 conn(0x7fb9640d1f10 msgr2=0x7fb9640b7410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 shutdown_connections 2024-03-18T15:01:23.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.202+0000 7fb96b1c6640 1 -- 172.21.15.152:0/2128049964 wait complete. 2024-03-18T15:01:23.214 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-18T15:01:23.214 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T15:01:23.251 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T15:01:23.299 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-18T15:01:23.299 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:23.299 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:23.315 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:23.315 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:23.370 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:23.370 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:23.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:23.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.567+0000 7fe67586e640 1 Processor -- start 2024-03-18T15:01:23.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.567+0000 7fe67586e640 1 -- start start 2024-03-18T15:01:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe67586e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe670162da0 0x7fe67015f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe67586e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6700b3440 con 0x7fe6700d10d0 2024-03-18T15:01:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe67586e640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe6700d20a0 con 0x7fe6701622b0 2024-03-18T15:01:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe67586e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe6700d16c0 con 0x7fe670162da0 2024-03-18T15:01:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe670162da0 0x7fe67015f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe667fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe6700d10d0 0x7fe67015ea90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38416/0 (socket says 172.21.15.152:38416) 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe670162da0 0x7fe67015f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36184/0 (socket says 172.21.15.152:36184) 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe667fff640 1 -- 172.21.15.152:0/1292455045 learned_addr learned my addr 172.21.15.152:0/1292455045 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66f7fe640 1 -- 172.21.15.152:0/1292455045 >> v1:172.21.15.186:6789/0 conn(0x7fe6701622b0 legacy=0x7fe670162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66f7fe640 1 -- 172.21.15.152:0/1292455045 >> v1:172.21.15.152:6789/0 conn(0x7fe6700d10d0 legacy=0x7fe67015ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66f7fe640 1 -- 172.21.15.152:0/1292455045 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6700d2380 con 0x7fe670162da0 2024-03-18T15:01:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.568+0000 7fe66e7fc640 1 -- 172.21.15.152:0/1292455045 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2701905566 0 0) 0x7fe6700b3440 con 0x7fe6700d10d0 2024-03-18T15:01:23.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe66f7fe640 1 --2- 172.21.15.152:0/1292455045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe670162da0 0x7fe67015f1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe668009dc0 tx=0x7fe66802bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=226361e64bd3a50e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe66e7fc640 1 -- 172.21.15.152:0/1292455045 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668039070 con 0x7fe670162da0 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe66e7fc640 1 -- 172.21.15.152:0/1292455045 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe66802cb20 con 0x7fe670162da0 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe66e7fc640 1 -- 172.21.15.152:0/1292455045 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe668034440 con 0x7fe670162da0 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe67586e640 1 -- 172.21.15.152:0/1292455045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe670162da0 msgr2=0x7fe67015f1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.569+0000 7fe67586e640 1 --2- 172.21.15.152:0/1292455045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe670162da0 0x7fe67015f1a0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe668009dc0 tx=0x7fe66802bd70 comp rx=0 tx=0).stop 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.570+0000 7fe67586e640 1 -- 172.21.15.152:0/1292455045 shutdown_connections 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.570+0000 7fe67586e640 1 --2- 172.21.15.152:0/1292455045 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe670162da0 0x7fe67015f1a0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.570+0000 7fe67586e640 1 -- 172.21.15.152:0/1292455045 >> 172.21.15.152:0/1292455045 conn(0x7fe6700d4070 msgr2=0x7fe6700d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.570+0000 7fe67586e640 1 -- 172.21.15.152:0/1292455045 shutdown_connections 2024-03-18T15:01:23.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.570+0000 7fe67586e640 1 -- 172.21.15.152:0/1292455045 wait complete. 2024-03-18T15:01:23.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 Processor -- start 2024-03-18T15:01:23.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 -- start start 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6700d10d0 0x7fe670155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe670162da0 0x7fe670158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe6701631f0 con 0x7fe6701622b0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe6700d2660 con 0x7fe670162da0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.571+0000 7fe67586e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe6700cfc90 con 0x7fe6700d10d0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36186/0 (socket says 172.21.15.152:36186) 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 -- 172.21.15.152:0/4030723694 learned_addr learned my addr 172.21.15.152:0/4030723694 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe66effd640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6700d10d0 0x7fe670155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe66f7fe640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe670162da0 0x7fe670158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 -- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6700d10d0 msgr2=0x7fe670155e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6700d10d0 0x7fe670155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 -- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe670162da0 msgr2=0x7fe670158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe670162da0 0x7fe670158320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 -- 172.21.15.152:0/4030723694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe67015eb30 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe667fff640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c430 tx=0x7fe65800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6580074e0 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe6580047e0 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe67015ee10 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe658004bd0 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.572+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe67015f6b0 con 0x7fe6701622b0 2024-03-18T15:01:23.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.573+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe67015efe0 con 0x7fe6701622b0 2024-03-18T15:01:23.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.574+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe658011070 con 0x7fe6701622b0 2024-03-18T15:01:23.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.574+0000 7fe66cff9640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 0x7fe65006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.574+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fe65808a6f0 con 0x7fe6701622b0 2024-03-18T15:01:23.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.575+0000 7fe66effd640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 0x7fe65006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.577 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.575+0000 7fe66effd640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 0x7fe65006e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe66000a750 tx=0x7fe660008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.579+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe6580591e0 con 0x7fe6701622b0 2024-03-18T15:01:23.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.758+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe67004f5b0 con 0x7fe6701622b0 2024-03-18T15:01:23.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.759+0000 7fe66cff9640 1 -- 172.21.15.152:0/4030723694 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fe658058ae0 con 0x7fe6701622b0 2024-03-18T15:01:23.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:23.761 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 msgr2=0x7fe65006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 0x7fe65006e090 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe66000a750 tx=0x7fe660008040 comp rx=0 tx=0).stop 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 msgr2=0x7fe6700b4f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe65800c430 tx=0x7fe65800c8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 shutdown_connections 2024-03-18T15:01:23.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe670162da0 0x7fe670158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe6701622b0 0x7fe6700b4f40 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe65006bbd0 0x7fe65006e090 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 --2- 172.21.15.152:0/4030723694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe6700d10d0 0x7fe670155e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 >> 172.21.15.152:0/4030723694 conn(0x7fe6700d4070 msgr2=0x7fe67006bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 shutdown_connections 2024-03-18T15:01:23.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.761+0000 7fe67586e640 1 -- 172.21.15.152:0/4030723694 wait complete. 2024-03-18T15:01:23.773 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:23.774 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:23.878 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.877+0000 7fd4c2187640 1 Processor -- start 2024-03-18T15:01:23.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.877+0000 7fd4c2187640 1 -- start start 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4c2187640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc161890 0x7fd4bc0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4c2187640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4c2187640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd4bc0cffe0 con 0x7fd4bc0d0960 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4c2187640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd4bc0cfa20 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4c2187640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd4bc0cfd00 con 0x7fd4bc161890 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4baffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4baffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36198/0 (socket says 172.21.15.152:36198) 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4baffd640 1 -- 172.21.15.152:0/3938346054 learned_addr learned my addr 172.21.15.152:0/3938346054 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.878+0000 7fd4bb7fe640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc161890 0x7fd4bc0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.879+0000 7fd4baffd640 1 -- 172.21.15.152:0/3938346054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc161890 msgr2=0x7fd4bc0d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:23.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.879+0000 7fd4baffd640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc161890 0x7fd4bc0d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.879+0000 7fd4baffd640 1 -- 172.21.15.152:0/3938346054 >> v1:172.21.15.186:6789/0 conn(0x7fd4bc0d0960 legacy=0x7fd4bc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.881 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.879+0000 7fd4baffd640 1 -- 172.21.15.152:0/3938346054 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc0cf710 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4baffd640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009870 tx=0x7fd4a402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55b276b61856d11c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4ba7fc640 1 -- 172.21.15.152:0/3938346054 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4034070 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4ba7fc640 1 -- 172.21.15.152:0/3938346054 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4a4030840 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4ba7fc640 1 -- 172.21.15.152:0/3938346054 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4a4030c10 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 -- 172.21.15.152:0/3938346054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc0b4ec0 msgr2=0x7fd4bc0b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fd4a4009870 tx=0x7fd4a402b980 comp rx=0 tx=0).stop 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 -- 172.21.15.152:0/3938346054 shutdown_connections 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc0b6ee0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.882 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3938346054 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc161890 0x7fd4bc0d4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.880+0000 7fd4c2187640 1 -- 172.21.15.152:0/3938346054 >> 172.21.15.152:0/3938346054 conn(0x7fd4bc0d4090 msgr2=0x7fd4bc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:23.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.881+0000 7fd4c2187640 1 -- 172.21.15.152:0/3938346054 shutdown_connections 2024-03-18T15:01:23.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.881+0000 7fd4c2187640 1 -- 172.21.15.152:0/3938346054 wait complete. 2024-03-18T15:01:23.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.882+0000 7fd4c2187640 1 Processor -- start 2024-03-18T15:01:23.883 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.882+0000 7fd4c2187640 1 -- start start 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 0x7fd4bc0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc0d0df0 con 0x7fd4bc161890 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd4bc0b5580 con 0x7fd4bc0b4ec0 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd4bc0d0f70 con 0x7fd4bc0d0960 2024-03-18T15:01:23.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36208/0 (socket says 172.21.15.152:36208) 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 -- 172.21.15.152:0/3300676118 learned_addr learned my addr 172.21.15.152:0/3300676118 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bb7fe640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4baffd640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 0x7fd4bc0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 -- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 msgr2=0x7fd4bc0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 0x7fd4bc0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 -- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4bc0b4ec0 msgr2=0x7fd4bc1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 -- 172.21.15.152:0/3300676118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4bc1f4b20 con 0x7fd4bc161890 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4baffd640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 0x7fd4bc0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4bbfff640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400c7a0 tx=0x7fd4b400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b4003b70 con 0x7fd4bc161890 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4b4003d30 con 0x7fd4bc161890 2024-03-18T15:01:23.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4bc15a2a0 con 0x7fd4bc161890 2024-03-18T15:01:23.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4b400aa90 con 0x7fd4bc161890 2024-03-18T15:01:23.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.883+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4bc159de0 con 0x7fd4bc161890 2024-03-18T15:01:23.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.885+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4bc1f4cf0 con 0x7fd4bc161890 2024-03-18T15:01:23.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.885+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd4b400ac30 con 0x7fd4bc161890 2024-03-18T15:01:23.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.885+0000 7fd4b3fff640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 0x7fd49c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:23.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.886+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd4b408a9a0 con 0x7fd4bc161890 2024-03-18T15:01:23.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.886+0000 7fd4bb7fe640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 0x7fd49c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:23.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.886+0000 7fd4bb7fe640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 0x7fd49c06e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009a30 tx=0x7fd4ac008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:23.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:23.892+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd4b40594a0 con 0x7fd4bc161890 2024-03-18T15:01:24.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.070+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd4bc04f540 con 0x7fd4bc161890 2024-03-18T15:01:24.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.070+0000 7fd4b3fff640 1 -- 172.21.15.152:0/3300676118 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fd4b4058da0 con 0x7fd4bc161890 2024-03-18T15:01:24.071 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:24.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 msgr2=0x7fd49c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 0x7fd49c06e090 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fd4ac009a30 tx=0x7fd4ac008040 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 msgr2=0x7fd4bc0ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fd4b400c7a0 tx=0x7fd4b400cc60 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 shutdown_connections 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd4bc161890 0x7fd4bc0ca020 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd49c06bbd0 0x7fd49c06e090 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd4bc0d0960 0x7fd4bc0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 --2- 172.21.15.152:0/3300676118 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd4bc0b4ec0 0x7fd4bc1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 >> 172.21.15.152:0/3300676118 conn(0x7fd4bc0d4090 msgr2=0x7fd4bc149320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 shutdown_connections 2024-03-18T15:01:24.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.073+0000 7fd4c2187640 1 -- 172.21.15.152:0/3300676118 wait complete. 2024-03-18T15:01:24.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:24.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.192+0000 7f89dd7f3640 1 Processor -- start 2024-03-18T15:01:24.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.192+0000 7f89dd7f3640 1 -- start start 2024-03-18T15:01:24.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.193+0000 7f89dd7f3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89d806b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89dd7f3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f89d80b5b80 0x7f89d80b6000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89dd7f3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89d80b0560 con 0x7f89d8072870 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89dd7f3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f89d806bae0 con 0x7f89d80b5b80 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89dd7f3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f89d815e830 con 0x7f89d806b1c0 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d77fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f89d8072870 0x7f89d8072d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38430/0 (socket says 172.21.15.152:38430) 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d77fe640 1 -- 172.21.15.152:0/1316447041 learned_addr learned my addr 172.21.15.152:0/1316447041 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89cffff640 1 --2- 172.21.15.152:0/1316447041 >> v2:172.21.15.186:3300/0 conn(0x7f89d80b5b80 0x7f89d80b6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89d806b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2080614425 0 0) 0x7f89d80b0560 con 0x7f89d8072870 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f89c4003520 con 0x7f89d8072870 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3170910972 0 0) 0x7f89c4003520 con 0x7f89d8072870 2024-03-18T15:01:24.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 msgr2=0x7f89d806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89d806b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 >> v2:172.21.15.186:3300/0 conn(0x7f89d80b5b80 msgr2=0x7f89d80b6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 --2- 172.21.15.152:0/1316447041 >> v2:172.21.15.186:3300/0 conn(0x7f89d80b5b80 0x7f89d80b6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80b07d0 con 0x7f89d8072870 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f89d00019f0 con 0x7f89d8072870 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 >> v1:172.21.15.152:6789/0 conn(0x7f89d8072870 legacy=0x7f89d8072d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89c40039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89c4003f30 0x7f89c4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89c4004d40 0x7f89c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89d806bae0 con 0x7f89c4004d40 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f89d815e830 con 0x7f89c4003f30 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f89c400b9c0 con 0x7f89d806b1c0 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.194+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89c40039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89c4004d40 0x7f89c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89cffff640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89c4003f30 0x7f89c4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 -- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 msgr2=0x7f89c40039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d806b1c0 0x7f89c40039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 -- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89c4003f30 msgr2=0x7f89c4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89c4003f30 0x7f89c4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.195+0000 7f89d77fe640 1 -- 172.21.15.152:0/1316447041 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89c4003520 con 0x7f89c4004d40 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89c4004d40 0x7f89c40051c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f89d00013d0 tx=0x7f89c4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7bc5bdcff776e8a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d000a4e0 con 0x7f89c4004d40 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89d0034650 con 0x7f89c4004d40 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89d67fc640 1 -- 172.21.15.152:0/1316447041 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89d0034a40 con 0x7f89c4004d40 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1316447041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89c4004d40 msgr2=0x7f89c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1316447041 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89c4004d40 0x7f89c40051c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f89d00013d0 tx=0x7f89c4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:24.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89d77fe640 1 -- 172.21.15.152:0/1316447041 reap_dead start 2024-03-18T15:01:24.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1316447041 shutdown_connections 2024-03-18T15:01:24.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1316447041 >> 172.21.15.152:0/1316447041 conn(0x7f89d80d0510 msgr2=0x7f89d80d0920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1316447041 shutdown_connections 2024-03-18T15:01:24.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.196+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1316447041 wait complete. 2024-03-18T15:01:24.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.197+0000 7f89dd7f3640 1 Processor -- start 2024-03-18T15:01:24.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 -- start start 2024-03-18T15:01:24.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 0x7f89d81573b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 0x7f89d8157d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80b1070 con 0x7f89d806ea40 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f89d80b0d90 con 0x7f89d80c62d0 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89dd7f3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f89d80670d0 con 0x7f89d8159000 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89cffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36218/0 (socket says 172.21.15.152:36218) 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.198+0000 7f89cffff640 1 -- 172.21.15.152:0/1599089193 learned_addr learned my addr 172.21.15.152:0/1599089193 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 0x7f89d81573b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 0x7f89d8157d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 -- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 msgr2=0x7f89d81573b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 0x7f89d81573b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 -- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 msgr2=0x7f89d8157d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 0x7f89d8157d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 -- 172.21.15.152:0/1599089193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89d80c4cf0 con 0x7f89d806ea40 2024-03-18T15:01:24.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 0x7f89d81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89d77fe640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 0x7f89d8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.199+0000 7f89cffff640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89c0011960 tx=0x7f89c0011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.201+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c000faf0 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.201+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89d80c4fd0 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.201+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89c000fc90 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.201+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89c0014440 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.201+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89d80c5590 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.202+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89d804f540 con 0x7f89d806ea40 2024-03-18T15:01:24.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.202+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f89c0012040 con 0x7f89d806ea40 2024-03-18T15:01:24.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.203+0000 7f89cf7fe640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 0x7f89b806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.203+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f89c008b0e0 con 0x7f89d806ea40 2024-03-18T15:01:24.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.203+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 0x7f89b806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.203+0000 7f89d6ffd640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 0x7f89b806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89d806e9d0 tx=0x7f89c8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.207+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f89c0019030 con 0x7f89d806ea40 2024-03-18T15:01:24.387 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.386+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f89d806b6d0 con 0x7f89d806ea40 2024-03-18T15:01:24.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.386+0000 7f89cf7fe640 1 -- 172.21.15.152:0/1599089193 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f89c0059be0 con 0x7f89d806ea40 2024-03-18T15:01:24.388 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:24.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 msgr2=0x7f89b806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 0x7f89b806e090 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f89d806e9d0 tx=0x7f89c8008040 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 msgr2=0x7f89d80c5d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f89c0011960 tx=0x7f89c0011e20 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 shutdown_connections 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89d80c62d0 0x7f89d8157d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89d806ea40 0x7f89d80c5d90 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f89b806bbd0 0x7f89b806e090 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 --2- 172.21.15.152:0/1599089193 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89d8159000 0x7f89d81573b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 >> 172.21.15.152:0/1599089193 conn(0x7f89d80d0510 msgr2=0x7f89d80af530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 shutdown_connections 2024-03-18T15:01:24.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.388+0000 7f89dd7f3640 1 -- 172.21.15.152:0/1599089193 wait complete. 2024-03-18T15:01:24.400 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:24.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.507+0000 7f8cedfa9640 1 Processor -- start 2024-03-18T15:01:24.508 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.507+0000 7f8cedfa9640 1 -- start start 2024-03-18T15:01:24.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 0x7f8ce80d09c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ce815eaa0 0x7f8ce80d0f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 0x7f8ce80d1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce80d02f0 con 0x7f8ce815eaa0 2024-03-18T15:01:24.510 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8ce80d4c10 con 0x7f8ce815e6c0 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8cedfa9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce80d4ef0 con 0x7f8ce80b4d80 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ce815eaa0 0x7f8ce80d0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8ce815eaa0 0x7f8ce80d0f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36226/0 (socket says 172.21.15.152:36226) 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3181791668 learned_addr learned my addr 172.21.15.152:0/3181791668 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce7fff640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 0x7f8ce80d1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3181791668 >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 0x7f8ce80d09c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3181791668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 msgr2=0x7f8ce80d1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 0x7f8ce80d1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3181791668 >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 msgr2=0x7f8ce80d09c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3181791668 >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 0x7f8ce80d09c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3181791668 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce80cfaf0 con 0x7f8ce815eaa0 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce7fff640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 0x7f8ce80d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:24.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.508+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3181791668 >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 0x7f8ce80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:24.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.509+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815eaa0 0x7f8ce80d0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b6bf0 tx=0x7f8cdc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca965fc0827a8f70 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.509+0000 7f8ce67fc640 1 -- 172.21.15.152:0/3181791668 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc02e070 con 0x7f8ce815eaa0 2024-03-18T15:01:24.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.509+0000 7f8ce67fc640 1 -- 172.21.15.152:0/3181791668 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc037070 con 0x7f8ce815eaa0 2024-03-18T15:01:24.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.509+0000 7f8ce67fc640 1 -- 172.21.15.152:0/3181791668 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc031a00 con 0x7f8ce815eaa0 2024-03-18T15:01:24.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3181791668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815eaa0 msgr2=0x7f8ce80d0f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815eaa0 0x7f8ce80d0f00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f8ce80b6bf0 tx=0x7f8cdc02b880 comp rx=0 tx=0).stop 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3181791668 shutdown_connections 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce80b4d80 0x7f8ce80d1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3181791668 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815eaa0 0x7f8ce80d0f00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3181791668 >> v2:172.21.15.186:3300/0 conn(0x7f8ce815e6c0 0x7f8ce80d09c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3181791668 >> 172.21.15.152:0/3181791668 conn(0x7f8ce80d40f0 msgr2=0x7f8ce80d4500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3181791668 shutdown_connections 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.510+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3181791668 wait complete. 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.511+0000 7f8cedfa9640 1 Processor -- start 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.511+0000 7f8cedfa9640 1 -- start start 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 0x7f8ce8160350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce815eaa0 0x7f8ce80cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80d18b0 con 0x7f8ce815e6c0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce80cf7c0 con 0x7f8ce80b4d80 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce80d1a30 con 0x7f8ce815eaa0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36230/0 (socket says 172.21.15.152:36230) 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3363383185 learned_addr learned my addr 172.21.15.152:0/3363383185 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 0x7f8ce8160350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce7fff640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce815eaa0 0x7f8ce80cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce815eaa0 msgr2=0x7f8ce80cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce815eaa0 0x7f8ce80cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 msgr2=0x7f8ce8160350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 0x7f8ce8160350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 -- 172.21.15.152:0/3363383185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce80cc4d0 con 0x7f8ce815e6c0 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 0x7f8ce8160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:24.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ce6ffd640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc02b8c0 tx=0x7f8cdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc032880 con 0x7f8ce815e6c0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8cdc032a20 con 0x7f8ce815e6c0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce80cca20 con 0x7f8ce815e6c0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.512+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc032e10 con 0x7f8ce815e6c0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.513+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce80ccfe0 con 0x7f8ce815e6c0 2024-03-18T15:01:24.517 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.514+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce804f540 con 0x7f8ce815e6c0 2024-03-18T15:01:24.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.514+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8cdc0453f0 con 0x7f8ce815e6c0 2024-03-18T15:01:24.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.514+0000 7f8ccffff640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 0x7f8cd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.515+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 0x7f8cd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.515+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f8cdc0acd30 con 0x7f8ce815e6c0 2024-03-18T15:01:24.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.515+0000 7f8ce77fe640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 0x7f8cd406e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a990 tx=0x7f8cd8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.519+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8cdc040070 con 0x7f8ce815e6c0 2024-03-18T15:01:24.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.694+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ce80d4720 con 0x7f8ce815e6c0 2024-03-18T15:01:24.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.694+0000 7f8ccffff640 1 -- 172.21.15.152:0/3363383185 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7f8cdc07b830 con 0x7f8ce815e6c0 2024-03-18T15:01:24.696 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:24.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 msgr2=0x7f8cd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 0x7f8cd406e090 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800a990 tx=0x7f8cd8008040 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 msgr2=0x7f8ce80cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc02b8c0 tx=0x7f8cdc0046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 shutdown_connections 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8cd406bbd0 0x7f8cd406e090 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8ce815eaa0 0x7f8ce80cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8ce815e6c0 0x7f8ce80cd7e0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 --2- 172.21.15.152:0/3363383185 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8ce80b4d80 0x7f8ce8160350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 >> 172.21.15.152:0/3363383185 conn(0x7f8ce80d40f0 msgr2=0x7f8ce80d1ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 shutdown_connections 2024-03-18T15:01:24.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.696+0000 7f8cedfa9640 1 -- 172.21.15.152:0/3363383185 wait complete. 2024-03-18T15:01:24.711 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T15:01:24.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.813+0000 7f51bb145640 1 Processor -- start 2024-03-18T15:01:24.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.813+0000 7f51bb145640 1 -- start start 2024-03-18T15:01:24.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51bb145640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f51b40ae8d0 0x7f51b406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51bb145640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b4071930 con 0x7f51b415e4f0 2024-03-18T15:01:24.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51bb145640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f51b4071c10 con 0x7f51b415e110 2024-03-18T15:01:24.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51bb145640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f51b4071ef0 con 0x7f51b40ae8d0 2024-03-18T15:01:24.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51b3fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f51b415e4f0 0x7f51b406e9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38432/0 (socket says 172.21.15.152:38432) 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.814+0000 7f51b3fff640 1 -- 172.21.15.152:0/1124410270 learned_addr learned my addr 172.21.15.152:0/1124410270 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1124410270 >> v2:172.21.15.186:3300/0 conn(0x7f51b40ae8d0 0x7f51b406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3171977196 0 0) 0x7f51b4071930 con 0x7f51b415e4f0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f51a4003520 con 0x7f51b415e4f0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1925632759 0 0) 0x7f51a4003520 con 0x7f51b415e4f0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 >> v2:172.21.15.186:3300/0 conn(0x7f51b40ae8d0 msgr2=0x7f51b406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 --2- 172.21.15.152:0/1124410270 >> v2:172.21.15.186:3300/0 conn(0x7f51b40ae8d0 0x7f51b406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 >> v1:172.21.15.186:6789/0 conn(0x7f51b415e110 legacy=0x7f51b40cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b40721d0 con 0x7f51b415e4f0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f51a0001670 con 0x7f51b415e4f0 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 >> v1:172.21.15.152:6789/0 conn(0x7f51b415e4f0 legacy=0x7f51b406e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 0x7f51a4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4005230 0x7f51a400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f51b4071ef0 con 0x7f51a4003a20 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51a400c190 con 0x7f51a4005230 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f51a400c390 con 0x7f51a4004800 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 0x7f51a4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b3fff640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4005230 0x7f51a400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 -- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4004800 msgr2=0x7f51a4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51a4004800 0x7f51a4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 -- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4005230 msgr2=0x7f51a400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4005230 0x7f51a400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b8ee1640 1 -- 172.21.15.152:0/1124410270 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51a4003520 con 0x7f51a4003a20 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4005230 0x7f51a400b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.815+0000 7f51b96e2640 1 -- 172.21.15.152:0/1124410270 reap_dead start 2024-03-18T15:01:24.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.816+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 0x7f51a4003e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001750 tx=0x7f51a4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823fb0683db08735 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8001370 con 0x7f51a4003a20 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51a80052d0 con 0x7f51a4003a20 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51b37fe640 1 -- 172.21.15.152:0/1124410270 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51a8003830 con 0x7f51a4003a20 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51bb145640 1 -- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 msgr2=0x7f51a4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51bb145640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 0x7f51a4003e40 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f51a8001750 tx=0x7f51a4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51bb145640 1 -- 172.21.15.152:0/1124410270 shutdown_connections 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51bb145640 1 --2- 172.21.15.152:0/1124410270 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51a4003a20 0x7f51a4003e40 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.817+0000 7f51bb145640 1 -- 172.21.15.152:0/1124410270 >> 172.21.15.152:0/1124410270 conn(0x7f51b40ccfb0 msgr2=0x7f51b40cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.818+0000 7f51bb145640 1 -- 172.21.15.152:0/1124410270 shutdown_connections 2024-03-18T15:01:24.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.818+0000 7f51bb145640 1 -- 172.21.15.152:0/1124410270 wait complete. 2024-03-18T15:01:24.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.819+0000 7f51bb145640 1 Processor -- start 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.819+0000 7f51bb145640 1 -- start start 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4003a20 0x7f51b4152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51b41572c0 0x7f51b4160e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f51b40cf9b0 con 0x7f51b4157740 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f51b40cf830 con 0x7f51a4003a20 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f51b40cfb30 con 0x7f51b41572c0 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36238/0 (socket says 172.21.15.152:36238) 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 -- 172.21.15.152:0/1785726413 learned_addr learned my addr 172.21.15.152:0/1785726413 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:24.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4003a20 0x7f51b4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b3fff640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51b41572c0 0x7f51b4160e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 -- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51b41572c0 msgr2=0x7f51b4160e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51b41572c0 0x7f51b4160e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 -- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4003a20 msgr2=0x7f51b4152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4003a20 0x7f51b4152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 -- 172.21.15.152:0/1785726413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51b4153bb0 con 0x7f51b4157740 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b96e2640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ce8c0 tx=0x7f51ac010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac010e30 con 0x7f51b4157740 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f51ac003990 con 0x7f51b4157740 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51b4153e90 con 0x7f51b4157740 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.820+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51ac003d80 con 0x7f51b4157740 2024-03-18T15:01:24.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.821+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51b4154450 con 0x7f51b4157740 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.821+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51b404f5b0 con 0x7f51b4157740 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.822+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f51ac01e020 con 0x7f51b4157740 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.822+0000 7f51b17fa640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 0x7f519806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.823+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f51ac08af70 con 0x7f51b4157740 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.823+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 0x7f519806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.823+0000 7f51b8ee1640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 0x7f519806e0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51a8033000 tx=0x7f51a8009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:24.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:24.827+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f51ac059380 con 0x7f51b4157740 2024-03-18T15:01:25.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.066+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f51b415c6c0 con 0x7f51b4157740 2024-03-18T15:01:25.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.067+0000 7f51b17fa640 1 -- 172.21.15.152:0/1785726413 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f51ac05d420 con 0x7f51b4157740 2024-03-18T15:01:25.068 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-03-18T15:01:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 msgr2=0x7f519806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 0x7f519806e0c0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f51a8033000 tx=0x7f51a8009030 comp rx=0 tx=0).stop 2024-03-18T15:01:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 msgr2=0x7f51b41613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f51b40ce8c0 tx=0x7f51ac010590 comp rx=0 tx=0).stop 2024-03-18T15:01:25.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 shutdown_connections 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f51b4157740 0x7f51b41613d0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f519806bc00 0x7f519806e0c0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f51b41572c0 0x7f51b4160e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 --2- 172.21.15.152:0/1785726413 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f51a4003a20 0x7f51b4152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 >> 172.21.15.152:0/1785726413 conn(0x7f51b40ccfb0 msgr2=0x7f51b40d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 shutdown_connections 2024-03-18T15:01:25.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.069+0000 7f51bb145640 1 -- 172.21.15.152:0/1785726413 wait complete. 2024-03-18T15:01:25.081 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-18T15:01:25.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:25.081 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2024-03-18T15:01:25.109 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T15:01:25.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:25.110 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-18T15:01:25.173 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:25.173 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:25.192 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:25.192 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:25.250 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:25.250 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:25.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:25.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 Processor -- start 2024-03-18T15:01:25.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 -- start start 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f634c15e5a0 0x7f634c0d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f634c0d1200 con 0x7f634c0d1e40 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f634c0cff90 con 0x7f634c15e5a0 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.408+0000 7f6350c12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f634c0b34d0 con 0x7f634c0d2d50 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f634c15e5a0 0x7f634c0d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f634c15e5a0 0x7f634c0d4b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36248/0 (socket says 172.21.15.152:36248) 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 -- 172.21.15.152:0/2913718783 learned_addr learned my addr 172.21.15.152:0/2913718783 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f6343fff640 1 --1- 172.21.15.152:0/2913718783 >> v1:172.21.15.152:6789/0 conn(0x7f634c0d1e40 0x7f634c0d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38442/0 (socket says 172.21.15.152:38442) 2024-03-18T15:01:25.412 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634ad9d640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 -- 172.21.15.152:0/2913718783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 msgr2=0x7f634c0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 -- 172.21.15.152:0/2913718783 >> v1:172.21.15.152:6789/0 conn(0x7f634c0d1e40 legacy=0x7f634c0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634a59c640 1 -- 172.21.15.152:0/2913718783 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c0d14e0 con 0x7f634c15e5a0 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f6349d9b640 1 -- 172.21.15.152:0/2913718783 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3646383409 0 0) 0x7f634c0d1200 con 0x7f634c0d1e40 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.409+0000 7f634ad9d640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f634a59c640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c15e5a0 0x7f634c0d4b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f633c009870 tx=0x7f633c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f66a281f8d3b8680 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6349d9b640 1 -- 172.21.15.152:0/2913718783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c035020 con 0x7f634c15e5a0 2024-03-18T15:01:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6349d9b640 1 -- 172.21.15.152:0/2913718783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c031640 con 0x7f634c15e5a0 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6349d9b640 1 -- 172.21.15.152:0/2913718783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c02d040 con 0x7f634c15e5a0 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 -- 172.21.15.152:0/2913718783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c15e5a0 msgr2=0x7f634c0d4b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c15e5a0 0x7f634c0d4b80 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f633c009870 tx=0x7f633c02b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 -- 172.21.15.152:0/2913718783 shutdown_connections 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c0b3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 --2- 172.21.15.152:0/2913718783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c15e5a0 0x7f634c0d4b80 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 -- 172.21.15.152:0/2913718783 >> 172.21.15.152:0/2913718783 conn(0x7f634c0d4060 msgr2=0x7f634c0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 -- 172.21.15.152:0/2913718783 shutdown_connections 2024-03-18T15:01:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.410+0000 7f6350c12640 1 -- 172.21.15.152:0/2913718783 wait complete. 2024-03-18T15:01:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 Processor -- start 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 -- start start 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c1f50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 0x7f634c1f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0b4300 con 0x7f634c0d1e40 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f634c0b4180 con 0x7f634c15e5a0 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f6350c12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f634c0b4480 con 0x7f634c0d2d50 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.412+0000 7f634a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36260/0 (socket says 172.21.15.152:36260) 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 -- 172.21.15.152:0/3703872316 learned_addr learned my addr 172.21.15.152:0/3703872316 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6343fff640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c1f50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634ad9d640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 0x7f634c1f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 -- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 msgr2=0x7f634c1f50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c1f50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 -- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 msgr2=0x7f634c1f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 0x7f634c1f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 -- 172.21.15.152:0/3703872316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c1f4280 con 0x7f634c0d1e40 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6343fff640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c1f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634ad9d640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 0x7f634c1f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f634a59c640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c040070 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f633c039bf0 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c1f4560 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f633c035040 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.413+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c1f4b20 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.414+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f634c04f5b0 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.415+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f633c04b060 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.415+0000 7f6342ffd640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.415+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f633c0ac4c0 con 0x7f634c0d1e40 2024-03-18T15:01:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.415+0000 7f6343fff640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.416+0000 7f6343fff640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f634c1e8f10 tx=0x7f6334009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.420+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f633c07b040 con 0x7f634c0d1e40 2024-03-18T15:01:25.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.608+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f634c0b0ef0 con 0x7f634c0d1e40 2024-03-18T15:01:25.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.609+0000 7f6342ffd640 1 -- 172.21.15.152:0/3703872316 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7f633c07a940 con 0x7f634c0d1e40 2024-03-18T15:01:25.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:25.611 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:25.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 msgr2=0x7f632c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 0x7f632c06e090 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f634c1e8f10 tx=0x7f6334009040 comp rx=0 tx=0).stop 2024-03-18T15:01:25.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 msgr2=0x7f634c0cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f633c000c00 tx=0x7f633c0046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.613 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 shutdown_connections 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f634c15e5a0 0x7f634c1f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f632c06bbd0 0x7f632c06e090 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f634c0d2d50 0x7f634c1f50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 --2- 172.21.15.152:0/3703872316 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f634c0d1e40 0x7f634c0cd770 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 >> 172.21.15.152:0/3703872316 conn(0x7f634c0d4060 msgr2=0x7f634c06be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 shutdown_connections 2024-03-18T15:01:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.612+0000 7f6350c12640 1 -- 172.21.15.152:0/3703872316 wait complete. 2024-03-18T15:01:25.624 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:25.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.727+0000 7fd293859640 1 Processor -- start 2024-03-18T15:01:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.727+0000 7fd293859640 1 -- start start 2024-03-18T15:01:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd293859640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd28c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd293859640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c0cda10 con 0x7fd28c072d40 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd293859640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd28c0cdcf0 con 0x7fd28c160170 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd293859640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c0cd7c0 con 0x7fd28c145700 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd290df4640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd28c072d40 0x7fd28c15fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38452/0 (socket says 172.21.15.152:38452) 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.728+0000 7fd290df4640 1 -- 172.21.15.152:0/723410848 learned_addr learned my addr 172.21.15.152:0/723410848 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd2915f5640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd28c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2895892785 0 0) 0x7fd28c0cda10 con 0x7fd28c072d40 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd278003520 con 0x7fd28c072d40 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1010907081 0 0) 0x7fd278003520 con 0x7fd28c072d40 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 msgr2=0x7fd28c06cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd28c06cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 >> v1:172.21.15.186:6789/0 conn(0x7fd28c160170 legacy=0x7fd28c0cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0cdfd0 con 0x7fd28c072d40 2024-03-18T15:01:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fd288001690 con 0x7fd28c072d40 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 >> v1:172.21.15.152:6789/0 conn(0x7fd28c072d40 legacy=0x7fd28c15fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2780039e0 0x7fd278003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd278004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd278004d40 0x7fd2780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0cd7c0 con 0x7fd278004d40 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd27800bb50 con 0x7fd2780039e0 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd27800bd20 con 0x7fd28c145700 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd278004d40 0x7fd2780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd2915f5640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2780039e0 0x7fd278003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd290df4640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd278004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 -- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 msgr2=0x7fd278004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c145700 0x7fd278004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 -- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2780039e0 msgr2=0x7fd278003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd2780039e0 0x7fd278003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.729+0000 7fd291df6640 1 -- 172.21.15.152:0/723410848 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd278003520 con 0x7fd278004d40 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.730+0000 7fd291df6640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd278004d40 0x7fd2780051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd284001f30 tx=0x7fd278005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c701689f3f076e5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.730+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd284001b30 con 0x7fd278004d40 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.730+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd28402d6d0 con 0x7fd278004d40 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.730+0000 7fd283fff640 1 -- 172.21.15.152:0/723410848 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd28402dac0 con 0x7fd278004d40 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 -- 172.21.15.152:0/723410848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd278004d40 msgr2=0x7fd2780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 --2- 172.21.15.152:0/723410848 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd278004d40 0x7fd2780051c0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fd284001f30 tx=0x7fd278005830 comp rx=0 tx=0).stop 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd291df6640 1 -- 172.21.15.152:0/723410848 reap_dead start 2024-03-18T15:01:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 -- 172.21.15.152:0/723410848 shutdown_connections 2024-03-18T15:01:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 -- 172.21.15.152:0/723410848 >> 172.21.15.152:0/723410848 conn(0x7fd28c0cfbf0 msgr2=0x7fd28c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 -- 172.21.15.152:0/723410848 shutdown_connections 2024-03-18T15:01:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.731+0000 7fd293859640 1 -- 172.21.15.152:0/723410848 wait complete. 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.732+0000 7fd293859640 1 Processor -- start 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.732+0000 7fd293859640 1 -- start start 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd28c0b5090 0x7fd28c13e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c0cc8f0 0x7fd28c13eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c06cdc0 con 0x7fd28c0cc510 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd28c0ce340 con 0x7fd28c0b5090 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd293859640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd28c06cf40 con 0x7fd28c0cc8f0 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36278/0 (socket says 172.21.15.152:36278) 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 -- 172.21.15.152:0/700872068 learned_addr learned my addr 172.21.15.152:0/700872068 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd291df6640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c0cc8f0 0x7fd28c13eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd290df4640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd28c0b5090 0x7fd28c13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 -- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c0cc8f0 msgr2=0x7fd28c13eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c0cc8f0 0x7fd28c13eb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 -- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd28c0b5090 msgr2=0x7fd28c13e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd28c0b5090 0x7fd28c13e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 -- 172.21.15.152:0/700872068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd28c0c76d0 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.733+0000 7fd2915f5640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0119a0 tx=0x7fd27c011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.734+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c00fa90 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.734+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd27c00fc30 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.734+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd28c0c79b0 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.734+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd27c014440 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.734+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd28c0c7f70 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.735+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd28c04f540 con 0x7fd28c0cc510 2024-03-18T15:01:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.735+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd27c012040 con 0x7fd28c0cc510 2024-03-18T15:01:25.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.736+0000 7fd281ffb640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 0x7fd27006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:25.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.736+0000 7fd290df4640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 0x7fd27006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:25.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.736+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fd27c08afe0 con 0x7fd28c0cc510 2024-03-18T15:01:25.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.736+0000 7fd290df4640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 0x7fd27006e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af5e0 tx=0x7fd288000fc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:25.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.740+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd27c019030 con 0x7fd28c0cc510 2024-03-18T15:01:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.919+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd28c144920 con 0x7fd28c0cc510 2024-03-18T15:01:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.919+0000 7fd281ffb640 1 -- 172.21.15.152:0/700872068 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7fd27c0593f0 con 0x7fd28c0cc510 2024-03-18T15:01:25.921 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 msgr2=0x7fd27006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 0x7fd27006e090 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd28c0af5e0 tx=0x7fd288000fc0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 msgr2=0x7fd28c0c6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd27c0119a0 tx=0x7fd27c011e60 comp rx=0 tx=0).stop 2024-03-18T15:01:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 shutdown_connections 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd27006bbd0 0x7fd27006e090 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd28c0cc8f0 0x7fd28c13eb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd28c0b5090 0x7fd28c13e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 --2- 172.21.15.152:0/700872068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd28c0cc510 0x7fd28c0c6cc0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 >> 172.21.15.152:0/700872068 conn(0x7fd28c0cfbf0 msgr2=0x7fd28c06e400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 shutdown_connections 2024-03-18T15:01:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:25.921+0000 7fd293859640 1 -- 172.21.15.152:0/700872068 wait complete. 2024-03-18T15:01:25.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:26.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.036+0000 7f8787d77640 1 Processor -- start 2024-03-18T15:01:26.037 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.036+0000 7f8787d77640 1 -- start start 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8787d77640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f87800ceca0 0x7f87800b7820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8787d77640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800cce20 con 0x7f878015c140 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8787d77640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87800cd100 con 0x7f87800ce840 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8787d77640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f87800b7d60 con 0x7f87800ceca0 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8785b13640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f878015c140 0x7f87800d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38466/0 (socket says 172.21.15.152:38466) 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.037+0000 7f8785b13640 1 -- 172.21.15.152:0/2412434125 learned_addr learned my addr 172.21.15.152:0/2412434125 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:26.048 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8786314640 1 --2- 172.21.15.152:0/2412434125 >> v2:172.21.15.186:3300/0 conn(0x7f87800ceca0 0x7f87800b7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2336128629 0 0) 0x7f87800cce20 con 0x7f878015c140 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f876c003520 con 0x7f878015c140 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2253767358 0 0) 0x7f876c003520 con 0x7f878015c140 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 >> v2:172.21.15.186:3300/0 conn(0x7f87800ceca0 msgr2=0x7f87800b7820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 --2- 172.21.15.152:0/2412434125 >> v2:172.21.15.186:3300/0 conn(0x7f87800ceca0 0x7f87800b7820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 >> v1:172.21.15.186:6789/0 conn(0x7f87800ce840 legacy=0x7f87800b7110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87800cd3e0 con 0x7f878015c140 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f877c001670 con 0x7f878015c140 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 >> v1:172.21.15.152:6789/0 conn(0x7f878015c140 legacy=0x7f87800d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f876c0039b0 0x7f876c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.049 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 0x7f876c004880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c005080 0x7f876c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87800b7d60 con 0x7f876c0043b0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f876c00bfe0 con 0x7f876c005080 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f876c00c1e0 con 0x7f876c0039b0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8785312640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 0x7f876c004880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8785b13640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f876c0039b0 0x7f876c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8786314640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c005080 0x7f876c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.038+0000 7f8785312640 1 -- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f876c0039b0 msgr2=0x7f876c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8785312640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f876c0039b0 0x7f876c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8785312640 1 -- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c005080 msgr2=0x7f876c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8785312640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c005080 0x7f876c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8785312640 1 -- 172.21.15.152:0/2412434125 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c003520 con 0x7f876c0043b0 2024-03-18T15:01:26.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8786314640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c005080 0x7f876c00b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8786314640 1 -- 172.21.15.152:0/2412434125 reap_dead start 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8785312640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 0x7f876c004880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8770001860 tx=0x7f876c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14be42b15b2072bd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770001430 con 0x7f876c0043b0 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8770033610 con 0x7f876c0043b0 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.039+0000 7f8784b11640 1 -- 172.21.15.152:0/2412434125 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770033a00 con 0x7f876c0043b0 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 -- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 msgr2=0x7f876c004880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 0x7f876c004880 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f8770001860 tx=0x7f876c005830 comp rx=0 tx=0).stop 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 -- 172.21.15.152:0/2412434125 shutdown_connections 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 --2- 172.21.15.152:0/2412434125 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f876c0043b0 0x7f876c004880 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 -- 172.21.15.152:0/2412434125 >> 172.21.15.152:0/2412434125 conn(0x7f878009b160 msgr2=0x7f87800d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 -- 172.21.15.152:0/2412434125 shutdown_connections 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.040+0000 7f8787d77640 1 -- 172.21.15.152:0/2412434125 wait complete. 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.041+0000 7f8787d77640 1 Processor -- start 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.041+0000 7f8787d77640 1 -- start start 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c0043b0 0x7f8780159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f878015c520 0x7f8780156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f87800cf130 con 0x7f87800c6230 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f87800cd9a0 con 0x7f876c0043b0 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8787d77640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f87800d2710 con 0x7f878015c520 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36304/0 (socket says 172.21.15.152:36304) 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 -- 172.21.15.152:0/1905722835 learned_addr learned my addr 172.21.15.152:0/1905722835 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785b13640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c0043b0 0x7f8780159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8786314640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f878015c520 0x7f8780156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 -- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f878015c520 msgr2=0x7f8780156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f878015c520 0x7f8780156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 -- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c0043b0 msgr2=0x7f8780159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c0043b0 0x7f8780159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.042+0000 7f8785312640 1 -- 172.21.15.152:0/1905722835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f878006c370 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f8785312640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f877002bdb0 tx=0x7f8770001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8770007220 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87700073c0 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87800c6690 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87700067d0 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.043+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f878006c8f0 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.044+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f878004f540 con 0x7f87800c6230 2024-03-18T15:01:26.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.044+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8770045070 con 0x7f87800c6230 2024-03-18T15:01:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.045+0000 7f87767fc640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 0x7f876406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.045+0000 7f8785b13640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 0x7f876406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.045+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f87700ac580 con 0x7f87800c6230 2024-03-18T15:01:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.045+0000 7f8785b13640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 0x7f876406e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f877c007cb0 tx=0x7f877c0078f0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.049+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8770030070 con 0x7f87800c6230 2024-03-18T15:01:26.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.226+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f87800ce620 con 0x7f87800c6230 2024-03-18T15:01:26.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.227+0000 7f87767fc640 1 -- 172.21.15.152:0/1905722835 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) ==== 104+0+11 (secure 0 0 0) 0x7f877007aa20 con 0x7f87800c6230 2024-03-18T15:01:26.228 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.228+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 msgr2=0x7f876406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.228+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 0x7f876406e090 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f877c007cb0 tx=0x7f877c0078f0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.228+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 msgr2=0x7f87801f7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.228+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f877002bdb0 tx=0x7f8770001230 comp rx=0 tx=0).stop 2024-03-18T15:01:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 shutdown_connections 2024-03-18T15:01:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f876406bbd0 0x7f876406e090 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f878015c520 0x7f8780156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f87800c6230 0x7f87801f7250 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 --2- 172.21.15.152:0/1905722835 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f876c0043b0 0x7f8780159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 >> 172.21.15.152:0/1905722835 conn(0x7f878009b160 msgr2=0x7f87800b4a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 shutdown_connections 2024-03-18T15:01:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.229+0000 7f8787d77640 1 -- 172.21.15.152:0/1905722835 wait complete. 2024-03-18T15:01:26.244 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:26.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.347+0000 7fa62cc8a640 1 Processor -- start 2024-03-18T15:01:26.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.347+0000 7fa62cc8a640 1 -- start start 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62cc8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ca940 0x7fa62806ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62cc8a640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6280ce100 0x7fa6280c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62cc8a640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa62815aa30 con 0x7fa6280cd7c0 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62cc8a640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa62806e7a0 con 0x7fa6280ce100 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62cc8a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa62806e190 con 0x7fa6280ca940 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa626d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa6280ce100 0x7fa6280c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa61ffff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa6280cd7c0 0x7fa6280cad20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38482/0 (socket says 172.21.15.152:38482) 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa61ffff640 1 -- 172.21.15.152:0/2262584213 learned_addr learned my addr 172.21.15.152:0/2262584213 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa62659c640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ca940 0x7fa62806ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa625d9b640 1 -- 172.21.15.152:0/2262584213 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1028569706 0 0) 0x7fa610001110 con 0x7fa6280cd7c0 2024-03-18T15:01:26.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa625d9b640 1 -- 172.21.15.152:0/2262584213 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa614003520 con 0x7fa6280cd7c0 2024-03-18T15:01:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa626d9d640 1 -- 172.21.15.152:0/2262584213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ca940 msgr2=0x7fa62806ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa626d9d640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ca940 0x7fa62806ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa626d9d640 1 -- 172.21.15.152:0/2262584213 >> v1:172.21.15.152:6789/0 conn(0x7fa6280cd7c0 legacy=0x7fa6280cad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.348+0000 7fa626d9d640 1 -- 172.21.15.152:0/2262584213 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6280ce6c0 con 0x7fa6280ce100 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.349+0000 7fa626d9d640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280ce100 0x7fa6280c4ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa620009e10 tx=0x7fa62002e2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8f5804057c3c60 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.349+0000 7fa625d9b640 1 -- 172.21.15.152:0/2262584213 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa62003b070 con 0x7fa6280ce100 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.349+0000 7fa625d9b640 1 -- 172.21.15.152:0/2262584213 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa62002ee50 con 0x7fa6280ce100 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.349+0000 7fa625d9b640 1 -- 172.21.15.152:0/2262584213 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa620036860 con 0x7fa6280ce100 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2262584213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280ce100 msgr2=0x7fa6280c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280ce100 0x7fa6280c4ec0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa620009e10 tx=0x7fa62002e2a0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2262584213 shutdown_connections 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280ce100 0x7fa6280c4ec0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2262584213 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ca940 0x7fa62806ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2262584213 >> 172.21.15.152:0/2262584213 conn(0x7fa6280cfbf0 msgr2=0x7fa6280cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2262584213 shutdown_connections 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.350+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2262584213 wait complete. 2024-03-18T15:01:26.353 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.351+0000 7fa62cc8a640 1 Processor -- start 2024-03-18T15:01:26.354 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.351+0000 7fa62cc8a640 1 -- start start 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6280ca940 0x7fa62815d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ce100 0x7fa628072140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa6280cb430 con 0x7fa6280cd7c0 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa6280ce9a0 con 0x7fa6280ca940 2024-03-18T15:01:26.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62cc8a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa6280cc260 con 0x7fa6280ce100 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36320/0 (socket says 172.21.15.152:36320) 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 -- 172.21.15.152:0/2030665144 learned_addr learned my addr 172.21.15.152:0/2030665144 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa62659c640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6280ca940 0x7fa62815d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa626d9d640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ce100 0x7fa628072140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 -- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ce100 msgr2=0x7fa628072140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ce100 0x7fa628072140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 -- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6280ca940 msgr2=0x7fa62815d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6280ca940 0x7fa62815d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 -- 172.21.15.152:0/2030665144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6280c8a90 con 0x7fa6280cd7c0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.352+0000 7fa61ffff640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c3a0 tx=0x7fa61000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.353+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610017070 con 0x7fa6280cd7c0 2024-03-18T15:01:26.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.353+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa610005ce0 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.353+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6280c79f0 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.353+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa610007310 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.353+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6280c7fb0 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.354+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa62804f540 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.354+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa61001a070 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.355+0000 7fa61effd640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 0x7fa60806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.355+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fa610089d60 con 0x7fa6280cd7c0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.355+0000 7fa62659c640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 0x7fa60806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.358 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.355+0000 7fa62659c640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 0x7fa60806e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b0380 tx=0x7fa618009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.359+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa62815aa30 con 0x7fa6280cd7c0 2024-03-18T15:01:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.537+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa6280cb0a0 con 0x7fa6280cd7c0 2024-03-18T15:01:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.538+0000 7fa61effd640 1 -- 172.21.15.152:0/2030665144 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) ==== 100+0+11 (secure 0 0 0) 0x7fa610058290 con 0x7fa6280cd7c0 2024-03-18T15:01:26.539 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 msgr2=0x7fa60806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 0x7fa60806e090 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b0380 tx=0x7fa618009190 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 msgr2=0x7fa628071c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa61000c3a0 tx=0x7fa61000c860 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 shutdown_connections 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa60806bbd0 0x7fa60806e090 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa6280ce100 0x7fa628072140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa6280cd7c0 0x7fa628071c00 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 --2- 172.21.15.152:0/2030665144 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa6280ca940 0x7fa62815d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 >> 172.21.15.152:0/2030665144 conn(0x7fa6280cfbf0 msgr2=0x7fa6280b0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 shutdown_connections 2024-03-18T15:01:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.540+0000 7fa62cc8a640 1 -- 172.21.15.152:0/2030665144 wait complete. 2024-03-18T15:01:26.552 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T15:01:26.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.676+0000 7f25cad32640 1 Processor -- start 2024-03-18T15:01:26.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.676+0000 7f25cad32640 1 -- start start 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25cad32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c40cf310 0x7f25c40ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25cad32640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f25c415e930 0x7f25c40cec20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25cad32640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f25c40cc4b0 con 0x7f25c415e550 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25cad32640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f25c40ccda0 con 0x7f25c415e930 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25cad32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f25c40ce240 con 0x7f25c40cf310 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c92cf640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f25c415e930 0x7f25c40cec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c8ace640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f25c415e550 0x7f25c406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38484/0 (socket says 172.21.15.152:38484) 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c8ace640 1 -- 172.21.15.152:0/1864973339 learned_addr learned my addr 172.21.15.152:0/1864973339 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:26.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c3fff640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c40cf310 0x7f25c40ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c92cf640 1 -- 172.21.15.152:0/1864973339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c40cf310 msgr2=0x7f25c40ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:26.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c92cf640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c40cf310 0x7f25c40ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c92cf640 1 -- 172.21.15.152:0/1864973339 >> v1:172.21.15.152:6789/0 conn(0x7f25c415e550 legacy=0x7f25c406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.677+0000 7f25c92cf640 1 -- 172.21.15.152:0/1864973339 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c406da40 con 0x7f25c415e930 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.678+0000 7f25c92cf640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c40cec20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009d90 tx=0x7f25bc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe7f25ad210c83d7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.678+0000 7f25c37fe640 1 -- 172.21.15.152:0/1864973339 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc039070 con 0x7f25c415e930 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.678+0000 7f25c37fe640 1 -- 172.21.15.152:0/1864973339 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc02cce0 con 0x7f25c415e930 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.678+0000 7f25c37fe640 1 -- 172.21.15.152:0/1864973339 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc034660 con 0x7f25c415e930 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 -- 172.21.15.152:0/1864973339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 msgr2=0x7f25c40cec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c40cec20 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009d90 tx=0x7f25bc02bf30 comp rx=0 tx=0).stop 2024-03-18T15:01:26.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 -- 172.21.15.152:0/1864973339 shutdown_connections 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c40cf310 0x7f25c40ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 --2- 172.21.15.152:0/1864973339 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c40cec20 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 -- 172.21.15.152:0/1864973339 >> 172.21.15.152:0/1864973339 conn(0x7f25c40d1e60 msgr2=0x7f25c40d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 -- 172.21.15.152:0/1864973339 shutdown_connections 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.679+0000 7f25cad32640 1 -- 172.21.15.152:0/1864973339 wait complete. 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.680+0000 7f25cad32640 1 Processor -- start 2024-03-18T15:01:26.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.680+0000 7f25cad32640 1 -- start start 2024-03-18T15:01:26.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25c40cf310 0x7f25c41f4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c415e550 0x7f25c41f6af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f25c40cca30 con 0x7f25c415e930 2024-03-18T15:01:26.684 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f25c40cc750 con 0x7f25c40cf310 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25cad32640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f25c40aebb0 con 0x7f25c415e550 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36332/0 (socket says 172.21.15.152:36332) 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 -- 172.21.15.152:0/882625825 learned_addr learned my addr 172.21.15.152:0/882625825 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c3fff640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c415e550 0x7f25c41f6af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c8ace640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25c40cf310 0x7f25c41f4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 -- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c415e550 msgr2=0x7f25c41f6af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c415e550 0x7f25c41f6af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 -- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25c40cf310 msgr2=0x7f25c41f4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25c40cf310 0x7f25c41f4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.681+0000 7f25c92cf640 1 -- 172.21.15.152:0/882625825 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c415ee90 con 0x7f25c415e930 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25c92cf640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009d90 tx=0x7f25bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc039050 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc045070 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c415f150 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25bc03e830 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.682+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c415f710 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.683+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c404f5b0 con 0x7f25c415e930 2024-03-18T15:01:26.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.683+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f25bc03e9d0 con 0x7f25c415e930 2024-03-18T15:01:26.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.684+0000 7f25c17fa640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 0x7f25a806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:26.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.684+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f25bc0ad810 con 0x7f25c415e930 2024-03-18T15:01:26.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.684+0000 7f25c8ace640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 0x7f25a806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:26.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.684+0000 7f25c8ace640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 0x7f25a806e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25b8000f60 tx=0x7f25b8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.692+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f25bc07c420 con 0x7f25c415e930 2024-03-18T15:01:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.882+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f25c4074d80 con 0x7f25c415e930 2024-03-18T15:01:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.883+0000 7f25c17fa640 1 -- 172.21.15.152:0/882625825 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v22) ==== 80+0+0 (secure 0 0 0) 0x7f25bc07bd20 con 0x7f25c415e930 2024-03-18T15:01:26.884 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-03-18T15:01:26.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 msgr2=0x7f25a806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 0x7f25a806e090 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f25b8000f60 tx=0x7f25b8009040 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 msgr2=0x7f25c41f4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f25bc009d90 tx=0x7f25bc004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 shutdown_connections 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f25c415e930 0x7f25c41f4460 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f25a806bbd0 0x7f25a806e090 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f25c415e550 0x7f25c41f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 --2- 172.21.15.152:0/882625825 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f25c40cf310 0x7f25c41f4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 >> 172.21.15.152:0/882625825 conn(0x7f25c40d1e60 msgr2=0x7f25c406f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 shutdown_connections 2024-03-18T15:01:26.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:26.885+0000 7f25cad32640 1 -- 172.21.15.152:0/882625825 wait complete. 2024-03-18T15:01:26.899 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-03-18T15:01:26.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:26.900 DEBUG:teuthology.orchestra.run.smithi186:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2024-03-18T15:01:26.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:01:26.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:26.934 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-03-18T15:01:27.001 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:27.001 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:27.017 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:27.017 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:27.073 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:27.073 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:27.128 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:27.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.269+0000 7fc2d7461640 1 Processor -- start 2024-03-18T15:01:27.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.269+0000 7fc2d7461640 1 -- start start 2024-03-18T15:01:27.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d7461640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc2d01622b0 0x7fc2d00d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d7461640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d00b3440 con 0x7fc2d0162690 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d7461640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc2d00d20a0 con 0x7fc2d015ea90 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d7461640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fc2d00d16c0 con 0x7fc2d01622b0 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d49fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc2d0162690 0x7fc2d0162b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38492/0 (socket says 172.21.15.152:38492) 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d49fc640 1 -- 172.21.15.152:0/424458038 learned_addr learned my addr 172.21.15.152:0/424458038 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2d51fd640 1 --2- 172.21.15.152:0/424458038 >> v2:172.21.15.186:3300/0 conn(0x7fc2d01622b0 0x7fc2d00d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2786386281 0 0) 0x7fc2d00b3440 con 0x7fc2d0162690 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.270+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2bc003520 con 0x7fc2d0162690 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4205394247 0 0) 0x7fc2d00d20a0 con 0x7fc2d015ea90 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc2d00b3440 con 0x7fc2d015ea90 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 239030983 0 0) 0x7fc2bc003520 con 0x7fc2d0162690 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 >> v2:172.21.15.186:3300/0 conn(0x7fc2d01622b0 msgr2=0x7fc2d00d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:27.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 --2- 172.21.15.152:0/424458038 >> v2:172.21.15.186:3300/0 conn(0x7fc2d01622b0 0x7fc2d00d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 >> v1:172.21.15.186:6789/0 conn(0x7fc2d015ea90 legacy=0x7fc2d015eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d00d2380 con 0x7fc2d0162690 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fc2c00015f0 con 0x7fc2d0162690 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 >> v1:172.21.15.152:6789/0 conn(0x7fc2d0162690 legacy=0x7fc2d0162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2bc003c00 0x7fc2bc004000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 0x7fc2bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc0052f0 0x7fc2bc00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00d16c0 con 0x7fc2bc004800 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc2bc00c230 con 0x7fc2bc0052f0 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc2bc00c430 con 0x7fc2bc003c00 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 0x7fc2bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d59fe640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc0052f0 0x7fc2bc00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d51fd640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2bc003c00 0x7fc2bc004000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 -- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2bc003c00 msgr2=0x7fc2bc004000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2bc003c00 0x7fc2bc004000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 -- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc0052f0 msgr2=0x7fc2bc00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc0052f0 0x7fc2bc00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d49fc640 1 -- 172.21.15.152:0/424458038 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2bc003520 con 0x7fc2bc004800 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.271+0000 7fc2d59fe640 1 -- 172.21.15.152:0/424458038 reap_dead start 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.272+0000 7fc2d49fc640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 0x7fc2bc004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0007f80 tx=0x7fc2bc005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c733241ec050e62 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.272+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0007ba0 con 0x7fc2bc004800 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.272+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c0030070 con 0x7fc2bc004800 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.272+0000 7fc2c7fff640 1 -- 172.21.15.152:0/424458038 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c0005e30 con 0x7fc2bc004800 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 -- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 msgr2=0x7fc2bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 0x7fc2bc004c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fc2c0007f80 tx=0x7fc2bc005830 comp rx=0 tx=0).stop 2024-03-18T15:01:27.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 -- 172.21.15.152:0/424458038 shutdown_connections 2024-03-18T15:01:27.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 --2- 172.21.15.152:0/424458038 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2bc004800 0x7fc2bc004c80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 -- 172.21.15.152:0/424458038 >> 172.21.15.152:0/424458038 conn(0x7fc2d00d4070 msgr2=0x7fc2d00d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:27.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 -- 172.21.15.152:0/424458038 shutdown_connections 2024-03-18T15:01:27.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.273+0000 7fc2d7461640 1 -- 172.21.15.152:0/424458038 wait complete. 2024-03-18T15:01:27.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.275+0000 7fc2d7461640 1 Processor -- start 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.275+0000 7fc2d7461640 1 -- start start 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc004800 0x7fc2d01e77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2d00b6bf0 0x7fc2d00b4650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00d2fd0 con 0x7fc2d00b7070 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc2d00d2660 con 0x7fc2bc004800 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d7461640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc2d00d3150 con 0x7fc2d00b6bf0 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36352/0 (socket says 172.21.15.152:36352) 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 -- 172.21.15.152:0/668170180 learned_addr learned my addr 172.21.15.152:0/668170180 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d49fc640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2d00b6bf0 0x7fc2d00b4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d51fd640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc004800 0x7fc2d01e77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 -- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2d00b6bf0 msgr2=0x7fc2d00b4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2d00b6bf0 0x7fc2d00b4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 -- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc004800 msgr2=0x7fc2d01e77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc004800 0x7fc2d01e77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 -- 172.21.15.152:0/668170180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2d00b7560 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.276+0000 7fc2d59fe640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800f8b0 tx=0x7fc2c800fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.277+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c8003b80 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.277+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2c8018070 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.277+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2c80050d0 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.277+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2d00b7840 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.277+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2d00b8570 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.278+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2d004f5b0 con 0x7fc2d00b7070 2024-03-18T15:01:27.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.278+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc2c8005270 con 0x7fc2d00b7070 2024-03-18T15:01:27.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.278+0000 7fc2c5ffb640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 0x7fc2b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.279+0000 7fc2d51fd640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 0x7fc2b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.279+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2c808a9c0 con 0x7fc2d00b7070 2024-03-18T15:01:27.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.279+0000 7fc2d51fd640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 0x7fc2b406e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00cda90 tx=0x7fc2cc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.283+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc2c808ce20 con 0x7fc2d00b7070 2024-03-18T15:01:27.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.462+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc2d015e240 con 0x7fc2d00b7070 2024-03-18T15:01:27.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.463+0000 7fc2c5ffb640 1 -- 172.21.15.152:0/668170180 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16653 (secure 0 0 0) 0x7fc2c801a310 con 0x7fc2d00b7070 2024-03-18T15:01:27.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:27.465 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":22,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:00:50.594862+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 msgr2=0x7fc2b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 0x7fc2b406e090 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc2d00cda90 tx=0x7fc2cc008040 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 msgr2=0x7fc2d00b4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fc2c800f8b0 tx=0x7fc2c800fd70 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 shutdown_connections 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc2d00b7070 0x7fc2d00b4b90 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc2b406bbd0 0x7fc2b406e090 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc2d00b6bf0 0x7fc2d00b4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 --2- 172.21.15.152:0/668170180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc2bc004800 0x7fc2d01e77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 >> 172.21.15.152:0/668170180 conn(0x7fc2d00d4070 msgr2=0x7fc2d015d900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:27.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 shutdown_connections 2024-03-18T15:01:27.468 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.465+0000 7fc2d7461640 1 -- 172.21.15.152:0/668170180 wait complete. 2024-03-18T15:01:27.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:27.482 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:27.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.585+0000 7f07817f3640 1 Processor -- start 2024-03-18T15:01:27.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.585+0000 7f07817f3640 1 -- start start 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f07817f3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f077c161890 0x7f077c0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f07817f3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c0cffe0 con 0x7f077c0d1070 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f07817f3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f077c0cfa20 con 0x7f077c0b4ec0 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f07817f3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f077c0cfd00 con 0x7f077c161890 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f077b7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f077c0d1070 0x7f077c0d2220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38508/0 (socket says 172.21.15.152:38508) 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f077b7fe640 1 -- 172.21.15.152:0/3179563180 learned_addr learned my addr 172.21.15.152:0/3179563180 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:27.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f077affd640 1 --2- 172.21.15.152:0/3179563180 >> v2:172.21.15.186:3300/0 conn(0x7f077c161890 0x7f077c0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 276895479 0 0) 0x7f077c0cffe0 con 0x7f077c0d1070 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.586+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0768003520 con 0x7f077c0d1070 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.587+0000 7f077affd640 1 -- 172.21.15.152:0/3179563180 >> v1:172.21.15.186:6789/0 conn(0x7f077c0b4ec0 legacy=0x7f077c0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.587+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 121928351 0 0) 0x7f0768003520 con 0x7f077c0d1070 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.587+0000 7f077affd640 1 -- 172.21.15.152:0/3179563180 >> v1:172.21.15.152:6789/0 conn(0x7f077c0d1070 legacy=0x7f077c0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.587+0000 7f077affd640 1 -- 172.21.15.152:0/3179563180 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c0cf710 con 0x7f077c161890 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.588+0000 7f077affd640 1 --2- 172.21.15.152:0/3179563180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c0d4bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07740097a0 tx=0x7f077402b680 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba740e8348fc48f5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.588+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0774037070 con 0x7f077c161890 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.588+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0774030510 con 0x7f077c161890 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.588+0000 7f0779ffb640 1 -- 172.21.15.152:0/3179563180 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076c0019f0 con 0x7f077c161890 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 -- 172.21.15.152:0/3179563180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 msgr2=0x7f077c0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 --2- 172.21.15.152:0/3179563180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c0d4bb0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f07740097a0 tx=0x7f077402b680 comp rx=0 tx=0).stop 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 -- 172.21.15.152:0/3179563180 shutdown_connections 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 --2- 172.21.15.152:0/3179563180 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c0d4bb0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 -- 172.21.15.152:0/3179563180 >> 172.21.15.152:0/3179563180 conn(0x7f077c0d4090 msgr2=0x7f077c0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 -- 172.21.15.152:0/3179563180 shutdown_connections 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.589+0000 7f07817f3640 1 -- 172.21.15.152:0/3179563180 wait complete. 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.590+0000 7f07817f3640 1 Processor -- start 2024-03-18T15:01:27.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.590+0000 7f07817f3640 1 -- start start 2024-03-18T15:01:27.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 0x7f077c150ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c1f7570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f077c0b6ee0 con 0x7f077c0d1070 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f077c0b5580 con 0x7f077c161890 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f077c0b7060 con 0x7f077c0b4ec0 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36360/0 (socket says 172.21.15.152:36360) 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 -- 172.21.15.152:0/1566126753 learned_addr learned my addr 172.21.15.152:0/1566126753 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077b7fe640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c1f7570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077affd640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 0x7f077c150ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 -- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 msgr2=0x7f077c150ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 0x7f077c150ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 -- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 msgr2=0x7f077c1f7570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c1f7570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 -- 172.21.15.152:0/1566126753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077c1f80e0 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077affd640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 0x7f077c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f077a7fc640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f076400c7b0 tx=0x7f076400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0764017070 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0764005290 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.591+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f077c1f83c0 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.592+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f076400a880 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.592+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077c1503a0 con 0x7f077c0d1070 2024-03-18T15:01:27.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.593+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f077c04f540 con 0x7f077c0d1070 2024-03-18T15:01:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.593+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f076401a070 con 0x7f077c0d1070 2024-03-18T15:01:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.593+0000 7f07737fe640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 0x7f075c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.594+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f0764089ef0 con 0x7f077c0d1070 2024-03-18T15:01:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.594+0000 7f077affd640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 0x7f075c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.594+0000 7f077affd640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 0x7f075c06e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0774034000 tx=0x7f0774008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.599 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.598+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0764058390 con 0x7f077c0d1070 2024-03-18T15:01:27.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.775+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f077c0d4730 con 0x7f077c0d1070 2024-03-18T15:01:27.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.775+0000 7f07737fe640 1 -- 172.21.15.152:0/1566126753 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) ==== 93+0+10 (secure 0 0 0) 0x7f076405c430 con 0x7f077c0d1070 2024-03-18T15:01:27.777 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:27.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 msgr2=0x7f075c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 0x7f075c06e090 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0774034000 tx=0x7f0774008030 comp rx=0 tx=0).stop 2024-03-18T15:01:27.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 msgr2=0x7f077c14d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f076400c7b0 tx=0x7f076400cc70 comp rx=0 tx=0).stop 2024-03-18T15:01:27.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 shutdown_connections 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f077c161890 0x7f077c1f7570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f077c0d1070 0x7f077c14d770 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f075c06bbd0 0x7f075c06e090 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 --2- 172.21.15.152:0/1566126753 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f077c0b4ec0 0x7f077c150ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.777+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 >> 172.21.15.152:0/1566126753 conn(0x7f077c0d4090 msgr2=0x7f077c162260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.778+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 shutdown_connections 2024-03-18T15:01:27.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.778+0000 7f07817f3640 1 -- 172.21.15.152:0/1566126753 wait complete. 2024-03-18T15:01:27.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:27.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.896+0000 7f7a398c0640 1 Processor -- start 2024-03-18T15:01:27.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.896+0000 7f7a398c0640 1 -- start start 2024-03-18T15:01:27.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a3415c140 0x7f7a340d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 0x7f7a340ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 0x7f7a340b75a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340cf1e0 con 0x7f7a3415c140 2024-03-18T15:01:27.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7a340cce20 con 0x7f7a340ce840 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a398c0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7a340cd100 con 0x7f7a340b7110 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a3415c140 0x7f7a340d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7a3415c140 0x7f7a340d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36362/0 (socket says 172.21.15.152:36362) 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 -- 172.21.15.152:0/2662127713 learned_addr learned my addr 172.21.15.152:0/2662127713 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a327fc640 1 --2- 172.21.15.152:0/2662127713 >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 0x7f7a340ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a337fe640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 0x7f7a340b75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 -- 172.21.15.152:0/2662127713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 msgr2=0x7f7a340b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 0x7f7a340b75a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 -- 172.21.15.152:0/2662127713 >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 msgr2=0x7f7a340ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 --2- 172.21.15.152:0/2662127713 >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 0x7f7a340ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a32ffd640 1 -- 172.21.15.152:0/2662127713 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a340cd3e0 con 0x7f7a3415c140 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a327fc640 1 --2- 172.21.15.152:0/2662127713 >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 0x7f7a340ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:27.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.898+0000 7f7a337fe640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 0x7f7a340b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:27.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.899+0000 7f7a32ffd640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a3415c140 0x7f7a340d08c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a34074ef0 tx=0x7f7a2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe1f91991cd6f7e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.899+0000 7f7a31ffb640 1 -- 172.21.15.152:0/2662127713 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24035020 con 0x7f7a3415c140 2024-03-18T15:01:27.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.899+0000 7f7a31ffb640 1 -- 172.21.15.152:0/2662127713 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a24031870 con 0x7f7a3415c140 2024-03-18T15:01:27.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.899+0000 7f7a31ffb640 1 -- 172.21.15.152:0/2662127713 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a24031c40 con 0x7f7a3415c140 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 -- 172.21.15.152:0/2662127713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a3415c140 msgr2=0x7f7a340d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a3415c140 0x7f7a340d08c0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f7a34074ef0 tx=0x7f7a2402b910 comp rx=0 tx=0).stop 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 -- 172.21.15.152:0/2662127713 shutdown_connections 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340b7110 0x7f7a340b75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 --2- 172.21.15.152:0/2662127713 >> v2:172.21.15.186:3300/0 conn(0x7f7a340ce840 0x7f7a340ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 --2- 172.21.15.152:0/2662127713 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a3415c140 0x7f7a340d08c0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 -- 172.21.15.152:0/2662127713 >> 172.21.15.152:0/2662127713 conn(0x7f7a3409b160 msgr2=0x7f7a340d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:27.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 -- 172.21.15.152:0/2662127713 shutdown_connections 2024-03-18T15:01:27.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.900+0000 7f7a398c0640 1 -- 172.21.15.152:0/2662127713 wait complete. 2024-03-18T15:01:27.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.902+0000 7f7a398c0640 1 Processor -- start 2024-03-18T15:01:27.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.902+0000 7f7a398c0640 1 -- start start 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 0x7f7a341574b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340ce840 0x7f7a3406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 0x7f7a3415a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340d0e00 con 0x7f7a340b7110 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7a340cd9a0 con 0x7f7a3415c140 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a398c0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7a340d2710 con 0x7f7a340ce840 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 0x7f7a341574b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.905 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a32ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 0x7f7a341574b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36366/0 (socket says 172.21.15.152:36366) 2024-03-18T15:01:27.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.903+0000 7f7a32ffd640 1 -- 172.21.15.152:0/3853619263 learned_addr learned my addr 172.21.15.152:0/3853619263 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:27.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 0x7f7a3415a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 -- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340ce840 msgr2=0x7f7a3406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340ce840 0x7f7a3406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 -- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 msgr2=0x7f7a341574b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:27.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 0x7f7a341574b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:27.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 -- 172.21.15.152:0/3853619263 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a341f8eb0 con 0x7f7a3415c140 2024-03-18T15:01:27.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.904+0000 7f7a337fe640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 0x7f7a3415a250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c007d40 tx=0x7f7a2c00d4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.913+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c01a070 con 0x7f7a3415c140 2024-03-18T15:01:27.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.913+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a2c003990 con 0x7f7a3415c140 2024-03-18T15:01:27.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.913+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a2c003d60 con 0x7f7a3415c140 2024-03-18T15:01:27.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.913+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a341f9190 con 0x7f7a3415c140 2024-03-18T15:01:27.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.913+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a341f9750 con 0x7f7a3415c140 2024-03-18T15:01:27.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.914+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a3404f540 con 0x7f7a3415c140 2024-03-18T15:01:27.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.915+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7a2c01d070 con 0x7f7a3415c140 2024-03-18T15:01:27.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.915+0000 7f7a1bfff640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 0x7f7a2006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:27.916 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.915+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f7a2c08aad0 con 0x7f7a3415c140 2024-03-18T15:01:27.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.915+0000 7f7a32ffd640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 0x7f7a2006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:27.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.916+0000 7f7a32ffd640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 0x7f7a2006e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a240090b0 tx=0x7f7a2403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:27.921 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:27.920+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7a2c010070 con 0x7f7a3415c140 2024-03-18T15:01:28.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.207+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f7a340d24f0 con 0x7f7a3415c140 2024-03-18T15:01:28.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.207+0000 7f7a1bfff640 1 -- 172.21.15.152:0/3853619263 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7f7a2c058ed0 con 0x7f7a3415c140 2024-03-18T15:01:28.209 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:28.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 msgr2=0x7f7a2006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 0x7f7a2006e090 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7a240090b0 tx=0x7f7a2403c040 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 msgr2=0x7f7a3415a250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 0x7f7a3415a250 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a2c007d40 tx=0x7f7a2c00d4a0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 shutdown_connections 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7a3415c140 0x7f7a3415a250 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a2006bbd0 0x7f7a2006e090 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7a340ce840 0x7f7a3406cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 --2- 172.21.15.152:0/3853619263 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7a340b7110 0x7f7a341574b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 >> 172.21.15.152:0/3853619263 conn(0x7f7a3409b160 msgr2=0x7f7a340b5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 shutdown_connections 2024-03-18T15:01:28.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.210+0000 7f7a398c0640 1 -- 172.21.15.152:0/3853619263 wait complete. 2024-03-18T15:01:28.222 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:28.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.326+0000 7fd66bbf4640 1 Processor -- start 2024-03-18T15:01:28.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.327+0000 7fd66bbf4640 1 -- start start 2024-03-18T15:01:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.327+0000 7fd66bbf4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd6640ce840 0x7fd6640ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.327+0000 7fd66bbf4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6640cce20 con 0x7fd66415c140 2024-03-18T15:01:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.327+0000 7fd66bbf4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6640cd100 con 0x7fd6640b7110 2024-03-18T15:01:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.327+0000 7fd66bbf4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fd6640cf1e0 con 0x7fd6640ce840 2024-03-18T15:01:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd66918f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fd6640ce840 0x7fd6640ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd669990640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd66415c140 0x7fd6640d08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38514/0 (socket says 172.21.15.152:38514) 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd669990640 1 -- 172.21.15.152:0/1826910889 learned_addr learned my addr 172.21.15.152:0/1826910889 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd66918f640 1 -- 172.21.15.152:0/1826910889 >> v1:172.21.15.186:6789/0 conn(0x7fd6640b7110 legacy=0x7fd6640b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd66918f640 1 -- 172.21.15.152:0/1826910889 >> v1:172.21.15.152:6789/0 conn(0x7fd66415c140 legacy=0x7fd6640d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd66898e640 1 -- 172.21.15.152:0/1826910889 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3607372935 0 0) 0x7fd6640cce20 con 0x7fd66415c140 2024-03-18T15:01:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.328+0000 7fd66918f640 1 -- 172.21.15.152:0/1826910889 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640cd3e0 con 0x7fd6640ce840 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66918f640 1 --2- 172.21.15.152:0/1826910889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640ce840 0x7fd6640ceca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6540097a0 tx=0x7fd65402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db118a834d1c781 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66898e640 1 -- 172.21.15.152:0/1826910889 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654035020 con 0x7fd6640ce840 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66898e640 1 -- 172.21.15.152:0/1826910889 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd654031830 con 0x7fd6640ce840 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66898e640 1 -- 172.21.15.152:0/1826910889 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd654031c00 con 0x7fd6640ce840 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 -- 172.21.15.152:0/1826910889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640ce840 msgr2=0x7fd6640ceca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/1826910889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640ce840 0x7fd6640ceca0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fd6540097a0 tx=0x7fd65402b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 -- 172.21.15.152:0/1826910889 shutdown_connections 2024-03-18T15:01:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/1826910889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd6640ce840 0x7fd6640ceca0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 -- 172.21.15.152:0/1826910889 >> 172.21.15.152:0/1826910889 conn(0x7fd66409b160 msgr2=0x7fd6640d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 -- 172.21.15.152:0/1826910889 shutdown_connections 2024-03-18T15:01:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.329+0000 7fd66bbf4640 1 -- 172.21.15.152:0/1826910889 wait complete. 2024-03-18T15:01:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 Processor -- start 2024-03-18T15:01:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 -- start start 2024-03-18T15:01:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6640b7110 0x7fd6641e73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 0x7fd66415ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640b7cb0 con 0x7fd66415c140 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640cd9a0 con 0x7fd6640ce840 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66bbf4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd6640d2710 con 0x7fd6640b7110 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66a191640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66a191640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36394/0 (socket says 172.21.15.152:36394) 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.331+0000 7fd66a191640 1 -- 172.21.15.152:0/3468663542 learned_addr learned my addr 172.21.15.152:0/3468663542 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66918f640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 0x7fd66415ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd669990640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6640b7110 0x7fd6641e73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 -- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6640b7110 msgr2=0x7fd6641e73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6640b7110 0x7fd6641e73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 -- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 msgr2=0x7fd66415ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 0x7fd66415ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 -- 172.21.15.152:0/3468663542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6641e7ce0 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66918f640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 0x7fd66415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66a191640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00c780 tx=0x7fd65c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c004b60 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd65c004d00 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6641e7fc0 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd65c00aa90 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.332+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd66406c520 con 0x7fd66415c140 2024-03-18T15:01:28.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.333+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6640cb780 con 0x7fd66415c140 2024-03-18T15:01:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.334+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd65c00ac30 con 0x7fd66415c140 2024-03-18T15:01:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.334+0000 7fd65a7fc640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 0x7fd64806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.334+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7fd65c08ade0 con 0x7fd66415c140 2024-03-18T15:01:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.334+0000 7fd669990640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 0x7fd64806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.335+0000 7fd669990640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 0x7fd64806e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd660000f60 tx=0x7fd660007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.339+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd65c020070 con 0x7fd66415c140 2024-03-18T15:01:28.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.604+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fd66404f540 con 0x7fd66415c140 2024-03-18T15:01:28.606 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.605+0000 7fd65a7fc640 1 -- 172.21.15.152:0/3468663542 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7fd65c059850 con 0x7fd66415c140 2024-03-18T15:01:28.606 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 msgr2=0x7fd64806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 0x7fd64806e090 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd660000f60 tx=0x7fd660007c00 comp rx=0 tx=0).stop 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 msgr2=0x7fd66415d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd65c00c780 tx=0x7fd65c00cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 shutdown_connections 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd66415c140 0x7fd66415d180 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd6640ce840 0x7fd66415ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd64806bbd0 0x7fd64806e090 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.609 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 --2- 172.21.15.152:0/3468663542 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd6640b7110 0x7fd6641e73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 >> 172.21.15.152:0/3468663542 conn(0x7fd66409b160 msgr2=0x7fd664070400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:28.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 shutdown_connections 2024-03-18T15:01:28.610 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.607+0000 7fd66bbf4640 1 -- 172.21.15.152:0/3468663542 wait complete. 2024-03-18T15:01:28.620 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T15:01:28.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.720+0000 7f8fe108c640 1 Processor -- start 2024-03-18T15:01:28.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.720+0000 7f8fe108c640 1 -- start start 2024-03-18T15:01:28.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fe108c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fe108c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8fdc0cf310 0x7f8fdc0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fe108c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fdc0cc4b0 con 0x7f8fdc06d870 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fe108c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8fdc0ccda0 con 0x7f8fdc0cf310 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fe108c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc0ce240 con 0x7f8fdc15e550 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fdb59e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8fdc06d870 0x7f8fdc0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38522/0 (socket says 172.21.15.152:38522) 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fdb59e640 1 -- 172.21.15.152:0/2769983302 learned_addr learned my addr 172.21.15.152:0/2769983302 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713610557 0 0) 0x7f8fdc0cc4b0 con 0x7f8fdc06d870 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fda59c640 1 --2- 172.21.15.152:0/2769983302 >> v2:172.21.15.186:3300/0 conn(0x7f8fdc0cf310 0x7f8fdc0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.721+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc4003520 con 0x7f8fdc06d870 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3673394400 0 0) 0x7f8fc4003520 con 0x7f8fdc06d870 2024-03-18T15:01:28.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 msgr2=0x7f8fdc06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fdc06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 >> v2:172.21.15.186:3300/0 conn(0x7f8fdc0cf310 msgr2=0x7f8fdc0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 --2- 172.21.15.152:0/2769983302 >> v2:172.21.15.186:3300/0 conn(0x7f8fdc0cf310 0x7f8fdc0ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc06dcf0 con 0x7f8fdc06d870 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f8fd40019f0 con 0x7f8fdc06d870 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 >> v1:172.21.15.152:6789/0 conn(0x7f8fdc06d870 legacy=0x7f8fdc0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc4003a20 0x7f8fc4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fc4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc4004d40 0x7f8fc40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0ccda0 con 0x7f8fc4003a20 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0ce240 con 0x7f8fc4004d40 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc400ba40 con 0x7f8fdc15e550 2024-03-18T15:01:28.726 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc4003a20 0x7f8fc4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fda59c640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fc4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdb59e640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc4004d40 0x7f8fc40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 -- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 msgr2=0x7f8fc4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fdc15e550 0x7f8fc4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 -- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc4004d40 msgr2=0x7f8fc40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc4004d40 0x7f8fc40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdad9d640 1 -- 172.21.15.152:0/2769983302 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fc4003520 con 0x7f8fc4003a20 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.722+0000 7f8fdb59e640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc4004d40 0x7f8fc40051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.723+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc4003a20 0x7f8fc4003e40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009ac0 tx=0x7f8fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517a48082036447c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.723+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc039070 con 0x7f8fc4003a20 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.723+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fcc02c6b0 con 0x7f8fc4003a20 2024-03-18T15:01:28.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.723+0000 7f8fd9d9b640 1 -- 172.21.15.152:0/2769983302 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fcc009690 con 0x7f8fc4003a20 2024-03-18T15:01:28.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 -- 172.21.15.152:0/2769983302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc4003a20 msgr2=0x7f8fc4003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2769983302 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc4003a20 0x7f8fc4003e40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc009ac0 tx=0x7f8fc4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fdb59e640 1 -- 172.21.15.152:0/2769983302 reap_dead start 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 -- 172.21.15.152:0/2769983302 shutdown_connections 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 -- 172.21.15.152:0/2769983302 >> 172.21.15.152:0/2769983302 conn(0x7f8fdc0d1e60 msgr2=0x7f8fdc0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 -- 172.21.15.152:0/2769983302 shutdown_connections 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.724+0000 7f8fe108c640 1 -- 172.21.15.152:0/2769983302 wait complete. 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.725+0000 7f8fe108c640 1 Processor -- start 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.725+0000 7f8fe108c640 1 -- start start 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc4003a20 0x7f8fdc15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 0x7f8fdc0cd130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0aebb0 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8fdc0cca30 con 0x7f8fdc1f38c0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fe108c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fdc15e930 con 0x7f8fc4003a20 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fda59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36424/0 (socket says 172.21.15.152:36424) 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fda59c640 1 -- 172.21.15.152:0/2347918556 learned_addr learned my addr 172.21.15.152:0/2347918556 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fdb59e640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 0x7f8fdc0cd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.726+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc4003a20 0x7f8fdc15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 -- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc4003a20 msgr2=0x7f8fdc15ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc4003a20 0x7f8fdc15ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 -- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 msgr2=0x7f8fdc0cd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 0x7f8fdc0cd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 -- 172.21.15.152:0/2347918556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fdc1f7c20 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.732 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fdb59e640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 0x7f8fdc0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fda59c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0011ad0 tx=0x7f8fd0011f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd000fbb0 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd000fd50 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fdc1f7f00 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd0014660 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.727+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fdc1f84c0 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.728+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fdc04f5b0 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.728+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8fd0012040 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.729+0000 7f8fc37fe640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 0x7f8fc806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.729+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 0x7f8fc806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.729+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5825+0+0 (secure 0 0 0) 0x7f8fd008b190 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.729+0000 7f8fdad9d640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 0x7f8fc806e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc036000 tx=0x7f8fcc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:28.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.733+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8fd0019030 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.928+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8fdc0c5740 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.930 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.928+0000 7f8fc37fe640 1 -- 172.21.15.152:0/2347918556 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f8fd0059c00 con 0x7f8fdc1f76b0 2024-03-18T15:01:28.930 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.930+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 msgr2=0x7f8fc806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.930+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 0x7f8fc806e090 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8fcc036000 tx=0x7f8fcc030000 comp rx=0 tx=0).stop 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.930+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 msgr2=0x7f8fdc0707a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.930+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8fd0011ad0 tx=0x7f8fd0011f90 comp rx=0 tx=0).stop 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 shutdown_connections 2024-03-18T15:01:28.932 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fdc1f38c0 0x7f8fdc0cd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fdc1f76b0 0x7f8fdc0707a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fc806bbd0 0x7f8fc806e090 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 --2- 172.21.15.152:0/2347918556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc4003a20 0x7f8fdc15ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 >> 172.21.15.152:0/2347918556 conn(0x7f8fdc0d1e60 msgr2=0x7f8fdc0ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 shutdown_connections 2024-03-18T15:01:28.933 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:28.931+0000 7f8fe108c640 1 -- 172.21.15.152:0/2347918556 wait complete. 2024-03-18T15:01:28.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2024-03-18T15:01:28.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:28.943 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2024-03-18T15:01:28.975 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T15:01:28.975 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:28.975 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-03-18T15:01:29.030 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:29.030 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:29.049 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:29.050 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:29.107 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T15:01:29.107 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:29.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:29.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.301+0000 7feb9b190640 1 Processor -- start 2024-03-18T15:01:29.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.301+0000 7feb9b190640 1 -- start start 2024-03-18T15:01:29.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9b190640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb940d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9b190640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb940b3440 con 0x7feb9415ea90 2024-03-18T15:01:29.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9b190640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb940d20a0 con 0x7feb94162690 2024-03-18T15:01:29.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9b190640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feb94163200 con 0x7feb941622b0 2024-03-18T15:01:29.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9972d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7feb9415ea90 0x7feb9415ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38534/0 (socket says 172.21.15.152:38534) 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb9972d640 1 -- 172.21.15.152:0/2438754510 learned_addr learned my addr 172.21.15.152:0/2438754510 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.302+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2571402928 0 0) 0x7feb940b3440 con 0x7feb9415ea90 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb98f2c640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb940d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feb7c003520 con 0x7feb9415ea90 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1192253453 0 0) 0x7feb7c003520 con 0x7feb9415ea90 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 msgr2=0x7feb940d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb940d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 >> v1:172.21.15.186:6789/0 conn(0x7feb94162690 legacy=0x7feb94162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb940d2380 con 0x7feb9415ea90 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7feb8c0019f0 con 0x7feb9415ea90 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 >> v1:172.21.15.152:6789/0 conn(0x7feb9415ea90 legacy=0x7feb9415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb7c003a50 0x7feb7c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb7c004800 0x7feb7c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb7c00b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feb94163200 con 0x7feb7c004800 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb7c005500 con 0x7feb7c003a50 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feb7c00bf00 con 0x7feb941622b0 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb7c004800 0x7feb7c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb98f2c640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb7c003a50 0x7feb7c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb9972d640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb7c00b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 -- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 msgr2=0x7feb7c00b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb941622b0 0x7feb7c00b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 -- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb7c003a50 msgr2=0x7feb7c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb7c003a50 0x7feb7c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.303+0000 7feb8bfff640 1 -- 172.21.15.152:0/2438754510 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb7c003520 con 0x7feb7c004800 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb8bfff640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb7c004800 0x7feb7c004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feb84001750 tx=0x7feb7c005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dac259fd303e2ca9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84001370 con 0x7feb7c004800 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb840052d0 con 0x7feb7c004800 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb8b7fe640 1 -- 172.21.15.152:0/2438754510 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb84003830 con 0x7feb7c004800 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 -- 172.21.15.152:0/2438754510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb7c004800 msgr2=0x7feb7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 --2- 172.21.15.152:0/2438754510 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb7c004800 0x7feb7c004c80 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7feb84001750 tx=0x7feb7c005830 comp rx=0 tx=0).stop 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9972d640 1 -- 172.21.15.152:0/2438754510 reap_dead start 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 -- 172.21.15.152:0/2438754510 shutdown_connections 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 -- 172.21.15.152:0/2438754510 >> 172.21.15.152:0/2438754510 conn(0x7feb940d4070 msgr2=0x7feb940d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 -- 172.21.15.152:0/2438754510 shutdown_connections 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.305+0000 7feb9b190640 1 -- 172.21.15.152:0/2438754510 wait complete. 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.306+0000 7feb9b190640 1 Processor -- start 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 -- start start 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb7c004800 0x7feb9415f880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb940b6bf0 0x7feb940cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7feb940d2660 con 0x7feb940ce140 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7feb940d16c0 con 0x7feb940b6bf0 2024-03-18T15:01:29.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9b190640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7feb940cfc90 con 0x7feb7c004800 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9972d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.307+0000 7feb9972d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36440/0 (socket says 172.21.15.152:36440) 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 -- 172.21.15.152:0/2086241367 learned_addr learned my addr 172.21.15.152:0/2086241367 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb98f2c640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb7c004800 0x7feb9415f880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb8bfff640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb940b6bf0 0x7feb940cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 -- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb7c004800 msgr2=0x7feb9415f880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb7c004800 0x7feb9415f880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 -- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb940b6bf0 msgr2=0x7feb940cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb940b6bf0 0x7feb940cdc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 -- 172.21.15.152:0/2086241367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb940b70b0 con 0x7feb940ce140 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9972d640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000f80 tx=0x7feb8c007ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c017020 con 0x7feb940ce140 2024-03-18T15:01:29.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb8c00ab60 con 0x7feb940ce140 2024-03-18T15:01:29.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb940b7390 con 0x7feb940ce140 2024-03-18T15:01:29.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb8c0133f0 con 0x7feb940ce140 2024-03-18T15:01:29.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.308+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb940b7950 con 0x7feb940ce140 2024-03-18T15:01:29.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.309+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb9404f5b0 con 0x7feb940ce140 2024-03-18T15:01:29.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.310+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7feb8c01a020 con 0x7feb940ce140 2024-03-18T15:01:29.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.310+0000 7feb897fa640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 0x7feb8006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.310+0000 7feb98f2c640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 0x7feb8006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.310+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7feb8c08b280 con 0x7feb940ce140 2024-03-18T15:01:29.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.311+0000 7feb98f2c640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 0x7feb8006e0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb90009980 tx=0x7feb90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.315+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7feb8c021020 con 0x7feb940ce140 2024-03-18T15:01:29.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.584+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feb940d18d0 con 0x7feb940ce140 2024-03-18T15:01:29.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.585+0000 7feb897fa640 1 -- 172.21.15.152:0/2086241367 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16903 (secure 0 0 0) 0x7feb8c059d80 con 0x7feb940ce140 2024-03-18T15:01:29.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:29.587 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:28.902062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 msgr2=0x7feb8006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 0x7feb8006e0c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7feb90009980 tx=0x7feb90008040 comp rx=0 tx=0).stop 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 msgr2=0x7feb94160460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7feb8c000f80 tx=0x7feb8c007ab0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 shutdown_connections 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7feb940ce140 0x7feb94160460 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7feb940b6bf0 0x7feb940cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7feb8006bc00 0x7feb8006e0c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 --2- 172.21.15.152:0/2086241367 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7feb7c004800 0x7feb9415f880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 >> 172.21.15.152:0/2086241367 conn(0x7feb940d4070 msgr2=0x7feb940d4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:29.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 shutdown_connections 2024-03-18T15:01:29.591 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.588+0000 7feb9b190640 1 -- 172.21.15.152:0/2086241367 wait complete. 2024-03-18T15:01:29.601 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:29.601 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.706+0000 7f4ec4c30640 1 Processor -- start 2024-03-18T15:01:29.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.706+0000 7f4ec4c30640 1 -- start start 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ec4c30640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4ec0161890 0x7f4ec00d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ec4c30640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4ec00b4ec0 0x7f4ec00b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ec4c30640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4ec00cffe0 con 0x7f4ec00d0960 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ec4c30640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec00cfa20 con 0x7f4ec0161890 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ec4c30640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4ec00cfd00 con 0x7f4ec00b4ec0 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ebe59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4ec0161890 0x7f4ec00d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ebe59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4ec0161890 0x7f4ec00d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36448/0 (socket says 172.21.15.152:36448) 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.707+0000 7f4ebe59c640 1 -- 172.21.15.152:0/1642014579 learned_addr learned my addr 172.21.15.152:0/1642014579 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4eb7fff640 1 --2- 172.21.15.152:0/1642014579 >> v2:172.21.15.186:3300/0 conn(0x7f4ec00b4ec0 0x7f4ec00b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4ebe59c640 1 -- 172.21.15.152:0/1642014579 >> v2:172.21.15.186:3300/0 conn(0x7f4ec00b4ec0 msgr2=0x7f4ec00b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/1642014579 >> v2:172.21.15.186:3300/0 conn(0x7f4ec00b4ec0 0x7f4ec00b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4ebe59c640 1 -- 172.21.15.152:0/1642014579 >> v1:172.21.15.186:6789/0 conn(0x7f4ec00d0960 legacy=0x7f4ec00d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:29.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4ebe59c640 1 -- 172.21.15.152:0/1642014579 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec00cf710 con 0x7f4ec0161890 2024-03-18T15:01:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.708+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/1642014579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00d4bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ec008c6d0 tx=0x7f4eb002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e84160869aaf32 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ebdd9b640 1 -- 172.21.15.152:0/1642014579 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0035020 con 0x7f4ec0161890 2024-03-18T15:01:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ebdd9b640 1 -- 172.21.15.152:0/1642014579 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb0031870 con 0x7f4ec0161890 2024-03-18T15:01:29.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ebdd9b640 1 -- 172.21.15.152:0/1642014579 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0031c40 con 0x7f4ec0161890 2024-03-18T15:01:29.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 -- 172.21.15.152:0/1642014579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 msgr2=0x7f4ec00d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/1642014579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00d4bb0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4ec008c6d0 tx=0x7f4eb002b910 comp rx=0 tx=0).stop 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 -- 172.21.15.152:0/1642014579 shutdown_connections 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/1642014579 >> v2:172.21.15.186:3300/0 conn(0x7f4ec00b4ec0 0x7f4ec00b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/1642014579 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00d4bb0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 -- 172.21.15.152:0/1642014579 >> 172.21.15.152:0/1642014579 conn(0x7f4ec00d4090 msgr2=0x7f4ec00d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 -- 172.21.15.152:0/1642014579 shutdown_connections 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.709+0000 7f4ec4c30640 1 -- 172.21.15.152:0/1642014579 wait complete. 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.710+0000 7f4ec4c30640 1 Processor -- start 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.710+0000 7f4ec4c30640 1 -- start start 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 0x7f4ec01f4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 0x7f4ec00ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00d0df0 con 0x7f4ec0161890 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec00b5580 con 0x7f4ec00d0960 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ec4c30640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4ec00d0f70 con 0x7f4ec00b4ec0 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ebed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ebed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36454/0 (socket says 172.21.15.152:36454) 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.711+0000 7f4ebed9d640 1 -- 172.21.15.152:0/935792488 learned_addr learned my addr 172.21.15.152:0/935792488 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 0x7f4ec01f4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4eb7fff640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 0x7f4ec00ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 -- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 msgr2=0x7f4ec01f4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 0x7f4ec01f4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 -- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 msgr2=0x7f4ec00ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 0x7f4ec00ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 -- 172.21.15.152:0/935792488 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec01f46d0 con 0x7f4ec0161890 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 0x7f4ec01f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:29.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4eb7fff640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 0x7f4ec00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ebed9d640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c780 tx=0x7f4eb800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8004b60 con 0x7f4ec0161890 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4eb8004d00 con 0x7f4ec0161890 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec00cd890 con 0x7f4ec0161890 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800aa90 con 0x7f4ec0161890 2024-03-18T15:01:29.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.712+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec00cde50 con 0x7f4ec0161890 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.713+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec004f540 con 0x7f4ec0161890 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.713+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4eb800ac30 con 0x7f4ec0161890 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.714+0000 7f4eb6ffd640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 0x7f4ea006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.714+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f4eb808af60 con 0x7f4ec0161890 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.714+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 0x7f4ea006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:29.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.714+0000 7f4ebe59c640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 0x7f4ea006e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0036000 tx=0x7f4eb003c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:29.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.722+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4eb8059a60 con 0x7f4ec0161890 2024-03-18T15:01:29.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.902+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f4ec00b7900 con 0x7f4ec0161890 2024-03-18T15:01:29.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.902+0000 7f4eb6ffd640 1 -- 172.21.15.152:0/935792488 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f4eb8059360 con 0x7f4ec0161890 2024-03-18T15:01:29.904 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 msgr2=0x7f4ea006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 0x7f4ea006e0c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0036000 tx=0x7f4eb003c040 comp rx=0 tx=0).stop 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 msgr2=0x7f4ec00ca080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800c780 tx=0x7f4eb800cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 shutdown_connections 2024-03-18T15:01:29.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4ec0161890 0x7f4ec00ca080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4ec00d0960 0x7f4ec00ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ea006bc00 0x7f4ea006e0c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 --2- 172.21.15.152:0/935792488 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4ec00b4ec0 0x7f4ec01f4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 >> 172.21.15.152:0/935792488 conn(0x7f4ec00d4090 msgr2=0x7f4ec00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 shutdown_connections 2024-03-18T15:01:29.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:29.904+0000 7f4ec4c30640 1 -- 172.21.15.152:0/935792488 wait complete. 2024-03-18T15:01:29.917 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.020+0000 7f6709036640 1 Processor -- start 2024-03-18T15:01:30.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.020+0000 7f6709036640 1 -- start start 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f6709036640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f67040ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f6709036640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67040cce20 con 0x7f67040b7110 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f6709036640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f67040cd100 con 0x7f670415c140 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f6709036640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f67040cf1e0 con 0x7f67040ce840 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670359e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f67040b7110 0x7f67040b75a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38546/0 (socket says 172.21.15.152:38546) 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670359e640 1 -- 172.21.15.152:0/2775677538 learned_addr learned my addr 172.21.15.152:0/2775677538 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f66fa59c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f67040ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1955857874 0 0) 0x7f67040cce20 con 0x7f67040b7110 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f66f0003520 con 0x7f67040b7110 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1531415771 0 0) 0x7f66f0003520 con 0x7f67040b7110 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 msgr2=0x7f67040ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f67040ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 >> v1:172.21.15.186:6789/0 conn(0x7f670415c140 legacy=0x7f67040d08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67040cd3e0 con 0x7f67040b7110 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f66fc0019f0 con 0x7f67040b7110 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 >> v1:172.21.15.152:6789/0 conn(0x7f67040b7110 legacy=0x7f67040b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66f00039e0 0x7f66f0003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f0004800 0x7f66f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f66f00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f66f000ba70 con 0x7f66f00039e0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.022+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f66f000bbf0 con 0x7f66f0004800 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f66f000bdf0 con 0x7f67040ce840 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66f00039e0 0x7f66f0003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f66fa59c640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f0004800 0x7f66f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f670359e640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f66f00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 -- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 msgr2=0x7f66f00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f66f00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 -- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f0004800 msgr2=0x7f66f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f0004800 0x7f66f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f6702d9d640 1 -- 172.21.15.152:0/2775677538 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66f0003520 con 0x7f66f00039e0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.023+0000 7f670359e640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040ce840 0x7f66f00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6702d9d640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66f00039e0 0x7f66f0003e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66f4001720 tx=0x7f66f0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa2b20e0424cdc7d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4001370 con 0x7f66f00039e0 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66f40052d0 con 0x7f66f00039e0 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f670259c640 1 -- 172.21.15.152:0/2775677538 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66f4003830 con 0x7f66f00039e0 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 -- 172.21.15.152:0/2775677538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66f00039e0 msgr2=0x7f66f0003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 --2- 172.21.15.152:0/2775677538 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66f00039e0 0x7f66f0003e00 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f66f4001720 tx=0x7f66f0005830 comp rx=0 tx=0).stop 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f670359e640 1 -- 172.21.15.152:0/2775677538 reap_dead start 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 -- 172.21.15.152:0/2775677538 shutdown_connections 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 -- 172.21.15.152:0/2775677538 >> 172.21.15.152:0/2775677538 conn(0x7f670409b160 msgr2=0x7f67040d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 -- 172.21.15.152:0/2775677538 shutdown_connections 2024-03-18T15:01:30.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.024+0000 7f6709036640 1 -- 172.21.15.152:0/2775677538 wait complete. 2024-03-18T15:01:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.026+0000 7f6709036640 1 Processor -- start 2024-03-18T15:01:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.026+0000 7f6709036640 1 -- start start 2024-03-18T15:01:30.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 0x7f6704156c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040c5960 0x7f67040c5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f67040b7cb0 con 0x7f67041574f0 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f67040cd9a0 con 0x7f66f00039e0 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f67040d2710 con 0x7f67040c5960 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36476/0 (socket says 172.21.15.152:36476) 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 -- 172.21.15.152:0/577607916 learned_addr learned my addr 172.21.15.152:0/577607916 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6702d9d640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 0x7f6704156c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f670359e640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040c5960 0x7f67040c5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 -- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040c5960 msgr2=0x7f67040c5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040c5960 0x7f67040c5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.033 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 -- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 msgr2=0x7f6704156c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 0x7f6704156c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 -- 172.21.15.152:0/577607916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67041e7db0 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6702d9d640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 0x7f6704156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fa59c640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0119a0 tx=0x7f66ec011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec00faf0 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66ec00fc90 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66ec014440 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67041e8090 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.027+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67040c9c30 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.028+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f670404f540 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.029+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f66ec012040 con 0x7f67041574f0 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.029+0000 7f66fbfff640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 0x7f66e406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.034 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.030+0000 7f6702d9d640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 0x7f66e406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.030+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f66ec08b090 con 0x7f67041574f0 2024-03-18T15:01:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.030+0000 7f6702d9d640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 0x7f66e406e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f4033000 tx=0x7f66f4009030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.035 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.034+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f66ec019030 con 0x7f67041574f0 2024-03-18T15:01:30.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.212+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f67040ce620 con 0x7f67041574f0 2024-03-18T15:01:30.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.213+0000 7f66fbfff640 1 -- 172.21.15.152:0/577607916 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f66ec059540 con 0x7f67041574f0 2024-03-18T15:01:30.214 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:30.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 msgr2=0x7f66e406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 0x7f66e406e090 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f66f4033000 tx=0x7f66f4009030 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 msgr2=0x7f67041e7440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f66ec0119a0 tx=0x7f66ec011e60 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 shutdown_connections 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66e406bbd0 0x7f66e406e090 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f67040c5960 0x7f67040c5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f67041574f0 0x7f67041e7440 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 --2- 172.21.15.152:0/577607916 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66f00039e0 0x7f6704156c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 >> 172.21.15.152:0/577607916 conn(0x7f670409b160 msgr2=0x7f67040b53d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 shutdown_connections 2024-03-18T15:01:30.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.215+0000 7f6709036640 1 -- 172.21.15.152:0/577607916 wait complete. 2024-03-18T15:01:30.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:30.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.331+0000 7fcec8adc640 1 Processor -- start 2024-03-18T15:01:30.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.331+0000 7fcec8adc640 1 -- start start 2024-03-18T15:01:30.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec8adc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcec406c490 0x7fcec40d29c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec8adc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcec40b1ea0 0x7fcec40d0380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec8adc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcec40ce2d0 con 0x7fcec40cdef0 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec8adc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fcec406c970 con 0x7fcec406c490 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec8adc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcec406cc50 con 0x7fcec40b1ea0 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec1d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcec406c490 0x7fcec40d29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec1d9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcec406c490 0x7fcec40d29c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36490/0 (socket says 172.21.15.152:36490) 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec1d9b640 1 -- 172.21.15.152:0/3539852710 learned_addr learned my addr 172.21.15.152:0/3539852710 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.332+0000 7fcec2d9d640 1 --2- 172.21.15.152:0/3539852710 >> v2:172.21.15.186:3300/0 conn(0x7fcec40b1ea0 0x7fcec40d0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec1d9b640 1 -- 172.21.15.152:0/3539852710 >> v2:172.21.15.186:3300/0 conn(0x7fcec40b1ea0 msgr2=0x7fcec40d0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec1d9b640 1 --2- 172.21.15.152:0/3539852710 >> v2:172.21.15.186:3300/0 conn(0x7fcec40b1ea0 0x7fcec40d0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec1d9b640 1 -- 172.21.15.152:0/3539852710 >> v1:172.21.15.186:6789/0 conn(0x7fcec40cdef0 legacy=0x7fcec40b1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.335 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec1d9b640 1 -- 172.21.15.152:0/3539852710 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec406cf30 con 0x7fcec406c490 2024-03-18T15:01:30.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec1d9b640 1 --2- 172.21.15.152:0/3539852710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec406c490 0x7fcec40d29c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcec4068aa0 tx=0x7fceb802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6da14fff3cce158 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec159a640 1 -- 172.21.15.152:0/3539852710 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8034070 con 0x7fcec406c490 2024-03-18T15:01:30.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec159a640 1 -- 172.21.15.152:0/3539852710 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fceb8030860 con 0x7fcec406c490 2024-03-18T15:01:30.336 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.333+0000 7fcec159a640 1 -- 172.21.15.152:0/3539852710 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb8030c30 con 0x7fcec406c490 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 -- 172.21.15.152:0/3539852710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec406c490 msgr2=0x7fcec40d29c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 --2- 172.21.15.152:0/3539852710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec406c490 0x7fcec40d29c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcec4068aa0 tx=0x7fceb802b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 -- 172.21.15.152:0/3539852710 shutdown_connections 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 --2- 172.21.15.152:0/3539852710 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec406c490 0x7fcec40d29c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 --2- 172.21.15.152:0/3539852710 >> v2:172.21.15.186:3300/0 conn(0x7fcec40b1ea0 0x7fcec40d0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 -- 172.21.15.152:0/3539852710 >> 172.21.15.152:0/3539852710 conn(0x7fcec40d1ea0 msgr2=0x7fcec40d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 -- 172.21.15.152:0/3539852710 shutdown_connections 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.334+0000 7fcec8adc640 1 -- 172.21.15.152:0/3539852710 wait complete. 2024-03-18T15:01:30.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 Processor -- start 2024-03-18T15:01:30.338 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 -- start start 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 0x7fcec415d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 0x7fcec40b73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcec40b31f0 con 0x7fcec40cdef0 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcec406d4f0 con 0x7fcec40b1ea0 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.336+0000 7fcec8adc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcec40cc4f0 con 0x7fcec406c490 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:36500/0 (socket says 172.21.15.152:36500) 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 -- 172.21.15.152:0/372103651 learned_addr learned my addr 172.21.15.152:0/372103651 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec1d9b640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 0x7fcec40b73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec259c640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 0x7fcec415d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 -- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 msgr2=0x7fcec415d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 0x7fcec415d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 -- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 msgr2=0x7fcec40b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 0x7fcec40b73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 -- 172.21.15.152:0/372103651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec40c9e00 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec1d9b640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 0x7fcec40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec259c640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 0x7fcec415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec2d9d640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc018020 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcebc014480 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc014870 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec415dd10 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.337+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec415b6e0 con 0x7fcec40cdef0 2024-03-18T15:01:30.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.338+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcec406d840 con 0x7fcec40cdef0 2024-03-18T15:01:30.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.339+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fcebc005d10 con 0x7fcec40cdef0 2024-03-18T15:01:30.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.339+0000 7fceb2ffd640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 0x7fcea406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.339+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fcebc08b940 con 0x7fcec40cdef0 2024-03-18T15:01:30.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.339+0000 7fcec259c640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 0x7fcea406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.340+0000 7fcec259c640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 0x7fcea406e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcec41f79b0 tx=0x7fceb4009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.347+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fcec406d840 con 0x7fcec40cdef0 2024-03-18T15:01:30.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.525+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fcec404f540 con 0x7fcec40cdef0 2024-03-18T15:01:30.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.526+0000 7fceb2ffd640 1 -- 172.21.15.152:0/372103651 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fcebc022030 con 0x7fcec40cdef0 2024-03-18T15:01:30.527 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:30.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 msgr2=0x7fcea406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 0x7fcea406e090 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcec41f79b0 tx=0x7fceb4009040 comp rx=0 tx=0).stop 2024-03-18T15:01:30.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 msgr2=0x7fcec415b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00efc0 tx=0x7fcebc00c490 comp rx=0 tx=0).stop 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 shutdown_connections 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcec40cdef0 0x7fcec415b1a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcec40b1ea0 0x7fcec40b73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcea406bbd0 0x7fcea406e090 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 --2- 172.21.15.152:0/372103651 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcec406c490 0x7fcec415d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 >> 172.21.15.152:0/372103651 conn(0x7fcec40d1ea0 msgr2=0x7fcec4070500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 shutdown_connections 2024-03-18T15:01:30.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.528+0000 7fcec8adc640 1 -- 172.21.15.152:0/372103651 wait complete. 2024-03-18T15:01:30.543 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T15:01:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.646+0000 7f7ddc522640 1 Processor -- start 2024-03-18T15:01:30.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.646+0000 7f7ddc522640 1 -- start start 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7ddc522640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd40ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7ddc522640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd40cc4b0 con 0x7f7dd415e550 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7ddc522640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7dd406da40 con 0x7f7dd415e930 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7ddc522640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd40ccda0 con 0x7f7dd40cf310 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7dda2be640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7dd415e550 0x7f7dd406d330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54298/0 (socket says 172.21.15.152:54298) 2024-03-18T15:01:30.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.647+0000 7f7dda2be640 1 -- 172.21.15.152:0/3078718223 learned_addr learned my addr 172.21.15.152:0/3078718223 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd9abd640 1 --2- 172.21.15.152:0/3078718223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd40ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3768628395 0 0) 0x7f7dd40cc4b0 con 0x7f7dd415e550 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dc0003520 con 0x7f7dd415e550 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4088218480 0 0) 0x7f7dd406da40 con 0x7f7dd415e930 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7dd40cc4b0 con 0x7f7dd415e930 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd9abd640 1 -- 172.21.15.152:0/3078718223 >> v1:172.21.15.186:6789/0 conn(0x7f7dd415e930 legacy=0x7f7dd40cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd9abd640 1 -- 172.21.15.152:0/3078718223 >> v1:172.21.15.152:6789/0 conn(0x7f7dd415e550 legacy=0x7f7dd406d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1179085937 0 0) 0x7f7dc0003520 con 0x7f7dd415e550 2024-03-18T15:01:30.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.648+0000 7f7dd9abd640 1 -- 172.21.15.152:0/3078718223 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd406dcf0 con 0x7f7dd40cf310 2024-03-18T15:01:30.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7dd9abd640 1 --2- 172.21.15.152:0/3078718223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd40ce6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40097d0 tx=0x7f7dc402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57c065bfd1b00a1c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0001670 con 0x7f7dd40cf310 2024-03-18T15:01:30.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4037070 con 0x7f7dd40cf310 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7dd92bc640 1 -- 172.21.15.152:0/3078718223 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4031780 con 0x7f7dd40cf310 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7ddc522640 1 -- 172.21.15.152:0/3078718223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 msgr2=0x7f7dd40ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.649+0000 7f7ddc522640 1 --2- 172.21.15.152:0/3078718223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd40ce6e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7dc40097d0 tx=0x7f7dc402b8a0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.650+0000 7f7ddc522640 1 -- 172.21.15.152:0/3078718223 shutdown_connections 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.650+0000 7f7ddc522640 1 --2- 172.21.15.152:0/3078718223 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd40ce6e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.650+0000 7f7ddc522640 1 -- 172.21.15.152:0/3078718223 >> 172.21.15.152:0/3078718223 conn(0x7f7dd40d1e60 msgr2=0x7f7dd40d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.650+0000 7f7ddc522640 1 -- 172.21.15.152:0/3078718223 shutdown_connections 2024-03-18T15:01:30.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.650+0000 7f7ddc522640 1 -- 172.21.15.152:0/3078718223 wait complete. 2024-03-18T15:01:30.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 Processor -- start 2024-03-18T15:01:30.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 -- start start 2024-03-18T15:01:30.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd4161530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 0x7f7dd40cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd40aebb0 con 0x7f7dd415e550 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd40cca30 con 0x7f7dd415e930 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.651+0000 7f7ddc522640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd40cec20 con 0x7f7dd40cf310 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46346/0 (socket says 172.21.15.152:46346) 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 -- 172.21.15.152:0/1654359759 learned_addr learned my addr 172.21.15.152:0/1654359759 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dda2be640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd4161530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7ddaabf640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 0x7f7dd40cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 -- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 msgr2=0x7f7dd4161530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd4161530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 -- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 msgr2=0x7f7dd40cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 0x7f7dd40cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 -- 172.21.15.152:0/1654359759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd40c9180 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7ddaabf640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 0x7f7dd40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dda2be640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd4161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dd9abd640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4000c00 tx=0x7f7dc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc4032610 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7dc4031ec0 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd40c9460 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dc40329b0 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.652+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd40c9a20 con 0x7f7dd415e550 2024-03-18T15:01:30.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.653+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd40c9c20 con 0x7f7dd415e550 2024-03-18T15:01:30.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.654+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7dc404c060 con 0x7f7dd415e550 2024-03-18T15:01:30.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.654+0000 7f7dcaffd640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 0x7f7db806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:30.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.654+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f7dc40abf00 con 0x7f7dd415e550 2024-03-18T15:01:30.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.654+0000 7f7dda2be640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 0x7f7db806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:30.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.655+0000 7f7dda2be640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 0x7f7db806e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0000fd0 tx=0x7f7dd0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:30.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.659+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7dd40c9c20 con 0x7f7dd415e550 2024-03-18T15:01:30.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.952+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7dd404f5b0 con 0x7f7dd415e550 2024-03-18T15:01:30.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.952+0000 7f7dcaffd640 1 -- 172.21.15.152:0/1654359759 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f7dc4040070 con 0x7f7dd415e550 2024-03-18T15:01:30.953 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 msgr2=0x7f7db806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 0x7f7db806e090 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f7dd0000fd0 tx=0x7f7dd0009040 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 msgr2=0x7f7dd40cad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7dc4000c00 tx=0x7f7dc40046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 shutdown_connections 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7dd415e930 0x7f7dd40cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7dd415e550 0x7f7dd40cad60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7db806bbd0 0x7f7db806e090 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 --2- 172.21.15.152:0/1654359759 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7dd40cf310 0x7f7dd4161530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 >> 172.21.15.152:0/1654359759 conn(0x7f7dd40d1e60 msgr2=0x7f7dd40aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:30.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 shutdown_connections 2024-03-18T15:01:30.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:30.954+0000 7f7ddc522640 1 -- 172.21.15.152:0/1654359759 wait complete. 2024-03-18T15:01:30.967 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2024-03-18T15:01:30.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:30.967 DEBUG:teuthology.orchestra.run.smithi186:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2024-03-18T15:01:31.001 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T15:01:31.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:31.001 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-03-18T15:01:31.059 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-03-18T15:01:31.059 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:31.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.162+0000 7fac6131b640 1 Processor -- start 2024-03-18T15:01:31.164 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.162+0000 7fac6131b640 1 -- start start 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 0x7fac5c0cd710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fac5c0cdc50 0x7fac5c06b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c06b700 0x7fac5c06e450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c0d0050 con 0x7fac5c0cdc50 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fac5c06bb30 con 0x7fac5c145a50 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac6131b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c0d0b40 con 0x7fac5c06b700 2024-03-18T15:01:31.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac5a7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fac5c0cdc50 0x7fac5c06b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac5a7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fac5c0cdc50 0x7fac5c06b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46350/0 (socket says 172.21.15.152:46350) 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.163+0000 7fac5a7fc640 1 -- 172.21.15.152:0/1804132323 learned_addr learned my addr 172.21.15.152:0/1804132323 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5affd640 1 --2- 172.21.15.152:0/1804132323 >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 0x7fac5c0cd710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5b7fe640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c06b700 0x7fac5c06e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 -- 172.21.15.152:0/1804132323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c06b700 msgr2=0x7fac5c06e450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c06b700 0x7fac5c06e450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 -- 172.21.15.152:0/1804132323 >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 msgr2=0x7fac5c0cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/1804132323 >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 0x7fac5c0cd710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 -- 172.21.15.152:0/1804132323 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c06df70 con 0x7fac5c0cdc50 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5affd640 1 --2- 172.21.15.152:0/1804132323 >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 0x7fac5c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.164+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c06b1c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fac5c062e80 tx=0x7fac5002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dfb8b20a2e9e403 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac59ffb640 1 -- 172.21.15.152:0/1804132323 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50038070 con 0x7fac5c0cdc50 2024-03-18T15:01:31.167 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac59ffb640 1 -- 172.21.15.152:0/1804132323 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5002f050 con 0x7fac5c0cdc50 2024-03-18T15:01:31.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac59ffb640 1 -- 172.21.15.152:0/1804132323 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50031970 con 0x7fac5c0cdc50 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 -- 172.21.15.152:0/1804132323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 msgr2=0x7fac5c06b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c06b1c0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fac5c062e80 tx=0x7fac5002b7f0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 -- 172.21.15.152:0/1804132323 shutdown_connections 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c06b700 0x7fac5c06e450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 --2- 172.21.15.152:0/1804132323 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c06b1c0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 --2- 172.21.15.152:0/1804132323 >> v2:172.21.15.186:3300/0 conn(0x7fac5c145a50 0x7fac5c0cd710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 -- 172.21.15.152:0/1804132323 >> 172.21.15.152:0/1804132323 conn(0x7fac5c0d0d30 msgr2=0x7fac5c0d1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 -- 172.21.15.152:0/1804132323 shutdown_connections 2024-03-18T15:01:31.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.165+0000 7fac6131b640 1 -- 172.21.15.152:0/1804132323 wait complete. 2024-03-18T15:01:31.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.167+0000 7fac6131b640 1 Processor -- start 2024-03-18T15:01:31.170 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.167+0000 7fac6131b640 1 -- start start 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.168+0000 7fac6131b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 0x7fac5c1f2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 0x7fac5c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0d0860 con 0x7fac5c0cdc50 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fac5c0d0580 con 0x7fac5c06b700 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fac5c06e990 con 0x7fac5c145a50 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46358/0 (socket says 172.21.15.152:46358) 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 -- 172.21.15.152:0/3488403034 learned_addr learned my addr 172.21.15.152:0/3488403034 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:31.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5affd640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 0x7fac5c1f2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5b7fe640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 0x7fac5c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 -- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 msgr2=0x7fac5c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 0x7fac5c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 -- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 msgr2=0x7fac5c1f2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 0x7fac5c1f2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 -- 172.21.15.152:0/3488403034 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac5c0aded0 con 0x7fac5c0cdc50 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5affd640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 0x7fac5c1f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5b7fe640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 0x7fac5c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac5a7fc640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fac5002b830 tx=0x7fac500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50042070 con 0x7fac5c0cdc50 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fac5003d890 con 0x7fac5c0cdc50 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac5c0ae190 con 0x7fac5c0cdc50 2024-03-18T15:01:31.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac50038040 con 0x7fac5c0cdc50 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.169+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac5c0aea30 con 0x7fac5c0cdc50 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.170+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac5c04f5b0 con 0x7fac5c0cdc50 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.171+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fac50045070 con 0x7fac5c0cdc50 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.171+0000 7fac437fe640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 0x7fac4806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.171+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fac500ac7b0 con 0x7fac5c0cdc50 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.171+0000 7fac5affd640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 0x7fac4806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.172+0000 7fac5affd640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 0x7fac4806e0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac4c007f40 tx=0x7fac4c007490 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.180+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fac5007b220 con 0x7fac5c0cdc50 2024-03-18T15:01:31.395 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.394+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac5c0b09d0 con 0x7fac5c0cdc50 2024-03-18T15:01:31.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.395+0000 7fac437fe640 1 -- 172.21.15.152:0/3488403034 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fac5007ab20 con 0x7fac5c0cdc50 2024-03-18T15:01:31.396 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:31.396 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:31.397 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 msgr2=0x7fac4806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 0x7fac4806e0c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fac4c007f40 tx=0x7fac4c007490 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 msgr2=0x7fac5c0c5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fac5002b830 tx=0x7fac500046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 shutdown_connections 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fac4806bc00 0x7fac4806e0c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fac5c145a50 0x7fac5c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fac5c0cdc50 0x7fac5c0c5dc0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 --2- 172.21.15.152:0/3488403034 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fac5c06b700 0x7fac5c1f2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 >> 172.21.15.152:0/3488403034 conn(0x7fac5c0d0d30 msgr2=0x7fac5c0b0bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 shutdown_connections 2024-03-18T15:01:31.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.397+0000 7fac6131b640 1 -- 172.21.15.152:0/3488403034 wait complete. 2024-03-18T15:01:31.410 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:31.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 Processor -- start 2024-03-18T15:01:31.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 -- start start 2024-03-18T15:01:31.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35a80d10d0 0x7f35a8162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f35a815ea90 0x7f35a815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35a80b3440 con 0x7f35a81622b0 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.510+0000 7f35aeadc640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80d16c0 con 0x7f35a80d10d0 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35aeadc640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f35a80d2660 con 0x7f35a815ea90 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35a80d10d0 0x7f35a8162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f35a80d10d0 0x7f35a8162da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46364/0 (socket says 172.21.15.152:46364) 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 -- 172.21.15.152:0/918779471 learned_addr learned my addr 172.21.15.152:0/918779471 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35ad079640 1 --2- 172.21.15.152:0/918779471 >> v2:172.21.15.186:3300/0 conn(0x7f35a815ea90 0x7f35a815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 -- 172.21.15.152:0/918779471 >> v2:172.21.15.186:3300/0 conn(0x7f35a815ea90 msgr2=0x7f35a815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 --2- 172.21.15.152:0/918779471 >> v2:172.21.15.186:3300/0 conn(0x7f35a815ea90 0x7f35a815eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 -- 172.21.15.152:0/918779471 >> v1:172.21.15.186:6789/0 conn(0x7f35a81622b0 legacy=0x7f35a8162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:31.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.511+0000 7f35a7fff640 1 -- 172.21.15.152:0/918779471 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a80d20a0 con 0x7f35a80d10d0 2024-03-18T15:01:31.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35a7fff640 1 --2- 172.21.15.152:0/918779471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a80d10d0 0x7f35a8162da0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f359c009870 tx=0x7f359c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=510541291bde2a8e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35a77fe640 1 -- 172.21.15.152:0/918779471 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c038070 con 0x7f35a80d10d0 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35a77fe640 1 -- 172.21.15.152:0/918779471 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f359c02f050 con 0x7f35a80d10d0 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35a77fe640 1 -- 172.21.15.152:0/918779471 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f359c031970 con 0x7f35a80d10d0 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 -- 172.21.15.152:0/918779471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a80d10d0 msgr2=0x7f35a8162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 --2- 172.21.15.152:0/918779471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a80d10d0 0x7f35a8162da0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f359c009870 tx=0x7f359c02b7f0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 -- 172.21.15.152:0/918779471 shutdown_connections 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 --2- 172.21.15.152:0/918779471 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a80d10d0 0x7f35a8162da0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 --2- 172.21.15.152:0/918779471 >> v2:172.21.15.186:3300/0 conn(0x7f35a815ea90 0x7f35a815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.512+0000 7f35aeadc640 1 -- 172.21.15.152:0/918779471 >> 172.21.15.152:0/918779471 conn(0x7f35a80d4070 msgr2=0x7f35a80d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.513+0000 7f35aeadc640 1 -- 172.21.15.152:0/918779471 shutdown_connections 2024-03-18T15:01:31.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.513+0000 7f35aeadc640 1 -- 172.21.15.152:0/918779471 wait complete. 2024-03-18T15:01:31.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.514+0000 7f35aeadc640 1 Processor -- start 2024-03-18T15:01:31.516 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.514+0000 7f35aeadc640 1 -- start start 2024-03-18T15:01:31.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a80d10d0 0x7f35a815de20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35a815ea90 0x7f35a8156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80cfc90 con 0x7f35a81622b0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f35a80d2ab0 con 0x7f35a80d10d0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35aeadc640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f35a80cfe10 con 0x7f35a815ea90 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46374/0 (socket says 172.21.15.152:46374) 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 -- 172.21.15.152:0/3029432191 learned_addr learned my addr 172.21.15.152:0/3029432191 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ac878640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a80d10d0 0x7f35a815de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35a7fff640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35a815ea90 0x7f35a8156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 -- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35a815ea90 msgr2=0x7f35a8156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35a815ea90 0x7f35a8156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 -- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a80d10d0 msgr2=0x7f35a815de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a80d10d0 0x7f35a815de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 -- 172.21.15.152:0/3029432191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35a8158fa0 con 0x7f35a81622b0 2024-03-18T15:01:31.519 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35ad079640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35a000cd70 tx=0x7f35a000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.516+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0003b90 con 0x7f35a81622b0 2024-03-18T15:01:31.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.517+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a0003d30 con 0x7f35a81622b0 2024-03-18T15:01:31.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.517+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35a8157340 con 0x7f35a81622b0 2024-03-18T15:01:31.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.517+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a0004240 con 0x7f35a81622b0 2024-03-18T15:01:31.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.517+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35a815c1b0 con 0x7f35a81622b0 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.518+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35a804f5b0 con 0x7f35a81622b0 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.518+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f35a00043e0 con 0x7f35a81622b0 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.518+0000 7f35a57fa640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 0x7f359406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.519+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f35a008b560 con 0x7f35a81622b0 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.519+0000 7f35ac878640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 0x7f359406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.519+0000 7f35ac878640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 0x7f359406e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3598004ea0 tx=0x7f3598009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.523+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f35a005a060 con 0x7f35a81622b0 2024-03-18T15:01:31.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.703+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f35a80d18d0 con 0x7f35a81622b0 2024-03-18T15:01:31.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.704+0000 7f35a57fa640 1 -- 172.21.15.152:0/3029432191 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16903 (secure 0 0 0) 0x7f35a0059960 con 0x7f35a81622b0 2024-03-18T15:01:31.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:31.706 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:28.902062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 msgr2=0x7f359406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 0x7f359406e090 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f3598004ea0 tx=0x7f3598009040 comp rx=0 tx=0).stop 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 msgr2=0x7f35a80c9b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f35a000cd70 tx=0x7f35a000a660 comp rx=0 tx=0).stop 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 shutdown_connections 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f35a81622b0 0x7f35a80c9b60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f359406bbd0 0x7f359406e090 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f35a815ea90 0x7f35a8156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 --2- 172.21.15.152:0/3029432191 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f35a80d10d0 0x7f35a815de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.706+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 >> 172.21.15.152:0/3029432191 conn(0x7f35a80d4070 msgr2=0x7f35a8162690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.707+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 shutdown_connections 2024-03-18T15:01:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.707+0000 7f35aeadc640 1 -- 172.21.15.152:0/3029432191 wait complete. 2024-03-18T15:01:31.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:00:46.669412+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:00:47.913851+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:31.719 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:31.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.823+0000 7f66d2e8c640 1 Processor -- start 2024-03-18T15:01:31.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.823+0000 7f66d2e8c640 1 -- start start 2024-03-18T15:01:31.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66d2e8c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f66cc161890 0x7f66cc0d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66d2e8c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66cc0cffe0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66d2e8c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66cc0cfa20 con 0x7f66cc0d1070 2024-03-18T15:01:31.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66d2e8c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f66cc0cfd00 con 0x7f66cc161890 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66d0c28640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f66cc161890 0x7f66cc0d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66c3fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f66cc0b4ec0 0x7f66cc0d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54312/0 (socket says 172.21.15.152:54312) 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.824+0000 7f66c3fff640 1 -- 172.21.15.152:0/3197941739 learned_addr learned my addr 172.21.15.152:0/3197941739 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.825+0000 7f66d0c28640 1 -- 172.21.15.152:0/3197941739 >> v1:172.21.15.186:6789/0 conn(0x7f66cc0d1070 legacy=0x7f66cc0d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.825+0000 7f66d0c28640 1 -- 172.21.15.152:0/3197941739 >> v1:172.21.15.152:6789/0 conn(0x7f66cc0b4ec0 legacy=0x7f66cc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.825+0000 7f66d0c28640 1 -- 172.21.15.152:0/3197941739 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc0cf710 con 0x7f66cc161890 2024-03-18T15:01:31.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.825+0000 7f66c37fe640 1 -- 172.21.15.152:0/3197941739 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 672611472 0 0) 0x7f66cc0cffe0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.825+0000 7f66d0c28640 1 --2- 172.21.15.152:0/3197941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc161890 0x7f66cc0d4bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66c80097a0 tx=0x7f66c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5cc7ba010615382 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66c37fe640 1 -- 172.21.15.152:0/3197941739 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8035020 con 0x7f66cc161890 2024-03-18T15:01:31.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66c37fe640 1 -- 172.21.15.152:0/3197941739 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c8031830 con 0x7f66cc161890 2024-03-18T15:01:31.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66c37fe640 1 -- 172.21.15.152:0/3197941739 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c8031c00 con 0x7f66cc161890 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 -- 172.21.15.152:0/3197941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc161890 msgr2=0x7f66cc0d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/3197941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc161890 0x7f66cc0d4bb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66c80097a0 tx=0x7f66c802b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 -- 172.21.15.152:0/3197941739 shutdown_connections 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/3197941739 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc161890 0x7f66cc0d4bb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 -- 172.21.15.152:0/3197941739 >> 172.21.15.152:0/3197941739 conn(0x7f66cc0d4090 msgr2=0x7f66cc0d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 -- 172.21.15.152:0/3197941739 shutdown_connections 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.826+0000 7f66d2e8c640 1 -- 172.21.15.152:0/3197941739 wait complete. 2024-03-18T15:01:31.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.828+0000 7f66d2e8c640 1 Processor -- start 2024-03-18T15:01:31.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.828+0000 7f66d2e8c640 1 -- start start 2024-03-18T15:01:31.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66cc0d1070 0x7f66cc0c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 0x7f66cc0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc0b6ee0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f66cc0b5580 con 0x7f66cc0d1070 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f66cc0b7060 con 0x7f66cc161890 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46392/0 (socket says 172.21.15.152:46392) 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 -- 172.21.15.152:0/360396072 learned_addr learned my addr 172.21.15.152:0/360396072 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66c3fff640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66cc0d1070 0x7f66cc0c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d1429640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 0x7f66cc0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 -- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 msgr2=0x7f66cc0ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 0x7f66cc0ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 -- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66cc0d1070 msgr2=0x7f66cc0c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66cc0d1070 0x7f66cc0c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 -- 172.21.15.152:0/360396072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66cc15dfa0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d1429640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 0x7f66cc0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d0c28640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66c80098c0 tx=0x7f66c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c803ba80 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66c803bc20 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66c80453f0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66cc0cb160 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.830+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66cc0ce3a0 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.831+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66cc04f540 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.832+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f66c804c060 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.832+0000 7f66c17fa640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 0x7f66b806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.832+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f66c80ac840 con 0x7f66cc0b4ec0 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.832+0000 7f66c3fff640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 0x7f66b806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:31.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.833+0000 7f66c3fff640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 0x7f66b806e0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0b9c70 tx=0x7f66bc007c00 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:31.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:31.841+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f66c8040070 con 0x7f66cc0b4ec0 2024-03-18T15:01:32.020 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.019+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f66cc08d7e0 con 0x7f66cc0b4ec0 2024-03-18T15:01:32.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.020+0000 7f66c17fa640 1 -- 172.21.15.152:0/360396072 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f66c802f2e0 con 0x7f66cc0b4ec0 2024-03-18T15:01:32.021 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:32.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.021+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 msgr2=0x7f66b806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.021+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 0x7f66b806e0c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f66cc0b9c70 tx=0x7f66bc007c00 comp rx=0 tx=0).stop 2024-03-18T15:01:32.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.021+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 msgr2=0x7f66cc1f3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.021+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66c80098c0 tx=0x7f66c80046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 shutdown_connections 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f66b806bc00 0x7f66b806e0c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f66cc161890 0x7f66cc0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f66cc0d1070 0x7f66cc0c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 --2- 172.21.15.152:0/360396072 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f66cc0b4ec0 0x7f66cc1f3eb0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 >> 172.21.15.152:0/360396072 conn(0x7f66cc0d4090 msgr2=0x7f66cc0b80d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 shutdown_connections 2024-03-18T15:01:32.024 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.022+0000 7f66d2e8c640 1 -- 172.21.15.152:0/360396072 wait complete. 2024-03-18T15:01:32.034 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T15:01:32.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.168+0000 7fb37bfcd640 1 Processor -- start 2024-03-18T15:01:32.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.168+0000 7fb37bfcd640 1 -- start start 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37bfcd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb3740d1070 0x7fb3740d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37bfcd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3740b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37bfcd640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3740cffe0 con 0x7fb374161890 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37bfcd640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb3740cfa20 con 0x7fb3740d1070 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37bfcd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740cfd00 con 0x7fb3740b4ec0 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb379d69640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb374161890 0x7fb3740d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54316/0 (socket says 172.21.15.152:54316) 2024-03-18T15:01:32.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb379d69640 1 -- 172.21.15.152:0/2372000913 learned_addr learned my addr 172.21.15.152:0/2372000913 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb379568640 1 --2- 172.21.15.152:0/2372000913 >> v2:172.21.15.186:3300/0 conn(0x7fb3740d1070 0x7fb3740d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb37a56a640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3740b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3424883507 0 0) 0x7fb3740cffe0 con 0x7fb374161890 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb360003520 con 0x7fb374161890 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1958698721 0 0) 0x7fb360003520 con 0x7fb374161890 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 msgr2=0x7fb3740b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3740b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 >> v2:172.21.15.186:3300/0 conn(0x7fb3740d1070 msgr2=0x7fb3740d4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 --2- 172.21.15.152:0/2372000913 >> v2:172.21.15.186:3300/0 conn(0x7fb3740d1070 0x7fb3740d4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740cf710 con 0x7fb374161890 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fb370001670 con 0x7fb374161890 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 >> v1:172.21.15.152:6789/0 conn(0x7fb374161890 legacy=0x7fb3740d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.169+0000 7fb378d67640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3600039b0 0x7fb360003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb378d67640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360004800 0x7fb360004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb378d67640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740cfa20 con 0x7fb360004800 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740cfd00 con 0x7fb3600039b0 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb36000b9c0 con 0x7fb3740b4ec0 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360004800 0x7fb360004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb37a56a640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379d69640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3600039b0 0x7fb360003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 -- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 msgr2=0x7fb3600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3740b4ec0 0x7fb3600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 -- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3600039b0 msgr2=0x7fb360003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb3600039b0 0x7fb360003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.170+0000 7fb379568640 1 -- 172.21.15.152:0/2372000913 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb360003520 con 0x7fb360004800 2024-03-18T15:01:32.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb379568640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360004800 0x7fb360004c80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ac0 tx=0x7fb360005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d2713376c225ab1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364039070 con 0x7fb360004800 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36402c710 con 0x7fb360004800 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb378d67640 1 -- 172.21.15.152:0/2372000913 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364009690 con 0x7fb360004800 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37bfcd640 1 -- 172.21.15.152:0/2372000913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360004800 msgr2=0x7fb360004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/2372000913 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb360004800 0x7fb360004c80 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb364009ac0 tx=0x7fb360005830 comp rx=0 tx=0).stop 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37a56a640 1 -- 172.21.15.152:0/2372000913 reap_dead start 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37bfcd640 1 -- 172.21.15.152:0/2372000913 shutdown_connections 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37bfcd640 1 -- 172.21.15.152:0/2372000913 >> 172.21.15.152:0/2372000913 conn(0x7fb3740d4090 msgr2=0x7fb3740d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.171+0000 7fb37bfcd640 1 -- 172.21.15.152:0/2372000913 shutdown_connections 2024-03-18T15:01:32.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.172+0000 7fb37bfcd640 1 -- 172.21.15.152:0/2372000913 wait complete. 2024-03-18T15:01:32.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 Processor -- start 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 -- start start 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb360004800 0x7fb3740cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3741f4040 0x7fb3740cd230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740b6ee0 con 0x7fb3740ce060 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb3740b5580 con 0x7fb360004800 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb37bfcd640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb3740b7060 con 0x7fb3741f4040 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.173+0000 7fb379568640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46404/0 (socket says 172.21.15.152:46404) 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 -- 172.21.15.152:0/3442560894 learned_addr learned my addr 172.21.15.152:0/3442560894 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379d69640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb360004800 0x7fb3740cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb37a56a640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3741f4040 0x7fb3740cd230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 -- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3741f4040 msgr2=0x7fb3740cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3741f4040 0x7fb3740cd230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 -- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb360004800 msgr2=0x7fb3740cbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb360004800 0x7fb3740cbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 -- 172.21.15.152:0/3442560894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3740cc190 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb379568640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb3640099e0 tx=0x7fb364004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb364039050 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb36403a040 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3740cc470 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3640044e0 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.174+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3740ccd10 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.175+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3740cc860 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.176+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb364047030 con 0x7fb3740ce060 2024-03-18T15:01:32.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.176+0000 7fb36a7fc640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 0x7fb35806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.176+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb3640abfd0 con 0x7fb3740ce060 2024-03-18T15:01:32.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.176+0000 7fb379d69640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 0x7fb35806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.177+0000 7fb379d69640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 0x7fb35806e090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb370001eb0 tx=0x7fb370007970 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.181+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb36404e060 con 0x7fb3740ce060 2024-03-18T15:01:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.358+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb3740cc640 con 0x7fb3740ce060 2024-03-18T15:01:32.360 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.358+0000 7fb36a7fc640 1 -- 172.21.15.152:0/3442560894 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7fb36407a480 con 0x7fb3740ce060 2024-03-18T15:01:32.360 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 msgr2=0x7fb35806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 0x7fb35806e090 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fb370001eb0 tx=0x7fb370007970 comp rx=0 tx=0).stop 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 msgr2=0x7fb3741493f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb3640099e0 tx=0x7fb364004730 comp rx=0 tx=0).stop 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 shutdown_connections 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb35806bbd0 0x7fb35806e090 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3741f4040 0x7fb3740cd230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3740ce060 0x7fb3741493f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 --2- 172.21.15.152:0/3442560894 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb360004800 0x7fb3740cbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 >> 172.21.15.152:0/3442560894 conn(0x7fb3740d4090 msgr2=0x7fb3740d3330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 shutdown_connections 2024-03-18T15:01:32.364 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.361+0000 7fb37bfcd640 1 -- 172.21.15.152:0/3442560894 wait complete. 2024-03-18T15:01:32.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T15:01:32.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.477+0000 7fa81d4d1640 1 Processor -- start 2024-03-18T15:01:32.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.477+0000 7fa81d4d1640 1 -- start start 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa81d4d1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa81815c140 0x7fa8180d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa81d4d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180ce840 0x7fa8180ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa81d4d1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8180cce20 con 0x7fa8180b7110 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa81d4d1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa8180cf1e0 con 0x7fa81815c140 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa81d4d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180cd100 con 0x7fa8180ce840 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa81815c140 0x7fa8180d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa81815c140 0x7fa8180d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46420/0 (socket says 172.21.15.152:46420) 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 -- 172.21.15.152:0/2593333867 learned_addr learned my addr 172.21.15.152:0/2593333867 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:32.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa8167fc640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180ce840 0x7fa8180ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 -- 172.21.15.152:0/2593333867 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180ce840 msgr2=0x7fa8180ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180ce840 0x7fa8180ceca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 -- 172.21.15.152:0/2593333867 >> v1:172.21.15.186:6789/0 conn(0x7fa8180b7110 legacy=0x7fa8180b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.481 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.478+0000 7fa816ffd640 1 -- 172.21.15.152:0/2593333867 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180cd3e0 con 0x7fa81815c140 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.479+0000 7fa816ffd640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180d08c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009870 tx=0x7fa80c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=162a9c5db655a590 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.479+0000 7fa815ffb640 1 -- 172.21.15.152:0/2593333867 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c035020 con 0x7fa81815c140 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.479+0000 7fa815ffb640 1 -- 172.21.15.152:0/2593333867 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa80c031640 con 0x7fa81815c140 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.479+0000 7fa815ffb640 1 -- 172.21.15.152:0/2593333867 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa80c02d040 con 0x7fa81815c140 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 -- 172.21.15.152:0/2593333867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 msgr2=0x7fa8180d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180d08c0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fa80c009870 tx=0x7fa80c02b8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 -- 172.21.15.152:0/2593333867 shutdown_connections 2024-03-18T15:01:32.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180ce840 0x7fa8180ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/2593333867 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180d08c0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 -- 172.21.15.152:0/2593333867 >> 172.21.15.152:0/2593333867 conn(0x7fa81809b160 msgr2=0x7fa8180d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 -- 172.21.15.152:0/2593333867 shutdown_connections 2024-03-18T15:01:32.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.480+0000 7fa81d4d1640 1 -- 172.21.15.152:0/2593333867 wait complete. 2024-03-18T15:01:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.481+0000 7fa81d4d1640 1 Processor -- start 2024-03-18T15:01:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.481+0000 7fa81d4d1640 1 -- start start 2024-03-18T15:01:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180b7110 0x7fa818157970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8180ce840 0x7fa8180aef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180b7cb0 con 0x7fa81815c140 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa8180cd9a0 con 0x7fa8180ce840 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa81d4d1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa8180d0e00 con 0x7fa8180b7110 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa8177fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46428/0 (socket says 172.21.15.152:46428) 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa8177fe640 1 -- 172.21.15.152:0/3864926430 learned_addr learned my addr 172.21.15.152:0/3864926430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa816ffd640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180b7110 0x7fa818157970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.482+0000 7fa8167fc640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8180ce840 0x7fa8180aef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 -- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180b7110 msgr2=0x7fa818157970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180b7110 0x7fa818157970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 -- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8180ce840 msgr2=0x7fa8180aef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8180ce840 0x7fa8180aef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 -- 172.21.15.152:0/3864926430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8180ca210 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa8177fe640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c7b0 tx=0x7fa81000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa810004b60 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa810004d00 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa81000aa90 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8180ca4f0 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.483+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8180c6d10 con 0x7fa81815c140 2024-03-18T15:01:32.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.484+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa81804f540 con 0x7fa81815c140 2024-03-18T15:01:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.484+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa81000ac30 con 0x7fa81815c140 2024-03-18T15:01:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.485+0000 7fa7ff7fe640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 0x7fa80406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.485+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fa81008abe0 con 0x7fa81815c140 2024-03-18T15:01:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.485+0000 7fa816ffd640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 0x7fa80406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.485+0000 7fa816ffd640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 0x7fa80406e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa80c036000 tx=0x7fa80c03c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.490 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.489+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa810020070 con 0x7fa81815c140 2024-03-18T15:01:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.707+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa8180ce620 con 0x7fa81815c140 2024-03-18T15:01:32.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.708+0000 7fa7ff7fe640 1 -- 172.21.15.152:0/3864926430 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fa810059090 con 0x7fa81815c140 2024-03-18T15:01:32.709 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T15:01:32.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 msgr2=0x7fa80406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 0x7fa80406e090 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa80c036000 tx=0x7fa80c03c040 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 msgr2=0x7fa8180af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa81000c7b0 tx=0x7fa81000cc70 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 shutdown_connections 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa81815c140 0x7fa8180af4c0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa8180ce840 0x7fa8180aef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa80406bbd0 0x7fa80406e090 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 --2- 172.21.15.152:0/3864926430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8180b7110 0x7fa818157970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 >> 172.21.15.152:0/3864926430 conn(0x7fa81809b160 msgr2=0x7fa8180b6680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 shutdown_connections 2024-03-18T15:01:32.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.710+0000 7fa81d4d1640 1 -- 172.21.15.152:0/3864926430 wait complete. 2024-03-18T15:01:32.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:32.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.823+0000 7fe8bb33b640 1 Processor -- start 2024-03-18T15:01:32.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.823+0000 7fe8bb33b640 1 -- start start 2024-03-18T15:01:32.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8bb33b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe8b40d10d0 0x7fe8b4162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8bb33b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b40b3440 con 0x7fe8b41622b0 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8bb33b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8b40d20a0 con 0x7fe8b415ea90 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8bb33b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe8b40d16c0 con 0x7fe8b40d10d0 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b88d6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe8b40d10d0 0x7fe8b4162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b90d7640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe8b41622b0 0x7fe8b4162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54320/0 (socket says 172.21.15.152:54320) 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b90d7640 1 -- 172.21.15.152:0/1221245715 learned_addr learned my addr 172.21.15.152:0/1221245715 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b88d6640 1 -- 172.21.15.152:0/1221245715 >> v1:172.21.15.186:6789/0 conn(0x7fe8b415ea90 legacy=0x7fe8b415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b88d6640 1 -- 172.21.15.152:0/1221245715 >> v1:172.21.15.152:6789/0 conn(0x7fe8b41622b0 legacy=0x7fe8b4162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.824+0000 7fe8b88d6640 1 -- 172.21.15.152:0/1221245715 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b40d2380 con 0x7fe8b40d10d0 2024-03-18T15:01:32.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.825+0000 7fe8b88d6640 1 --2- 172.21.15.152:0/1221245715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b40d10d0 0x7fe8b4162da0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097d0 tx=0x7fe8a402b5d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb809358deab35e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.825+0000 7fe8abfff640 1 -- 172.21.15.152:0/1221245715 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4037070 con 0x7fe8b40d10d0 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.825+0000 7fe8abfff640 1 -- 172.21.15.152:0/1221245715 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8a4030710 con 0x7fe8b40d10d0 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.825+0000 7fe8abfff640 1 -- 172.21.15.152:0/1221245715 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8a4030ae0 con 0x7fe8b40d10d0 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1221245715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b40d10d0 msgr2=0x7fe8b4162da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1221245715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b40d10d0 0x7fe8b4162da0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe8a40097d0 tx=0x7fe8a402b5d0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1221245715 shutdown_connections 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1221245715 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b40d10d0 0x7fe8b4162da0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1221245715 >> 172.21.15.152:0/1221245715 conn(0x7fe8b40d4070 msgr2=0x7fe8b40d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1221245715 shutdown_connections 2024-03-18T15:01:32.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.826+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1221245715 wait complete. 2024-03-18T15:01:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.827+0000 7fe8bb33b640 1 Processor -- start 2024-03-18T15:01:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.827+0000 7fe8bb33b640 1 -- start start 2024-03-18T15:01:32.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.827+0000 7fe8bb33b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8b40d10d0 0x7fe8b40cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.827+0000 7fe8bb33b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 0x7fe8b414ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8bb33b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8bb33b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b40cfc90 con 0x7fe8b41622b0 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8bb33b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8b40d2660 con 0x7fe8b40d10d0 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8bb33b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe8b40cfe10 con 0x7fe8b415ea90 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46452/0 (socket says 172.21.15.152:46452) 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 -- 172.21.15.152:0/1538596612 learned_addr learned my addr 172.21.15.152:0/1538596612 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b90d7640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8b40d10d0 0x7fe8b40cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b88d6640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 0x7fe8b414ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 -- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 msgr2=0x7fe8b414ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 0x7fe8b414ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 -- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8b40d10d0 msgr2=0x7fe8b40cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8b40d10d0 0x7fe8b40cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 -- 172.21.15.152:0/1538596612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8b40cb680 con 0x7fe8b41622b0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b88d6640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 0x7fe8b414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8b98d8640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c780 tx=0x7fe8ac00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac017070 con 0x7fe8b41622b0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8ac003da0 con 0x7fe8b41622b0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8ac0052b0 con 0x7fe8b41622b0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.828+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8b40b81b0 con 0x7fe8b41622b0 2024-03-18T15:01:32.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.829+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8b40b8770 con 0x7fe8b41622b0 2024-03-18T15:01:32.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.830+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8b404f5b0 con 0x7fe8b41622b0 2024-03-18T15:01:32.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.830+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe8ac01a070 con 0x7fe8b41622b0 2024-03-18T15:01:32.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.831+0000 7fe8a9ffb640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 0x7fe89806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:32.833 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.831+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fe8ac08a030 con 0x7fe8b41622b0 2024-03-18T15:01:32.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.831+0000 7fe8b90d7640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 0x7fe89806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:32.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.831+0000 7fe8b90d7640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 0x7fe89806e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000f60 tx=0x7fe8b0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:32.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:32.835+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe8ac0584e0 con 0x7fe8b41622b0 2024-03-18T15:01:33.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.053+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8b40d18d0 con 0x7fe8b41622b0 2024-03-18T15:01:33.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.053+0000 7fe8a9ffb640 1 -- 172.21.15.152:0/1538596612 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fe8ac05c580 con 0x7fe8b41622b0 2024-03-18T15:01:33.055 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:33.055 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:33.055 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 msgr2=0x7fe89806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 0x7fe89806e090 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0000f60 tx=0x7fe8b0009040 comp rx=0 tx=0).stop 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 msgr2=0x7fe8b41f4da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe8ac00c780 tx=0x7fe8ac00cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 shutdown_connections 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8b41622b0 0x7fe8b41f4da0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe89806bbd0 0x7fe89806e090 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.057 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8b415ea90 0x7fe8b414ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 --2- 172.21.15.152:0/1538596612 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8b40d10d0 0x7fe8b40cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 >> 172.21.15.152:0/1538596612 conn(0x7fe8b40d4070 msgr2=0x7fe8b40b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 shutdown_connections 2024-03-18T15:01:33.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.055+0000 7fe8bb33b640 1 -- 172.21.15.152:0/1538596612 wait complete. 2024-03-18T15:01:33.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:33.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.172+0000 7f83fbaf8640 1 Processor -- start 2024-03-18T15:01:33.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.172+0000 7f83fbaf8640 1 -- start start 2024-03-18T15:01:33.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83fbaf8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 0x7f83f40d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83fbaf8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f40b3440 con 0x7f83f4162690 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83fbaf8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f40d20a0 con 0x7f83f415ea90 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83fbaf8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f83f4163200 con 0x7f83f41622b0 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9093640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f83f4162690 0x7f83f4162af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54336/0 (socket says 172.21.15.152:54336) 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9093640 1 -- 172.21.15.152:0/3867760124 learned_addr learned my addr 172.21.15.152:0/3867760124 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9894640 1 --2- 172.21.15.152:0/3867760124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 0x7f83f40d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2001329357 0 0) 0x7f83f40b3440 con 0x7f83f4162690 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83e0003520 con 0x7f83f4162690 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2048167755 0 0) 0x7f83f40d20a0 con 0x7f83f415ea90 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f83f40b3440 con 0x7f83f415ea90 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9894640 1 -- 172.21.15.152:0/3867760124 >> v1:172.21.15.186:6789/0 conn(0x7f83f415ea90 legacy=0x7f83f415ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1591414940 0 0) 0x7f83e0003520 con 0x7f83f4162690 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9894640 1 -- 172.21.15.152:0/3867760124 >> v1:172.21.15.152:6789/0 conn(0x7f83f4162690 legacy=0x7f83f4162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.173+0000 7f83f9894640 1 -- 172.21.15.152:0/3867760124 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f40d2380 con 0x7f83f41622b0 2024-03-18T15:01:33.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.174+0000 7f83f9894640 1 --2- 172.21.15.152:0/3867760124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 0x7f83f40d10d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097d0 tx=0x7f83f002b6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8302bd0a458914d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.174+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83f0037070 con 0x7f83f41622b0 2024-03-18T15:01:33.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.174+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83f0030510 con 0x7f83f41622b0 2024-03-18T15:01:33.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.174+0000 7f83f8892640 1 -- 172.21.15.152:0/3867760124 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4001670 con 0x7f83f41622b0 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 -- 172.21.15.152:0/3867760124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 msgr2=0x7f83f40d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/3867760124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 0x7f83f40d10d0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f83f00097d0 tx=0x7f83f002b6e0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 -- 172.21.15.152:0/3867760124 shutdown_connections 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/3867760124 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f41622b0 0x7f83f40d10d0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 -- 172.21.15.152:0/3867760124 >> 172.21.15.152:0/3867760124 conn(0x7f83f40d4070 msgr2=0x7f83f40d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 -- 172.21.15.152:0/3867760124 shutdown_connections 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.175+0000 7f83fbaf8640 1 -- 172.21.15.152:0/3867760124 wait complete. 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.176+0000 7f83fbaf8640 1 Processor -- start 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.176+0000 7f83fbaf8640 1 -- start start 2024-03-18T15:01:33.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f415ea90 0x7f83f40ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 0x7f83f40b3630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f83f40d2660 con 0x7f83f41622b0 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83f40d16c0 con 0x7f83f4162690 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fbaf8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f83f40cfc90 con 0x7f83f415ea90 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83f9093640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83f9093640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46458/0 (socket says 172.21.15.152:46458) 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83f9093640 1 -- 172.21.15.152:0/807431206 learned_addr learned my addr 172.21.15.152:0/807431206 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83f9894640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f415ea90 0x7f83f40ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.177+0000 7f83fa095640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 0x7f83f40b3630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 -- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f415ea90 msgr2=0x7f83f40ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f415ea90 0x7f83f40ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 -- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 msgr2=0x7f83f40b3630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 0x7f83f40b3630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 -- 172.21.15.152:0/807431206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f40cbd50 con 0x7f83f41622b0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83fa095640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 0x7f83f40b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83f9093640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c780 tx=0x7f83e400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4017070 con 0x7f83f41622b0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4005af0 con 0x7f83f41622b0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f40cc030 con 0x7f83f41622b0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4007070 con 0x7f83f41622b0 2024-03-18T15:01:33.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.178+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f40cc5f0 con 0x7f83f41622b0 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.179+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83f404f5b0 con 0x7f83f41622b0 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.179+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f83e401a070 con 0x7f83f41622b0 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.180+0000 7f83ea7fc640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 0x7f83d806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.180+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f83e408a0a0 con 0x7f83f41622b0 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.180+0000 7f83f9894640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 0x7f83d806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.180+0000 7f83f9894640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 0x7f83d806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83f0034000 tx=0x7f83f0008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.184+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f83e4058440 con 0x7f83f41622b0 2024-03-18T15:01:33.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.361+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f83f40d18d0 con 0x7f83f41622b0 2024-03-18T15:01:33.363 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.362+0000 7f83ea7fc640 1 -- 172.21.15.152:0/807431206 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16903 (secure 0 0 0) 0x7f83e405c4e0 con 0x7f83f41622b0 2024-03-18T15:01:33.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:33.364 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:28.902062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 msgr2=0x7f83d806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 0x7f83d806e090 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f83f0034000 tx=0x7f83f0008030 comp rx=0 tx=0).stop 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 msgr2=0x7f83f4156530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c780 tx=0x7f83e400cc40 comp rx=0 tx=0).stop 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 shutdown_connections 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f4162690 0x7f83f40b3630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f41622b0 0x7f83f4156530 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.366 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83d806bbd0 0x7f83d806e090 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 --2- 172.21.15.152:0/807431206 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f415ea90 0x7f83f40ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.364+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 >> 172.21.15.152:0/807431206 conn(0x7f83f40d4070 msgr2=0x7f83f406c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.365+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 shutdown_connections 2024-03-18T15:01:33.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.365+0000 7f83fbaf8640 1 -- 172.21.15.152:0/807431206 wait complete. 2024-03-18T15:01:33.380 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T15:01:33.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:33.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.483+0000 7f8b00576640 1 Processor -- start 2024-03-18T15:01:33.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.483+0000 7f8b00576640 1 -- start start 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8af80cda20 0x7f8af806e680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80cede0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8af806bf90 0x7f8af806c420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8af806b4f0 con 0x7f8af806bf90 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8af815ec10 con 0x7f8af80cda20 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8b00576640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8af815eef0 con 0x7f8af80cde00 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8af806bf90 0x7f8af806c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8af806bf90 0x7f8af806c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46460/0 (socket says 172.21.15.152:46460) 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 -- 172.21.15.152:0/986914314 learned_addr learned my addr 172.21.15.152:0/986914314 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afe312640 1 --2- 172.21.15.152:0/986914314 >> v2:172.21.15.186:3300/0 conn(0x7f8af80cda20 0x7f8af806e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afdb11640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80cede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 -- 172.21.15.152:0/986914314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 msgr2=0x7f8af80cede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:33.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80cede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 -- 172.21.15.152:0/986914314 >> v2:172.21.15.186:3300/0 conn(0x7f8af80cda20 msgr2=0x7f8af806e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:33.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 --2- 172.21.15.152:0/986914314 >> v2:172.21.15.186:3300/0 conn(0x7f8af80cda20 0x7f8af806e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.484+0000 7f8afeb13640 1 -- 172.21.15.152:0/986914314 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af815f1d0 con 0x7f8af806bf90 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.485+0000 7f8afeb13640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af806c420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8af809ef80 tx=0x7f8af402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce850b5547456b8b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.485+0000 7f8afd310640 1 -- 172.21.15.152:0/986914314 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af402ca70 con 0x7f8af806bf90 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.485+0000 7f8afd310640 1 -- 172.21.15.152:0/986914314 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af402cc10 con 0x7f8af806bf90 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.485+0000 7f8afd310640 1 -- 172.21.15.152:0/986914314 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af40343f0 con 0x7f8af806bf90 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 -- 172.21.15.152:0/986914314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 msgr2=0x7f8af806c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af806c420 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f8af809ef80 tx=0x7f8af402bed0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 -- 172.21.15.152:0/986914314 shutdown_connections 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af806c420 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 --2- 172.21.15.152:0/986914314 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 --2- 172.21.15.152:0/986914314 >> v2:172.21.15.186:3300/0 conn(0x7f8af80cda20 0x7f8af806e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 -- 172.21.15.152:0/986914314 >> 172.21.15.152:0/986914314 conn(0x7f8af80b2ab0 msgr2=0x7f8af80b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 -- 172.21.15.152:0/986914314 shutdown_connections 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.486+0000 7f8b00576640 1 -- 172.21.15.152:0/986914314 wait complete. 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.488+0000 7f8b00576640 1 Processor -- start 2024-03-18T15:01:33.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.488+0000 7f8b00576640 1 -- start start 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 0x7f8af8159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80aea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8af806ebc0 con 0x7f8af806bf90 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8af815f790 con 0x7f8af80cda20 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8b00576640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8af815e8c0 con 0x7f8af80cde00 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8afe312640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8afe312640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46474/0 (socket says 172.21.15.152:46474) 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.489+0000 7f8afe312640 1 -- 172.21.15.152:0/4227257009 learned_addr learned my addr 172.21.15.152:0/4227257009 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afdb11640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 0x7f8af8159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.492 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 -- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 msgr2=0x7f8af80aea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80aea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 -- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 msgr2=0x7f8af8159f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 0x7f8af8159f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 -- 172.21.15.152:0/4227257009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8af80b15d0 con 0x7f8af806bf90 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afdb11640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 0x7f8af8159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8afe312640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e870 tx=0x7f8af000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af0017070 con 0x7f8af806bf90 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8af000ee60 con 0x7f8af806bf90 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af000cb80 con 0x7f8af806bf90 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8af80b18b0 con 0x7f8af806bf90 2024-03-18T15:01:33.493 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.490+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8af80b1e70 con 0x7f8af806bf90 2024-03-18T15:01:33.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.491+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8af804f5b0 con 0x7f8af806bf90 2024-03-18T15:01:33.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.491+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8af001a070 con 0x7f8af806bf90 2024-03-18T15:01:33.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.492+0000 7f8aeeffd640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 0x7f8adc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.494 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.492+0000 7f8afdb11640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 0x7f8adc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.492+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7f8af008ac30 con 0x7f8af806bf90 2024-03-18T15:01:33.495 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.493+0000 7f8afdb11640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 0x7f8adc06e090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b0f80 tx=0x7f8ae8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.496+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8af0059730 con 0x7f8af806bf90 2024-03-18T15:01:33.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.718+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8af815a4b0 con 0x7f8af806bf90 2024-03-18T15:01:33.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.719+0000 7f8aeeffd640 1 -- 172.21.15.152:0/4227257009 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7f8af0059030 con 0x7f8af806bf90 2024-03-18T15:01:33.720 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:33.720 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:33.721 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:33.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.720+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 msgr2=0x7f8adc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.720+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 0x7f8adc06e090 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b0f80 tx=0x7f8ae8008040 comp rx=0 tx=0).stop 2024-03-18T15:01:33.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.720+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 msgr2=0x7f8af80b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.720+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8af000e870 tx=0x7f8af000ed30 comp rx=0 tx=0).stop 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 shutdown_connections 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8adc06bbd0 0x7f8adc06e090 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8af80cde00 0x7f8af80aea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8af80cda20 0x7f8af8159f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 --2- 172.21.15.152:0/4227257009 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8af806bf90 0x7f8af80b0ff0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 >> 172.21.15.152:0/4227257009 conn(0x7f8af80b2ab0 msgr2=0x7f8af80d0250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 shutdown_connections 2024-03-18T15:01:33.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.721+0000 7f8b00576640 1 -- 172.21.15.152:0/4227257009 wait complete. 2024-03-18T15:01:33.736 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:33.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 Processor -- start 2024-03-18T15:01:33.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 -- start start 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe50c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c0b3440 con 0x7fe50c15ea90 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe50c0d20a0 con 0x7fe50c162690 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.846+0000 7fe512753640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c163200 con 0x7fe50c1622b0 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe510cf0640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe50c15ea90 0x7fe50c15ef20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54346/0 (socket says 172.21.15.152:54346) 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe510cf0640 1 -- 172.21.15.152:0/565662674 learned_addr learned my addr 172.21.15.152:0/565662674 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50bfff640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe50c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1626228424 0 0) 0x7fe50c0b3440 con 0x7fe50c15ea90 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4f4003520 con 0x7fe50c15ea90 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1428157452 0 0) 0x7fe50c0d20a0 con 0x7fe50c162690 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe50c0b3440 con 0x7fe50c162690 2024-03-18T15:01:33.851 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1813878059 0 0) 0x7fe4f4003520 con 0x7fe50c15ea90 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 msgr2=0x7fe50c0d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe50c0d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 >> v1:172.21.15.186:6789/0 conn(0x7fe50c162690 legacy=0x7fe50c162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c0d2380 con 0x7fe50c15ea90 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fe5040019f0 con 0x7fe50c15ea90 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 >> v1:172.21.15.152:6789/0 conn(0x7fe50c15ea90 legacy=0x7fe50c15ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4f4003be0 0x7fe4f4003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f4004800 0x7fe4f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe4f400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c163200 con 0x7fe4f4003be0 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe4f4005530 con 0x7fe4f4004800 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe4f400bf00 con 0x7fe50c1622b0 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50bfff640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4f4003be0 0x7fe4f4003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.852 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe510cf0640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe4f400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.847+0000 7fe50b7fe640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f4004800 0x7fe4f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 -- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 msgr2=0x7fe4f400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe50c1622b0 0x7fe4f400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 -- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f4004800 msgr2=0x7fe4f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe4f4004800 0x7fe4f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 -- 172.21.15.152:0/565662674 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4f4003520 con 0x7fe4f4003be0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.848+0000 7fe50bfff640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4f4003be0 0x7fe4f4003fe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009ac0 tx=0x7fe4f4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cb2ad70ba71551 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc039070 con 0x7fe4f4003be0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4fc02c6b0 con 0x7fe4f4003be0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe50affd640 1 -- 172.21.15.152:0/565662674 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4fc009690 con 0x7fe4f4003be0 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 -- 172.21.15.152:0/565662674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4f4003be0 msgr2=0x7fe4f4003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 --2- 172.21.15.152:0/565662674 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe4f4003be0 0x7fe4f4003fe0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc009ac0 tx=0x7fe4f4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:33.853 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe510cf0640 1 -- 172.21.15.152:0/565662674 reap_dead start 2024-03-18T15:01:33.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 -- 172.21.15.152:0/565662674 shutdown_connections 2024-03-18T15:01:33.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 -- 172.21.15.152:0/565662674 >> 172.21.15.152:0/565662674 conn(0x7fe50c0d4070 msgr2=0x7fe50c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:33.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 -- 172.21.15.152:0/565662674 shutdown_connections 2024-03-18T15:01:33.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.849+0000 7fe512753640 1 -- 172.21.15.152:0/565662674 wait complete. 2024-03-18T15:01:33.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.850+0000 7fe512753640 1 Processor -- start 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.850+0000 7fe512753640 1 -- start start 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 0x7fe50c0cdd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 0x7fe50c156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0d2660 con 0x7fe50c0cc530 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe50c0d16c0 con 0x7fe50c156000 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe512753640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe50c0cfc90 con 0x7fe4f4003be0 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe50b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe50b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46496/0 (socket says 172.21.15.152:46496) 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe50b7fe640 1 -- 172.21.15.152:0/3811049208 learned_addr learned my addr 172.21.15.152:0/3811049208 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.851+0000 7fe510cf0640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 0x7fe50c156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50bfff640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 0x7fe50c0cdd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 -- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 msgr2=0x7fe50c0cdd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 0x7fe50c0cdd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 -- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 msgr2=0x7fe50c156480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 0x7fe50c156480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 -- 172.21.15.152:0/3811049208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe50c0cd8e0 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe510cf0640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 0x7fe50c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50bfff640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 0x7fe50c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe50b7fe640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe50000f7a0 tx=0x7fe50000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50001a070 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe500005110 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe50c0cb490 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe500007050 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.852+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe50c0cba50 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.853+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe50c04f5b0 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.853+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe50001d070 con 0x7fe50c0cc530 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.854+0000 7fe508ff9640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 0x7fe4f806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:33.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.854+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fe50008a2b0 con 0x7fe50c0cc530 2024-03-18T15:01:33.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.854+0000 7fe50bfff640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 0x7fe4f806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:33.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.854+0000 7fe50bfff640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 0x7fe4f806e0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc036000 tx=0x7fe4fc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:33.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:33.858+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe500058d20 con 0x7fe50c0cc530 2024-03-18T15:01:34.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.093+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe50c0d18d0 con 0x7fe50c0cc530 2024-03-18T15:01:34.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.094+0000 7fe508ff9640 1 -- 172.21.15.152:0/3811049208 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+5181 (secure 0 0 0) 0x7fe50008a0d0 con 0x7fe50c0cc530 2024-03-18T15:01:34.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:34.095 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4235,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6833/659645551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":659645551},{"type":"v1","addr":"172.21.15.186:6833","nonce":659645551}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/437802570","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6834","nonce":437802570},{"type":"v1","addr":"172.21.15.186:6835","nonce":437802570}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4287,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/4004194651","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":4004194651},{"type":"v1","addr":"172.21.15.152:6836","nonce":4004194651}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:00:48.942367+0000","modified":"2024-03-18T15:00:50.948508+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4290},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4290":{"gid":4290,"name":"c","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/2508554293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":2508554293},{"type":"v1","addr":"172.21.15.152:6837","nonce":2508554293}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4290,"qdb_cluster":[4290]},"id":1}]} 2024-03-18T15:01:34.095 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 6 2024-03-18T15:01:34.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 msgr2=0x7fe4f806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 0x7fe4f806e0c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe4fc036000 tx=0x7fe4fc030000 comp rx=0 tx=0).stop 2024-03-18T15:01:34.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 msgr2=0x7fe50c0ca790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe50000f7a0 tx=0x7fe50000fc60 comp rx=0 tx=0).stop 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 shutdown_connections 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe50c156000 0x7fe50c156480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe50c0cc530 0x7fe50c0ca790 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe4f806bc00 0x7fe4f806e0c0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 --2- 172.21.15.152:0/3811049208 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe4f4003be0 0x7fe50c0cdd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 >> 172.21.15.152:0/3811049208 conn(0x7fe50c0d4070 msgr2=0x7fe50c06ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 shutdown_connections 2024-03-18T15:01:34.098 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.096+0000 7fe512753640 1 -- 172.21.15.152:0/3811049208 wait complete. 2024-03-18T15:01:34.108 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:34.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.209+0000 7fb98f9df640 1 Processor -- start 2024-03-18T15:01:34.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.209+0000 7fb98f9df640 1 -- start start 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb98815e390 0x7fb98815f520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 0x7fb9880d0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9880cf060 0x7fb9880d0fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb9880d0060 con 0x7fb9880cf060 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb9880cf4e0 con 0x7fb9880cec00 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98f9df640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb9880cf7c0 con 0x7fb98815e390 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9880cf060 0x7fb9880d0fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb9880cf060 0x7fb9880d0fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46504/0 (socket says 172.21.15.152:46504) 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 -- 172.21.15.152:0/1165389575 learned_addr learned my addr 172.21.15.152:0/1165389575 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:34.213 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98cf7a640 1 --2- 172.21.15.152:0/1165389575 >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 0x7fb9880d0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98d77b640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb98815e390 0x7fb98815f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 -- 172.21.15.152:0/1165389575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb98815e390 msgr2=0x7fb98815f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb98815e390 0x7fb98815f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 -- 172.21.15.152:0/1165389575 >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 msgr2=0x7fb9880d0a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 --2- 172.21.15.152:0/1165389575 >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 0x7fb9880d0a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98df7c640 1 -- 172.21.15.152:0/1165389575 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9880cfaa0 con 0x7fb9880cf060 2024-03-18T15:01:34.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.211+0000 7fb98cf7a640 1 --2- 172.21.15.152:0/1165389575 >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 0x7fb9880d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:34.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.212+0000 7fb98df7c640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9880d0fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb98808da30 tx=0x7fb98002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca1d1aa4510eff36 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.212+0000 7fb97ffff640 1 -- 172.21.15.152:0/1165389575 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98002c9e0 con 0x7fb9880cf060 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.212+0000 7fb97ffff640 1 -- 172.21.15.152:0/1165389575 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb98002cb80 con 0x7fb9880cf060 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.212+0000 7fb97ffff640 1 -- 172.21.15.152:0/1165389575 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9800343f0 con 0x7fb9880cf060 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 -- 172.21.15.152:0/1165389575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 msgr2=0x7fb9880d0fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9880d0fd0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fb98808da30 tx=0x7fb98002be40 comp rx=0 tx=0).stop 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 -- 172.21.15.152:0/1165389575 shutdown_connections 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9880d0fd0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1165389575 >> v2:172.21.15.186:3300/0 conn(0x7fb9880cec00 0x7fb9880d0a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1165389575 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb98815e390 0x7fb98815f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 -- 172.21.15.152:0/1165389575 >> 172.21.15.152:0/1165389575 conn(0x7fb98809d3c0 msgr2=0x7fb9880d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 -- 172.21.15.152:0/1165389575 shutdown_connections 2024-03-18T15:01:34.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.213+0000 7fb98f9df640 1 -- 172.21.15.152:0/1165389575 wait complete. 2024-03-18T15:01:34.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.214+0000 7fb98f9df640 1 Processor -- start 2024-03-18T15:01:34.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.214+0000 7fb98f9df640 1 -- start start 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 0x7fb9880a1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb98815e390 0x7fb98809de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb98815fcf0 con 0x7fb9880cf060 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb98815e770 con 0x7fb98815e390 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98f9df640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb9881610c0 con 0x7fb9880cec00 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46518/0 (socket says 172.21.15.152:46518) 2024-03-18T15:01:34.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 -- 172.21.15.152:0/1074085298 learned_addr learned my addr 172.21.15.152:0/1074085298 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98df7c640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb98815e390 0x7fb98809de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98d77b640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 0x7fb9880a1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 -- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 msgr2=0x7fb9880a1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 0x7fb9880a1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 -- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb98815e390 msgr2=0x7fb98809de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb98815e390 0x7fb98809de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 -- 172.21.15.152:0/1074085298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9880a06e0 con 0x7fb9880cf060 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98d77b640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 0x7fb9880a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.215+0000 7fb98cf7a640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb98400e840 tx=0x7fb98400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.216+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb98400f040 con 0x7fb9880cf060 2024-03-18T15:01:34.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.216+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb984004030 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.216+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9880a09c0 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.216+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb984004400 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.216+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9880a0f80 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.217+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb98804f5b0 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.217+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb98400c6d0 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.218+0000 7fb97dffb640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 0x7fb96c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.218+0000 7fb98d77b640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 0x7fb96c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.218+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb98408a760 con 0x7fb9880cf060 2024-03-18T15:01:34.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.218+0000 7fb98d77b640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 0x7fb96c06e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb978006fd0 tx=0x7fb978008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.222+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb984017020 con 0x7fb9880cf060 2024-03-18T15:01:34.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.402+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9880d4790 con 0x7fb9880cf060 2024-03-18T15:01:34.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.403+0000 7fb97dffb640 1 -- 172.21.15.152:0/1074085298 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+16903 (secure 0 0 0) 0x7fb984059260 con 0x7fb9880cf060 2024-03-18T15:01:34.404 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:34.404 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":24,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:28.902062+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:00:46.669412+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-03-18T15:00:47.913851+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1d","mappings":[{"from":5,"to":2}]},{"pgid":"3.22","mappings":[{"from":5,"to":2}]},{"pgid":"3.24","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 msgr2=0x7fb96c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 0x7fb96c06e090 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb978006fd0 tx=0x7fb978008040 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 msgr2=0x7fb9881f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fb98400e840 tx=0x7fb98400ed00 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 shutdown_connections 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb98815e390 0x7fb98809de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb9880cf060 0x7fb9881f3750 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb96c06bbd0 0x7fb96c06e090 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 --2- 172.21.15.152:0/1074085298 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb9880cec00 0x7fb9880a1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 >> 172.21.15.152:0/1074085298 conn(0x7fb98809d3c0 msgr2=0x7fb98806d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 shutdown_connections 2024-03-18T15:01:34.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.405+0000 7fb98f9df640 1 -- 172.21.15.152:0/1074085298 wait complete. 2024-03-18T15:01:34.417 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T15:01:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.519+0000 7fb4e6634640 1 Processor -- start 2024-03-18T15:01:34.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.519+0000 7fb4e6634640 1 -- start start 2024-03-18T15:01:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e6634640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 0x7fb4e006cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e6634640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4e015e880 0x7fb4e0071010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e6634640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb4e006e6f0 con 0x7fb4e006d1b0 2024-03-18T15:01:34.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e6634640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb4e006d650 con 0x7fb4e015e880 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e6634640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e006d930 con 0x7fb4e0154a90 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e4bd1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4e015e880 0x7fb4e0071010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4df7fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb4e006d1b0 0x7fb4e015e170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54356/0 (socket says 172.21.15.152:54356) 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4e4bd1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb4e015e880 0x7fb4e0071010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46530/0 (socket says 172.21.15.152:46530) 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.520+0000 7fb4df7fe640 1 -- 172.21.15.152:0/1065095833 learned_addr learned my addr 172.21.15.152:0/1065095833 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4dffff640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 0x7fb4e006cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4e4bd1640 1 -- 172.21.15.152:0/1065095833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 msgr2=0x7fb4e006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4e4bd1640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 0x7fb4e006cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4e4bd1640 1 -- 172.21.15.152:0/1065095833 >> v1:172.21.15.152:6789/0 conn(0x7fb4e006d1b0 legacy=0x7fb4e015e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4e4bd1640 1 -- 172.21.15.152:0/1065095833 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e006dc10 con 0x7fb4e015e880 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4deffd640 1 -- 172.21.15.152:0/1065095833 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1923133567 0 0) 0x7fb4e006e6f0 con 0x7fb4e006d1b0 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4dffff640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 0x7fb4e006cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.521+0000 7fb4e4bd1640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e015e880 0x7fb4e0071010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800aea0 tx=0x7fb4d802cf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e8600a5e512898a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.524 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4deffd640 1 -- 172.21.15.152:0/1065095833 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d802dab0 con 0x7fb4e015e880 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4deffd640 1 -- 172.21.15.152:0/1065095833 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d802dc50 con 0x7fb4e015e880 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4deffd640 1 -- 172.21.15.152:0/1065095833 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d8008440 con 0x7fb4e015e880 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 -- 172.21.15.152:0/1065095833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e015e880 msgr2=0x7fb4e0071010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e015e880 0x7fb4e0071010 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fb4d800aea0 tx=0x7fb4d802cf10 comp rx=0 tx=0).stop 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 -- 172.21.15.152:0/1065095833 shutdown_connections 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e015e880 0x7fb4e0071010 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1065095833 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e0154a90 0x7fb4e006cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 -- 172.21.15.152:0/1065095833 >> 172.21.15.152:0/1065095833 conn(0x7fb4e006b5e0 msgr2=0x7fb4e006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 -- 172.21.15.152:0/1065095833 shutdown_connections 2024-03-18T15:01:34.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.522+0000 7fb4e6634640 1 -- 172.21.15.152:0/1065095833 wait complete. 2024-03-18T15:01:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.524+0000 7fb4e6634640 1 Processor -- start 2024-03-18T15:01:34.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.524+0000 7fb4e6634640 1 -- start start 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e006d1b0 0x7fb4e01f4590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 0x7fb4e014cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e0154e70 con 0x7fb4e0154a90 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb4e006e1d0 con 0x7fb4e015e880 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4e6634640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb4e0154ff0 con 0x7fb4e006d1b0 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4df7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46542/0 (socket says 172.21.15.152:46542) 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.525+0000 7fb4df7fe640 1 -- 172.21.15.152:0/1391760091 learned_addr learned my addr 172.21.15.152:0/1391760091 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4dffff640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e006d1b0 0x7fb4e01f4590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4e4bd1640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 0x7fb4e014cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 -- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e006d1b0 msgr2=0x7fb4e01f4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e006d1b0 0x7fb4e01f4590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 -- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 msgr2=0x7fb4e014cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 0x7fb4e014cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 -- 172.21.15.152:0/1391760091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4e014bad0 con 0x7fb4e0154a90 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4e4bd1640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 0x7fb4e014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4df7fe640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c4a0 tx=0x7fb4d000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0018070 con 0x7fb4e0154a90 2024-03-18T15:01:34.529 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb4d00074e0 con 0x7fb4e0154a90 2024-03-18T15:01:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4e014bdb0 con 0x7fb4e0154a90 2024-03-18T15:01:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4d0004a20 con 0x7fb4e0154a90 2024-03-18T15:01:34.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.526+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4e014c650 con 0x7fb4e0154a90 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.527+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4e014c1a0 con 0x7fb4e0154a90 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.528+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb4d001b070 con 0x7fb4e0154a90 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.528+0000 7fb4dcff9640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 0x7fb4cc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.528+0000 7fb4dffff640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 0x7fb4cc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.528+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5825+0+0 (secure 0 0 0) 0x7fb4d0089d10 con 0x7fb4e0154a90 2024-03-18T15:01:34.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.529+0000 7fb4dffff640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 0x7fb4cc06e090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400ab60 tx=0x7fb4d4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.534 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.533+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb4d00581c0 con 0x7fb4e0154a90 2024-03-18T15:01:34.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.834+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fb4e004f5b0 con 0x7fb4e0154a90 2024-03-18T15:01:34.836 INFO:tasks.ceph.mon.a.smithi152.stderr:2024-03-18T15:01:34.835+0000 7f8051411640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-18T15:01:34.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.836+0000 7fb4dcff9640 1 -- 172.21.15.152:0/1391760091 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) ==== 161+0+0 (secure 0 0 0) 0x7fb4d005c260 con 0x7fb4e0154a90 2024-03-18T15:01:34.838 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T15:01:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 msgr2=0x7fb4cc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 0x7fb4cc06e090 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fb4d400ab60 tx=0x7fb4d4008040 comp rx=0 tx=0).stop 2024-03-18T15:01:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 msgr2=0x7fb4e0149bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fb4d000c4a0 tx=0x7fb4d000c960 comp rx=0 tx=0).stop 2024-03-18T15:01:34.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 shutdown_connections 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb4e015e880 0x7fb4e014cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb4e0154a90 0x7fb4e0149bc0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb4cc06bbd0 0x7fb4cc06e090 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 --2- 172.21.15.152:0/1391760091 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb4e006d1b0 0x7fb4e01f4590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 >> 172.21.15.152:0/1391760091 conn(0x7fb4e006b5e0 msgr2=0x7fb4e00b2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 shutdown_connections 2024-03-18T15:01:34.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.839+0000 7fb4e6634640 1 -- 172.21.15.152:0/1391760091 wait complete. 2024-03-18T15:01:34.844 INFO:tasks.ceph.mds.c.smithi152.stderr: -7643> 2024-03-18T15:00:52.183+0000 7fd9211cd640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T15:01:34.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T15:01:34.876 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-03-18T15:01:34.964 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 Processor -- start 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 -- start start 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe82c0c4a90 0x7fe82c06e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe82c06d3c0 con 0x7fe82c06eca0 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe82c158d80 con 0x7fe82c0c4a90 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.960+0000 7fe831e0b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c06f0f0 con 0x7fe82c1589a0 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe82c0c4a90 0x7fe82c06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe82c0c4a90 0x7fe82c06e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:56762/0 (socket says 172.21.15.152:56762) 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:54700/0 (socket says 172.21.15.152:54700) 2024-03-18T15:01:34.965 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 -- 172.21.15.152:0/1208001732 learned_addr learned my addr 172.21.15.152:0/1208001732 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe82c06eca0 0x7fe82c15e980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:56258/0 (socket says 172.21.15.152:56258) 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 -- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 msgr2=0x7fe82c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 -- 172.21.15.152:0/1208001732 >> v1:172.21.15.186:6789/0 conn(0x7fe82c06eca0 legacy=0x7fe82c15e980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82affd640 1 -- 172.21.15.152:0/1208001732 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0cc190 con 0x7fe82c0c4a90 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.961+0000 7fe82b7fe640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.962+0000 7fe82affd640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c06e760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe814009870 tx=0x7fe81402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e15f007f42badb05 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.962+0000 7fe82a7fc640 1 -- 172.21.15.152:0/1208001732 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814034070 con 0x7fe82c0c4a90 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.962+0000 7fe82a7fc640 1 -- 172.21.15.152:0/1208001732 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe814030840 con 0x7fe82c0c4a90 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.962+0000 7fe82a7fc640 1 -- 172.21.15.152:0/1208001732 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe814030c10 con 0x7fe82c0c4a90 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 -- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 msgr2=0x7fe82c06e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c06e760 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe814009870 tx=0x7fe81402b980 comp rx=0 tx=0).stop 2024-03-18T15:01:34.966 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 -- 172.21.15.152:0/1208001732 shutdown_connections 2024-03-18T15:01:34.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c06e760 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 --2- 172.21.15.152:0/1208001732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 -- 172.21.15.152:0/1208001732 >> 172.21.15.152:0/1208001732 conn(0x7fe82c0cfbf0 msgr2=0x7fe82c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:34.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 -- 172.21.15.152:0/1208001732 shutdown_connections 2024-03-18T15:01:34.967 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.963+0000 7fe831e0b640 1 -- 172.21.15.152:0/1208001732 wait complete. 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.964+0000 7fe831e0b640 1 Processor -- start 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.964+0000 7fe831e0b640 1 -- start start 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c14c3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0c5680 con 0x7fe82c06eca0 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe82c0c53a0 con 0x7fe82c0c4a90 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe82c0c5960 con 0x7fe82c1589a0 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46588/0 (socket says 172.21.15.152:46588) 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 -- 172.21.15.152:0/3762070272 learned_addr learned my addr 172.21.15.152:0/3762070272 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82affd640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82bfff640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c14c3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 -- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 msgr2=0x7fe82c14c3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c14c3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 -- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 msgr2=0x7fe82c149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 -- 172.21.15.152:0/3762070272 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe82c0724a0 con 0x7fe82c06eca0 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82affd640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe82b7fe640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e990 tx=0x7fe81c00ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c017070 con 0x7fe82c06eca0 2024-03-18T15:01:34.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe82c072780 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81c00c9e0 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe81c00cdb0 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.965+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe82c14a350 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.966+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe82c04f540 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.967+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe81c01a070 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.967+0000 7fe823fff640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 0x7fe80c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.967+0000 7fe82affd640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 0x7fe80c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.967+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7fe81c08ad50 con 0x7fe82c06eca0 2024-03-18T15:01:34.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.968+0000 7fe82affd640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 0x7fe80c06e0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe814036000 tx=0x7fe81403b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:34.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:34.972+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe81c08e030 con 0x7fe82c06eca0 2024-03-18T15:01:35.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.181+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fe82c15bd20 con 0x7fe82c06eca0 2024-03-18T15:01:35.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.837+0000 7fe823fff640 1 -- 172.21.15.152:0/3762070272 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) ==== 104+0+0 (secure 0 0 0) 0x7fe81c059780 con 0x7fe82c06eca0 2024-03-18T15:01:35.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 msgr2=0x7fe80c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 0x7fe80c06e0c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe814036000 tx=0x7fe81403b040 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 msgr2=0x7fe82c159c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fe81c00e990 tx=0x7fe81c00ee50 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 shutdown_connections 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe80c06bc00 0x7fe80c06e0c0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe82c1589a0 0x7fe82c14c3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe82c0c4a90 0x7fe82c149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 --2- 172.21.15.152:0/3762070272 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe82c06eca0 0x7fe82c159c10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 >> 172.21.15.152:0/3762070272 conn(0x7fe82c0cfbf0 msgr2=0x7fe82c0cc5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 shutdown_connections 2024-03-18T15:01:35.842 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:35.840+0000 7fe831e0b640 1 -- 172.21.15.152:0/3762070272 wait complete. 2024-03-18T15:01:35.856 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T15:01:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.004+0000 7ff8d3bdf640 1 Processor -- start 2024-03-18T15:01:36.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.004+0000 7ff8d3bdf640 1 -- start start 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d3bdf640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8cc0d0420 0x7ff8cc0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d3bdf640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff8cc0cda60 0x7ff8cc0c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d3bdf640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff8cc0d0d40 con 0x7ff8cc0c5f70 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d3bdf640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc067d90 con 0x7ff8cc0d0420 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d3bdf640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff8cc0cfbd0 con 0x7ff8cc0cda60 2024-03-18T15:01:36.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d197b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8cc0d0420 0x7ff8cc0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d197b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ff8cc0d0420 0x7ff8cc0d0800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46600/0 (socket says 172.21.15.152:46600) 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.005+0000 7ff8d197b640 1 -- 172.21.15.152:0/1725632429 learned_addr learned my addr 172.21.15.152:0/1725632429 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d217c640 1 --2- 172.21.15.152:0/1725632429 >> v2:172.21.15.186:3300/0 conn(0x7ff8cc0cda60 0x7ff8cc0c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d197b640 1 -- 172.21.15.152:0/1725632429 >> v2:172.21.15.186:3300/0 conn(0x7ff8cc0cda60 msgr2=0x7ff8cc0c6b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d197b640 1 --2- 172.21.15.152:0/1725632429 >> v2:172.21.15.186:3300/0 conn(0x7ff8cc0cda60 0x7ff8cc0c6b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d197b640 1 -- 172.21.15.152:0/1725632429 >> v1:172.21.15.186:6789/0 conn(0x7ff8cc0c5f70 legacy=0x7ff8cc0c6400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d197b640 1 -- 172.21.15.152:0/1725632429 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc0cfeb0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.006+0000 7ff8d197b640 1 --2- 172.21.15.152:0/1725632429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc0d0800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0d1e10 tx=0x7ff8c802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf55809aaf89a152 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d0979640 1 -- 172.21.15.152:0/1725632429 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c802cb20 con 0x7ff8cc0d0420 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d0979640 1 -- 172.21.15.152:0/1725632429 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c802ccc0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d0979640 1 -- 172.21.15.152:0/1725632429 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c8034610 con 0x7ff8cc0d0420 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/1725632429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 msgr2=0x7ff8cc0d0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/1725632429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc0d0800 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ff8cc0d1e10 tx=0x7ff8c802bf80 comp rx=0 tx=0).stop 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/1725632429 shutdown_connections 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/1725632429 >> v2:172.21.15.186:3300/0 conn(0x7ff8cc0cda60 0x7ff8cc0c6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/1725632429 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc0d0800 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/1725632429 >> 172.21.15.152:0/1725632429 conn(0x7ff8cc0d1e60 msgr2=0x7ff8cc0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:36.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/1725632429 shutdown_connections 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.007+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/1725632429 wait complete. 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.008+0000 7ff8d3bdf640 1 Processor -- start 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.008+0000 7ff8d3bdf640 1 -- start start 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8cc0c5f70 0x7ff8cc0ce8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8cc0cda60 0x7ff8cc1552c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d2980 con 0x7ff8cc0d0420 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff8cc0c5a50 con 0x7ff8cc0cda60 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d3bdf640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff8cc0d2b00 con 0x7ff8cc0c5f70 2024-03-18T15:01:36.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d217c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d217c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46614/0 (socket says 172.21.15.152:46614) 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d217c640 1 -- 172.21.15.152:0/2562128944 learned_addr learned my addr 172.21.15.152:0/2562128944 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d217c640 1 -- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8cc0c5f70 msgr2=0x7ff8cc0ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d197b640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8cc0c5f70 0x7ff8cc0ce8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d117a640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8cc0cda60 0x7ff8cc1552c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.009+0000 7ff8d217c640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8cc0c5f70 0x7ff8cc0ce8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d217c640 1 -- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8cc0cda60 msgr2=0x7ff8cc1552c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d217c640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8cc0cda60 0x7ff8cc1552c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d217c640 1 -- 172.21.15.152:0/2562128944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8cc06ce60 con 0x7ff8cc0d0420 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d217c640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400b6c0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff8c4019070 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8cc06d140 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8c400bac0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.010+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8cc06d700 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.011+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8cc06dc20 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.011+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff8c400bc60 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.012+0000 7ff8c27fc640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 0x7ff8b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.012+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5911+0+0 (secure 0 0 0) 0x7ff8c408aff0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.012+0000 7ff8d197b640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 0x7ff8b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:36.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.012+0000 7ff8d197b640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 0x7ff8b006e090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8035000 tx=0x7ff8c8030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:36.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.016+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff8c4059aa0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.188+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7ff8cc0b7ce0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.936+0000 7ff8c27fc640 1 -- 172.21.15.152:0/2562128944 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v26) ==== 181+0+0 (secure 0 0 0) 0x7ff8c40593a0 con 0x7ff8cc0d0420 2024-03-18T15:01:36.938 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 msgr2=0x7ff8b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 0x7ff8b006e090 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8035000 tx=0x7ff8c8030000 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 msgr2=0x7ff8cc1f72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7ff8c400d800 tx=0x7ff8c400dcc0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 shutdown_connections 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff8cc0d0420 0x7ff8cc1f72e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff8cc0cda60 0x7ff8cc1552c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff8b006bbd0 0x7ff8b006e090 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 --2- 172.21.15.152:0/2562128944 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff8cc0c5f70 0x7ff8cc0ce8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 >> 172.21.15.152:0/2562128944 conn(0x7ff8cc0d1e60 msgr2=0x7ff8cc0c69c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:36.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 shutdown_connections 2024-03-18T15:01:36.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:36.940+0000 7ff8d3bdf640 1 -- 172.21.15.152:0/2562128944 wait complete. 2024-03-18T15:01:36.955 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T15:01:37.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.063+0000 7f1f88427640 1 Processor -- start 2024-03-18T15:01:37.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.063+0000 7f1f88427640 1 -- start start 2024-03-18T15:01:37.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f88427640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1f8015e490 0x7f1f800cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f88427640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1f800cfbe0 0x7f1f800d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f88427640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1f8015e870 con 0x7f1f800d16c0 2024-03-18T15:01:37.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f88427640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1f800d06b0 con 0x7f1f8015e490 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f88427640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f1f800d1230 con 0x7f1f800cfbe0 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f861c3640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1f8015e490 0x7f1f800cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.064+0000 7f1f869c4640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1f800d16c0 0x7f1f80161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54386/0 (socket says 172.21.15.152:54386) 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f869c4640 1 -- 172.21.15.152:0/2338610593 learned_addr learned my addr 172.21.15.152:0/2338610593 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f861c3640 1 -- 172.21.15.152:0/2338610593 >> v2:172.21.15.186:3300/0 conn(0x7f1f800cfbe0 msgr2=0x7f1f800d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f859c2640 1 --2- 172.21.15.152:0/2338610593 >> v2:172.21.15.186:3300/0 conn(0x7f1f800cfbe0 0x7f1f800d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f861c3640 1 --2- 172.21.15.152:0/2338610593 >> v2:172.21.15.186:3300/0 conn(0x7f1f800cfbe0 0x7f1f800d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f861c3640 1 -- 172.21.15.152:0/2338610593 >> v1:172.21.15.152:6789/0 conn(0x7f1f800d16c0 legacy=0x7f1f80161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f851c1640 1 -- 172.21.15.152:0/2338610593 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884505087 0 0) 0x7f1f8015e870 con 0x7f1f800d16c0 2024-03-18T15:01:37.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f861c3640 1 -- 172.21.15.152:0/2338610593 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f800d0900 con 0x7f1f8015e490 2024-03-18T15:01:37.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.065+0000 7f1f861c3640 1 --2- 172.21.15.152:0/2338610593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8015e490 0x7f1f800cf6a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f80161ec0 tx=0x7f1f7c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ec49dd761a09a4 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:37.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f851c1640 1 -- 172.21.15.152:0/2338610593 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c039070 con 0x7f1f8015e490 2024-03-18T15:01:37.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f851c1640 1 -- 172.21.15.152:0/2338610593 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c02cbf0 con 0x7f1f8015e490 2024-03-18T15:01:37.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f851c1640 1 -- 172.21.15.152:0/2338610593 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c034440 con 0x7f1f8015e490 2024-03-18T15:01:37.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 -- 172.21.15.152:0/2338610593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8015e490 msgr2=0x7f1f800cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 --2- 172.21.15.152:0/2338610593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8015e490 0x7f1f800cf6a0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f1f80161ec0 tx=0x7f1f7c02be40 comp rx=0 tx=0).stop 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 -- 172.21.15.152:0/2338610593 shutdown_connections 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 --2- 172.21.15.152:0/2338610593 >> v2:172.21.15.186:3300/0 conn(0x7f1f800cfbe0 0x7f1f800d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 --2- 172.21.15.152:0/2338610593 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f8015e490 0x7f1f800cf6a0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 -- 172.21.15.152:0/2338610593 >> 172.21.15.152:0/2338610593 conn(0x7f1f800d4080 msgr2=0x7f1f800d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 -- 172.21.15.152:0/2338610593 shutdown_connections 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.066+0000 7f1f88427640 1 -- 172.21.15.152:0/2338610593 wait complete. 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.067+0000 7f1f88427640 1 Processor -- start 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.067+0000 7f1f88427640 1 -- start start 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f800d16c0 0x7f1f800cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f8015e490 0x7f1f8015fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800d2220 con 0x7f1f800cfbe0 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1f800d0ec0 con 0x7f1f800d16c0 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f88427640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1f800d23a0 con 0x7f1f8015e490 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f861c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f861c3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46632/0 (socket says 172.21.15.152:46632) 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f861c3640 1 -- 172.21.15.152:0/2220515720 learned_addr learned my addr 172.21.15.152:0/2220515720 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.068+0000 7f1f859c2640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f800d16c0 0x7f1f800cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f869c4640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f8015e490 0x7f1f8015fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 -- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f8015e490 msgr2=0x7f1f8015fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f8015e490 0x7f1f8015fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 -- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f800d16c0 msgr2=0x7f1f800cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f800d16c0 0x7f1f800cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 -- 172.21.15.152:0/2220515720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f8009e9f0 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f861c3640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c037040 tx=0x7f1f7c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c039050 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1f7c03a040 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f80159a20 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f7c03e610 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.069+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f800a0f40 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.070+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f8004f540 con 0x7f1f800cfbe0 2024-03-18T15:01:37.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.070+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1f7c047020 con 0x7f1f800cfbe0 2024-03-18T15:01:37.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.071+0000 7f1f76ffd640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 0x7f1f6406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:37.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.071+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 5473+0+0 (secure 0 0 0) 0x7f1f7c0acd50 con 0x7f1f800cfbe0 2024-03-18T15:01:37.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.071+0000 7f1f859c2640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 0x7f1f6406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:37.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.071+0000 7f1f859c2640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 0x7f1f6406e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006d9e0 tx=0x7f1f70008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:37.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.075+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1f7c0b0030 con 0x7f1f800cfbe0 2024-03-18T15:01:37.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.250+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1f8008e100 con 0x7f1f800cfbe0 2024-03-18T15:01:37.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.942+0000 7f1f76ffd640 1 -- 172.21.15.152:0/2220515720 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v27) ==== 169+0+0 (secure 0 0 0) 0x7f1f7c04e020 con 0x7f1f800cfbe0 2024-03-18T15:01:37.943 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2024-03-18T15:01:37.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 msgr2=0x7f1f6406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 0x7f1f6406e090 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f1f8006d9e0 tx=0x7f1f70008040 comp rx=0 tx=0).stop 2024-03-18T15:01:37.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 msgr2=0x7f1f801594e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:37.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f1f7c037040 tx=0x7f1f7c004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 shutdown_connections 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1f6406bbd0 0x7f1f6406e090 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1f8015e490 0x7f1f8015fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1f800d16c0 0x7f1f800cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 --2- 172.21.15.152:0/2220515720 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1f800cfbe0 0x7f1f801594e0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.945+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 >> 172.21.15.152:0/2220515720 conn(0x7f1f800d4080 msgr2=0x7f1f800b2930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.946+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 shutdown_connections 2024-03-18T15:01:37.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:37.946+0000 7f1f88427640 1 -- 172.21.15.152:0/2220515720 wait complete. 2024-03-18T15:01:37.959 INFO:tasks.ceph.mds.a:Restarting daemon 2024-03-18T15:01:37.959 INFO:tasks.ceph.mds.a:Stopping old one... 2024-03-18T15:01:37.959 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T15:01:37.959 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T15:01:37.960 INFO:tasks.ceph.mds.c:Restarting daemon 2024-03-18T15:01:37.960 INFO:tasks.ceph.mds.c:Stopping old one... 2024-03-18T15:01:37.960 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T15:01:37.960 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T15:01:37.960 INFO:tasks.ceph.mds.b:Restarting daemon 2024-03-18T15:01:37.960 INFO:tasks.ceph.mds.b:Stopping old one... 2024-03-18T15:01:37.960 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T15:01:37.961 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T15:01:37.961 INFO:tasks.ceph.mds.d:Restarting daemon 2024-03-18T15:01:37.961 INFO:tasks.ceph.mds.d:Stopping old one... 2024-03-18T15:01:37.961 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-18T15:01:37.961 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T15:01:37.969 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T15:01:37.969 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-03-18T15:01:37.970 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T15:01:37.970 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-03-18T15:01:37.972 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T15:01:37.972 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-03-18T15:01:37.973 INFO:tasks.ceph.mds.d:Stopped 2024-03-18T15:01:37.973 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-03-18T15:01:38.011 INFO:tasks.ceph.mds.a:Started 2024-03-18T15:01:38.012 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:38.012 INFO:tasks.ceph.mds.c:Started 2024-03-18T15:01:38.012 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:38.015 INFO:tasks.ceph.mds.b:Started 2024-03-18T15:01:38.015 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:38.015 INFO:tasks.ceph.mds.d:Started 2024-03-18T15:01:38.016 DEBUG:teuthology.parallel:result is None 2024-03-18T15:01:38.016 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-03-18T15:01:38.088 INFO:tasks.ceph.mds.a.smithi152.stdout:starting mds.a at 2024-03-18T15:01:38.088 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-03-18T15:01:38.102 INFO:tasks.ceph.mds.b.smithi186.stdout:starting mds.b at 2024-03-18T15:01:38.102 INFO:tasks.ceph.mds.d.smithi186.stdout:starting mds.d at 2024-03-18T15:01:38.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.120+0000 7f17e2110640 1 Processor -- start 2024-03-18T15:01:38.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.120+0000 7f17e2110640 1 -- start start 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17e2110640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc165da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17e2110640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17dc15ee60 con 0x7f17dc0ad800 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17e2110640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17dc15f140 con 0x7f17dc15ad40 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17e2110640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc0b3b10 con 0x7f17dc0d07f0 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17daffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f17dc0ad800 0x7f17dc0d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54394/0 (socket says 172.21.15.152:54394) 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.121+0000 7f17daffd640 1 -- 172.21.15.152:0/2447478382 learned_addr learned my addr 172.21.15.152:0/2447478382 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:38.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17dbfff640 1 --2- 172.21.15.152:0/2447478382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc165da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2670712248 0 0) 0x7f17dc15ee60 con 0x7f17dc0ad800 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17c4003520 con 0x7f17dc0ad800 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3960813924 0 0) 0x7f17dc15f140 con 0x7f17dc15ad40 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f17dc15ee60 con 0x7f17dc15ad40 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 82778450 0 0) 0x7f17c4003520 con 0x7f17dc0ad800 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17dbfff640 1 -- 172.21.15.152:0/2447478382 >> v1:172.21.15.186:6789/0 conn(0x7f17dc15ad40 legacy=0x7f17dc0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17dbfff640 1 -- 172.21.15.152:0/2447478382 >> v1:172.21.15.152:6789/0 conn(0x7f17dc0ad800 legacy=0x7f17dc0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.122+0000 7f17dbfff640 1 -- 172.21.15.152:0/2447478382 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc15f420 con 0x7f17dc0d07f0 2024-03-18T15:01:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17dbfff640 1 --2- 172.21.15.152:0/2447478382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc165da0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009dc0 tx=0x7f17d402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7035becf702f11d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:38.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d4039070 con 0x7f17dc0d07f0 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17d402c880 con 0x7f17dc0d07f0 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17da7fc640 1 -- 172.21.15.152:0/2447478382 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17d0001690 con 0x7f17dc0d07f0 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 -- 172.21.15.152:0/2447478382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 msgr2=0x7f17dc165da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 --2- 172.21.15.152:0/2447478382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc165da0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f17d4009dc0 tx=0x7f17d402bd50 comp rx=0 tx=0).stop 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 -- 172.21.15.152:0/2447478382 shutdown_connections 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 --2- 172.21.15.152:0/2447478382 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc165da0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 -- 172.21.15.152:0/2447478382 >> 172.21.15.152:0/2447478382 conn(0x7f17dc06b5e0 msgr2=0x7f17dc06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 -- 172.21.15.152:0/2447478382 shutdown_connections 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.123+0000 7f17e2110640 1 -- 172.21.15.152:0/2447478382 wait complete. 2024-03-18T15:01:38.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.124+0000 7f17e2110640 1 Processor -- start 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 -- start start 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc0b03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17dc15ad40 0x7f17dc0ae470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc15b2a0 con 0x7f17dc0ad800 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f17dc15b120 con 0x7f17dc15ad40 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17e2110640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f17dc15ea10 con 0x7f17dc0d07f0 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.125+0000 7f17db7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46662/0 (socket says 172.21.15.152:46662) 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 -- 172.21.15.152:0/2281505480 learned_addr learned my addr 172.21.15.152:0/2281505480 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17dbfff640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17dc15ad40 0x7f17dc0ae470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:38.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17daffd640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc0b03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 -- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 msgr2=0x7f17dc0b03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc0b03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 -- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17dc15ad40 msgr2=0x7f17dc0ae470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17dc15ad40 0x7f17dc0ae470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 -- 172.21.15.152:0/2281505480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17dc0b0b50 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17db7fe640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c490 tx=0x7f17cc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc0052d0 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17cc005470 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17dc0b0e30 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17cc012850 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.126+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17dc0b13f0 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.127+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17dc067a40 con 0x7f17dc0ad800 2024-03-18T15:01:38.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.128+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f17cc0129f0 con 0x7f17dc0ad800 2024-03-18T15:01:38.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.128+0000 7f17c3fff640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 0x7f17c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:38.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.128+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 4943+0+0 (secure 0 0 0) 0x7f17cc08a300 con 0x7f17dc0ad800 2024-03-18T15:01:38.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.128+0000 7f17daffd640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 0x7f17c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:38.131 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.128+0000 7f17daffd640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 0x7f17c806e090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0cf220 tx=0x7f17d0001080 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:38.133 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.132+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f17dc067a40 con 0x7f17dc0ad800 2024-03-18T15:01:38.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.319+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f17dc04f5b0 con 0x7f17dc0ad800 2024-03-18T15:01:38.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.952+0000 7f17c3fff640 1 -- 172.21.15.152:0/2281505480 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) ==== 97+0+0 (secure 0 0 0) 0x7f17cc058aa0 con 0x7f17dc0ad800 2024-03-18T15:01:38.954 INFO:teuthology.orchestra.run.smithi152.stderr: removed all blocklist entries 2024-03-18T15:01:38.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 msgr2=0x7f17c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 0x7f17c806e090 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f17dc0cf220 tx=0x7f17d0001080 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 msgr2=0x7f17dc09cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f17cc00c490 tx=0x7f17cc00c950 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 shutdown_connections 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f17dc15ad40 0x7f17dc0ae470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f17c806bbd0 0x7f17c806e090 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f17dc0d07f0 0x7f17dc0b03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 --2- 172.21.15.152:0/2281505480 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f17dc0ad800 0x7f17dc09cac0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 >> 172.21.15.152:0/2281505480 conn(0x7f17dc06b5e0 msgr2=0x7f17dc152660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 shutdown_connections 2024-03-18T15:01:38.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:38.955+0000 7f17e2110640 1 -- 172.21.15.152:0/2281505480 wait complete. 2024-03-18T15:01:38.969 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-03-18T15:01:39.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.068+0000 7fb31824b640 1 Processor -- start 2024-03-18T15:01:39.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.068+0000 7fb31824b640 1 -- start start 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb31824b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 0x7fb3100b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb31824b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb310159cc0 0x7fb3100ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb31824b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb31015fc70 con 0x7fb3101598e0 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb31824b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fb3100b3c80 con 0x7fb310159cc0 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb31824b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fb31015ff50 con 0x7fb3100d07f0 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb315fe7640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fb3101598e0 0x7fb3100d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54408/0 (socket says 172.21.15.152:54408) 2024-03-18T15:01:39.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb3167e8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fb310159cc0 0x7fb3100ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb315fe7640 1 -- 172.21.15.152:0/3477672677 learned_addr learned my addr 172.21.15.152:0/3477672677 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.069+0000 7fb3157e6640 1 --2- 172.21.15.152:0/3477672677 >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 0x7fb3100b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3167e8640 1 -- 172.21.15.152:0/3477672677 >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 msgr2=0x7fb3100b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3167e8640 1 --2- 172.21.15.152:0/3477672677 >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 0x7fb3100b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3167e8640 1 -- 172.21.15.152:0/3477672677 >> v1:172.21.15.152:6789/0 conn(0x7fb3101598e0 legacy=0x7fb3100d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3167e8640 1 -- 172.21.15.152:0/3477672677 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb310160230 con 0x7fb310159cc0 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb314fe5640 1 -- 172.21.15.152:0/3477672677 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694135751 0 0) 0x7fb31015fc70 con 0x7fb3101598e0 2024-03-18T15:01:39.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3157e6640 1 --2- 172.21.15.152:0/3477672677 >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 0x7fb3100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb3167e8640 1 --2- 172.21.15.152:0/3477672677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb310159cc0 0x7fb3100ae850 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb31006f400 tx=0x7fb30802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c621366044884e7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.070+0000 7fb314fe5640 1 -- 172.21.15.152:0/3477672677 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308039070 con 0x7fb310159cc0 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb314fe5640 1 -- 172.21.15.152:0/3477672677 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb30802cc80 con 0x7fb310159cc0 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb314fe5640 1 -- 172.21.15.152:0/3477672677 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308034660 con 0x7fb310159cc0 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 -- 172.21.15.152:0/3477672677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb310159cc0 msgr2=0x7fb3100ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 --2- 172.21.15.152:0/3477672677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb310159cc0 0x7fb3100ae850 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fb31006f400 tx=0x7fb30802bed0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 -- 172.21.15.152:0/3477672677 shutdown_connections 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 --2- 172.21.15.152:0/3477672677 >> v2:172.21.15.186:3300/0 conn(0x7fb3100d07f0 0x7fb3100b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 --2- 172.21.15.152:0/3477672677 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb310159cc0 0x7fb3100ae850 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 -- 172.21.15.152:0/3477672677 >> 172.21.15.152:0/3477672677 conn(0x7fb31006b5e0 msgr2=0x7fb31006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 -- 172.21.15.152:0/3477672677 shutdown_connections 2024-03-18T15:01:39.074 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.071+0000 7fb31824b640 1 -- 172.21.15.152:0/3477672677 wait complete. 2024-03-18T15:01:39.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.072+0000 7fb31824b640 1 Processor -- start 2024-03-18T15:01:39.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.072+0000 7fb31824b640 1 -- start start 2024-03-18T15:01:39.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3100d07f0 0x7fb3100b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb310159cc0 0x7fb3100ce480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fb31006cc70 con 0x7fb3101598e0 2024-03-18T15:01:39.077 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fb3101607f0 con 0x7fb310159cc0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb31824b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fb31006cdf0 con 0x7fb3100d07f0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb3157e6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb3157e6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46674/0 (socket says 172.21.15.152:46674) 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb3157e6640 1 -- 172.21.15.152:0/2275939219 learned_addr learned my addr 172.21.15.152:0/2275939219 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb3167e8640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb310159cc0 0x7fb3100ce480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.073+0000 7fb315fe7640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3100d07f0 0x7fb3100b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 -- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3100d07f0 msgr2=0x7fb3100b0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3100d07f0 0x7fb3100b0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 -- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb310159cc0 msgr2=0x7fb3100ce480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb310159cc0 0x7fb3100ce480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 -- 172.21.15.152:0/2275939219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3101f29e0 con 0x7fb3101598e0 2024-03-18T15:01:39.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3157e6640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e730 tx=0x7fb30000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000f040 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb300004230 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3100ce9c0 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000ee40 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.074+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3100b2a10 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.075+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31006b9c0 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.075+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fb30000c6d0 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.076+0000 7fb3067fc640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 0x7fb2f406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.076+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fb30008a350 con 0x7fb3101598e0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.076+0000 7fb315fe7640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 0x7fb2f406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.076+0000 7fb315fe7640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 0x7fb2f406e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f60 tx=0x7fb30c007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.080+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fb31006b9c0 con 0x7fb3101598e0 2024-03-18T15:01:39.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.326+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fb31004f5b0 con 0x7fb3101598e0 2024-03-18T15:01:39.328 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.327+0000 7fb3067fc640 1 -- 172.21.15.152:0/2275939219 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v4) ==== 80+0+6645 (secure 0 0 0) 0x7fb3101f29e0 con 0x7fb3101598e0 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "auth_dump": [ 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.a", 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDgVvhlxHu5NBAAQDO0+YDYTZYubWtt961hSw==", 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.329 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.b", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhls6mbBRAAZ4Nr5NlgZ70Bngn1k9T5KA==", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.c", 2024-03-18T15:01:39.330 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhlDtGOABAA8W43KXoCrFJo/lD0+CZtUw==", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mds.d", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhlNf31DBAASIaC2y/PkxRUP4XUpHbwqA==", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-03-18T15:01:39.331 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.0", 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDkVvhlgy77LBAAOT3tS/nz1OPp3dlANETZLg==", 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.332 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.1", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDnVvhl9hnXKxAA51YEpjT3ypiIqzAOdg7uXg==", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.2", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDqVvhloQPHKRAAEy+1Cxfay5nca0EU5mW8qA==", 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.333 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.3", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDtVvhlpiRTKBAAU7Iqk1iMXltq9LXiLnfBVQ==", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.334 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.4", 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDzVvhlWlFSLRAAejetEweZdqWyxHFjEtd6zQ==", 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.5", 2024-03-18T15:01:39.335 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQD2VvhlMNSZKxAAybVmPznwJi6hKt1IMagBrg==", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.6", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQD5VvhlRDSWKhAAKYsPNsMATuaopldHyqfNUQ==", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.336 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "osd.7", 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQD8VvhlyA1aKBAAVGITniwrnRbePLMbzx134w==", 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow profile osd", 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile osd", 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.0", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhl0cU9ERAACsAQRXNU45kokSZDXpm31Q==", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.1", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhlRtKVGhAANXjy4hzPgXOyNds0iIS1cA==", 2024-03-18T15:01:39.338 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.2", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhlvBsRFxAAVmtuUSmUl0vVMmHwjphDrw==", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-03-18T15:01:39.339 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.3", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDhVvhl3FR2IBAADZYu6kqnB3gxDxbVoACV6w==", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow r", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow rw", 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow rwx" 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.340 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.admin", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA==", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "mgr": "allow *", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow *", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mds", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hlT0ecJRAAOjBobRJKj3I3K6ZxMklRzw==", 2024-03-18T15:01:39.341 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mds" 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-mgr", 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hlV0+cJRAA1nGsnyITWCr4bLlWSRLZog==", 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-mgr" 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-osd", 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hltFicJRAAWjHiVMKhTE9bBIxfWaqAJA==", 2024-03-18T15:01:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-osd" 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd", 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hl+F+cJRAAcBBNxhAH3KmGSarQT3pgag==", 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd" 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hllmacJRAASOTVCb/+CyE2wPeDRzd4Dw==", 2024-03-18T15:01:39.343 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "client.bootstrap-rgw", 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQAHV/hlC2+cJRAAnJt0/VyPkDZQMfal2Otimw==", 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile bootstrap-rgw" 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.x", 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDgVvhljg0mMRAAjDsLwj8NGVcUYGkkr/0Nvw==", 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.344 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: }, 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "entity": "mgr.y", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "key": "AQDgVvhlw9dILRAAdahzLC2rEtUcp9Pq3jzZ1A==", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "caps": { 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "mds": "allow *", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "mon": "allow profile mgr", 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: "osd": "allow *" 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout: ] 2024-03-18T15:01:39.345 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 msgr2=0x7fb2f406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 0x7fb2f406e0c0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb30c000f60 tx=0x7fb30c007d50 comp rx=0 tx=0).stop 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 msgr2=0x7fb3101f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fb30000e730 tx=0x7fb30000ebf0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 shutdown_connections 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fb310159cc0 0x7fb3100ce480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fb3101598e0 0x7fb3101f24a0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fb2f406bc00 0x7fb2f406e0c0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 --2- 172.21.15.152:0/2275939219 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fb3100d07f0 0x7fb3100b0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 >> 172.21.15.152:0/2275939219 conn(0x7fb31006b5e0 msgr2=0x7fb31006d430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 shutdown_connections 2024-03-18T15:01:39.348 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.329+0000 7fb31824b640 1 -- 172.21.15.152:0/2275939219 wait complete. 2024-03-18T15:01:39.348 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-03-18T15:01:39.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.449+0000 7f0651b10640 1 Processor -- start 2024-03-18T15:01:39.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.449+0000 7f0651b10640 1 -- start start 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f0651b10640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f064c15ad40 0x7f064c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f0651b10640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f064c0b3400 0x7f064c0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f0651b10640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f064c15ee60 con 0x7f064c0b3860 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f0651b10640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f064c15f140 con 0x7f064c0b3400 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f0651b10640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f064c15f420 con 0x7f064c15ad40 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064affd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f064c0b3400 0x7f064c0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064bfff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f064c0b3860 0x7f064c06dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54412/0 (socket says 172.21.15.152:54412) 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064bfff640 1 -- 172.21.15.152:0/2128631578 learned_addr learned my addr 172.21.15.152:0/2128631578 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064b7fe640 1 --2- 172.21.15.152:0/2128631578 >> v2:172.21.15.186:3300/0 conn(0x7f064c15ad40 0x7f064c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064affd640 1 -- 172.21.15.152:0/2128631578 >> v2:172.21.15.186:3300/0 conn(0x7f064c15ad40 msgr2=0x7f064c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064affd640 1 --2- 172.21.15.152:0/2128631578 >> v2:172.21.15.186:3300/0 conn(0x7f064c15ad40 0x7f064c0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064affd640 1 -- 172.21.15.152:0/2128631578 >> v1:172.21.15.152:6789/0 conn(0x7f064c0b3860 legacy=0x7f064c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064affd640 1 -- 172.21.15.152:0/2128631578 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c15f700 con 0x7f064c0b3400 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.450+0000 7f064a7fc640 1 -- 172.21.15.152:0/2128631578 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 27097525 0 0) 0x7f064c15ee60 con 0x7f064c0b3860 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f064affd640 1 --2- 172.21.15.152:0/2128631578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3400 0x7f064c0d00e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f064c071130 tx=0x7f064002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d36ebd20ca6a53 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f064a7fc640 1 -- 172.21.15.152:0/2128631578 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06400315a0 con 0x7f064c0b3400 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f064a7fc640 1 -- 172.21.15.152:0/2128631578 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0640037070 con 0x7f064c0b3400 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f064a7fc640 1 -- 172.21.15.152:0/2128631578 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640031960 con 0x7f064c0b3400 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 -- 172.21.15.152:0/2128631578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3400 msgr2=0x7f064c0d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 --2- 172.21.15.152:0/2128631578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3400 0x7f064c0d00e0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f064c071130 tx=0x7f064002b840 comp rx=0 tx=0).stop 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 -- 172.21.15.152:0/2128631578 shutdown_connections 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 --2- 172.21.15.152:0/2128631578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3400 0x7f064c0d00e0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 --2- 172.21.15.152:0/2128631578 >> v2:172.21.15.186:3300/0 conn(0x7f064c15ad40 0x7f064c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.451+0000 7f0651b10640 1 -- 172.21.15.152:0/2128631578 >> 172.21.15.152:0/2128631578 conn(0x7f064c06b5e0 msgr2=0x7f064c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:39.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.452+0000 7f0651b10640 1 -- 172.21.15.152:0/2128631578 shutdown_connections 2024-03-18T15:01:39.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.452+0000 7f0651b10640 1 -- 172.21.15.152:0/2128631578 wait complete. 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.453+0000 7f0651b10640 1 Processor -- start 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.453+0000 7f0651b10640 1 -- start start 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.453+0000 7f0651b10640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c0b3400 0x7f064c15b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.453+0000 7f0651b10640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.453+0000 7f0651b10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f064c15ad40 0x7f064c1f7940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0651b10640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f064c15eb90 con 0x7f064c0b3860 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0651b10640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f064c15ea10 con 0x7f064c0b3400 2024-03-18T15:01:39.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0651b10640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f064c0d0620 con 0x7f064c15ad40 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46692/0 (socket says 172.21.15.152:46692) 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 -- 172.21.15.152:0/37695778 learned_addr learned my addr 172.21.15.152:0/37695778 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064b7fe640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c0b3400 0x7f064c15b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064bfff640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f064c15ad40 0x7f064c1f7940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 -- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f064c15ad40 msgr2=0x7f064c1f7940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f064c15ad40 0x7f064c1f7940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 -- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c0b3400 msgr2=0x7f064c15b370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c0b3400 0x7f064c15b370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 -- 172.21.15.152:0/37695778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f064c09c130 con 0x7f064c0b3860 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f064affd640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0640000c00 tx=0x7f06400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640032630 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f06400327f0 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f064c09c410 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0640032be0 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.454+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f064c153ea0 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.455+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f064c04f5b0 con 0x7f064c0b3860 2024-03-18T15:01:39.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.456+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f064004d3f0 con 0x7f064c0b3860 2024-03-18T15:01:39.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.456+0000 7f0633fff640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 0x7f063806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.456+0000 7f064b7fe640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 0x7f063806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.456+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f064002f030 con 0x7f064c0b3860 2024-03-18T15:01:39.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.457+0000 7f064b7fe640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 0x7f063806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f063c009aa0 tx=0x7f063c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.461+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0640040070 con 0x7f064c0b3860 2024-03-18T15:01:39.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.700+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f064c0ad0a0 con 0x7f064c0b3860 2024-03-18T15:01:39.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.702+0000 7f0633fff640 1 -- 172.21.15.152:0/37695778 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v5) ==== 90+0+0 (secure 0 0 0) 0x7f064007a870 con 0x7f064c0b3860 2024-03-18T15:01:39.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 msgr2=0x7f063806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 0x7f063806e090 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f063c009aa0 tx=0x7f063c009190 comp rx=0 tx=0).stop 2024-03-18T15:01:39.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 msgr2=0x7f064c1f7400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f0640000c00 tx=0x7f06400046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 shutdown_connections 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f063806bbd0 0x7f063806e090 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f064c15ad40 0x7f064c1f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f064c0b3860 0x7f064c1f7400 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 --2- 172.21.15.152:0/37695778 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f064c0b3400 0x7f064c15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 >> 172.21.15.152:0/37695778 conn(0x7f064c06b5e0 msgr2=0x7f064c15d580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 shutdown_connections 2024-03-18T15:01:39.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.704+0000 7f0651b10640 1 -- 172.21.15.152:0/37695778 wait complete. 2024-03-18T15:01:39.716 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-03-18T15:01:39.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.816+0000 7f76b4a61640 1 Processor -- start 2024-03-18T15:01:39.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.816+0000 7f76b4a61640 1 -- start start 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76b4a61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76b4a61640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f76b00d1e40 0x7f76b00d2640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76b4a61640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76b00d3010 con 0x7f76b00d2b80 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76b4a61640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f76b00cff90 con 0x7f76b00d1e40 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76b4a61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76b00b34d0 con 0x7f76b015e5a0 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76a7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f76b00d1e40 0x7f76b00d2640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76aed9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76b00d2b80 0x7f76b00ceb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:54428/0 (socket says 172.21.15.152:54428) 2024-03-18T15:01:39.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76aed9d640 1 -- 172.21.15.152:0/3998767337 learned_addr learned my addr 172.21.15.152:0/3998767337 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76a7fff640 1 -- 172.21.15.152:0/3998767337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 msgr2=0x7f76b00d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76a7fff640 1 --2- 172.21.15.152:0/3998767337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76a7fff640 1 -- 172.21.15.152:0/3998767337 >> v1:172.21.15.152:6789/0 conn(0x7f76b00d2b80 legacy=0x7f76b00ceb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76a7fff640 1 -- 172.21.15.152:0/3998767337 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b00d1200 con 0x7f76b00d1e40 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.817+0000 7f76add9b640 1 -- 172.21.15.152:0/3998767337 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2221594455 0 0) 0x7f76b00d3010 con 0x7f76b00d2b80 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76a7fff640 1 --2- 172.21.15.152:0/3998767337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b00d2640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f76980097a0 tx=0x7f769802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63a4dd9c2b10918c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76add9b640 1 -- 172.21.15.152:0/3998767337 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76980315a0 con 0x7f76b00d1e40 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76add9b640 1 -- 172.21.15.152:0/3998767337 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7698037070 con 0x7f76b00d1e40 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76add9b640 1 -- 172.21.15.152:0/3998767337 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7698031960 con 0x7f76b00d1e40 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76b4a61640 1 -- 172.21.15.152:0/3998767337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 msgr2=0x7f76b00d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.818+0000 7f76b4a61640 1 --2- 172.21.15.152:0/3998767337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b00d2640 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f76980097a0 tx=0x7f769802b840 comp rx=0 tx=0).stop 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 -- 172.21.15.152:0/3998767337 shutdown_connections 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 --2- 172.21.15.152:0/3998767337 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b00d2640 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 --2- 172.21.15.152:0/3998767337 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 -- 172.21.15.152:0/3998767337 >> 172.21.15.152:0/3998767337 conn(0x7f76b00d4060 msgr2=0x7f76b00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:39.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 -- 172.21.15.152:0/3998767337 shutdown_connections 2024-03-18T15:01:39.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.819+0000 7f76b4a61640 1 -- 172.21.15.152:0/3998767337 wait complete. 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.820+0000 7f76b4a61640 1 Processor -- start 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.820+0000 7f76b4a61640 1 -- start start 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 0x7f76b00b8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00b4c50 con 0x7f76b00d1e40 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f76b00d17c0 con 0x7f76b00d2b80 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76b00b4dd0 con 0x7f76b015e5a0 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46722/0 (socket says 172.21.15.152:46722) 2024-03-18T15:01:39.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 -- 172.21.15.152:0/1600307977 learned_addr learned my addr 172.21.15.152:0/1600307977 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76aed9d640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76a7fff640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 0x7f76b00b8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 -- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 msgr2=0x7f76b00cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 -- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 msgr2=0x7f76b00b8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 0x7f76b00b8ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 -- 172.21.15.152:0/1600307977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b015d910 con 0x7f76b00d1e40 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76a7fff640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 0x7f76b00b8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76ae59c640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76a000b4a0 tx=0x7f76a000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0014070 con 0x7f76b00d1e40 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76a0010610 con 0x7f76b00d1e40 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76b00b98a0 con 0x7f76b00d1e40 2024-03-18T15:01:39.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0010a00 con 0x7f76b00d1e40 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.821+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76b00c8ec0 con 0x7f76b00d1e40 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.822+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b004f5b0 con 0x7f76b00d1e40 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.823+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f76a0017070 con 0x7f76b00d1e40 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.823+0000 7f76a6ffd640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 0x7f769006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.823+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f76a008a130 con 0x7f76b00d1e40 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.823+0000 7f76a7fff640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 0x7f769006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:39.827 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.824+0000 7f76a7fff640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 0x7f769006e0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7698036000 tx=0x7f7698008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:39.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:39.828+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f76a0058f70 con 0x7f76b00d1e40 2024-03-18T15:01:40.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.067+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f76b00c95c0 con 0x7f76b00d1e40 2024-03-18T15:01:40.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.072+0000 7f76a6ffd640 1 -- 172.21.15.152:0/1600307977 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v6) ==== 90+0+0 (secure 0 0 0) 0x7f76a0058870 con 0x7f76b00d1e40 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 msgr2=0x7f769006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 0x7f769006e0c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f7698036000 tx=0x7f7698008030 comp rx=0 tx=0).stop 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 msgr2=0x7f76b015d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f76a000b4a0 tx=0x7f76a000b960 comp rx=0 tx=0).stop 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 shutdown_connections 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f769006bc00 0x7f769006e0c0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.073+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b015e5a0 0x7f76b00cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.074+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b00d2b80 0x7f76b00b8ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.074+0000 7f76b4a61640 1 --2- 172.21.15.152:0/1600307977 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b00d1e40 0x7f76b015d3d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.074+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 >> 172.21.15.152:0/1600307977 conn(0x7f76b00d4060 msgr2=0x7f76b006bd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.074+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 shutdown_connections 2024-03-18T15:01:40.076 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.074+0000 7f76b4a61640 1 -- 172.21.15.152:0/1600307977 wait complete. 2024-03-18T15:01:40.086 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-03-18T15:01:40.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.186+0000 7f0a61219640 1 Processor -- start 2024-03-18T15:01:40.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.186+0000 7f0a61219640 1 -- start start 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a61219640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c15ad40 0x7f0a5c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a61219640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a61219640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0a5c15ee60 con 0x7f0a5c0b3860 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a61219640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f0a5c15f140 con 0x7f0a5c0b3400 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a61219640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5c15f420 con 0x7f0a5c15ad40 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46734/0 (socket says 172.21.15.152:46734) 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 -- 172.21.15.152:0/2092643075 learned_addr learned my addr 172.21.15.152:0/2092643075 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:40.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5ad9d640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c15ad40 0x7f0a5c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 -- 172.21.15.152:0/2092643075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c15ad40 msgr2=0x7f0a5c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c15ad40 0x7f0a5c0ad800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 -- 172.21.15.152:0/2092643075 >> v1:172.21.15.186:6789/0 conn(0x7f0a5c0b3860 legacy=0x7f0a5c06dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.187+0000 7f0a5a59c640 1 -- 172.21.15.152:0/2092643075 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c15f700 con 0x7f0a5c0b3400 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a5a59c640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009870 tx=0x7f0a5002b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4faa19de12696c7c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a59d9b640 1 -- 172.21.15.152:0/2092643075 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a500317c0 con 0x7f0a5c0b3400 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a59d9b640 1 -- 172.21.15.152:0/2092643075 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a50037070 con 0x7f0a5c0b3400 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a59d9b640 1 -- 172.21.15.152:0/2092643075 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50031b80 con 0x7f0a5c0b3400 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 -- 172.21.15.152:0/2092643075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c0b3400 msgr2=0x7f0a5c0d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009870 tx=0x7f0a5002b860 comp rx=0 tx=0).stop 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 -- 172.21.15.152:0/2092643075 shutdown_connections 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c0d00e0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 --2- 172.21.15.152:0/2092643075 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c15ad40 0x7f0a5c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.188+0000 7f0a61219640 1 -- 172.21.15.152:0/2092643075 >> 172.21.15.152:0/2092643075 conn(0x7f0a5c06b5e0 msgr2=0x7f0a5c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.189+0000 7f0a61219640 1 -- 172.21.15.152:0/2092643075 shutdown_connections 2024-03-18T15:01:40.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.189+0000 7f0a61219640 1 -- 172.21.15.152:0/2092643075 wait complete. 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.190+0000 7f0a61219640 1 Processor -- start 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.190+0000 7f0a61219640 1 -- start start 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c152800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c0b3860 0x7f0a5c0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c15ea10 con 0x7f0a5c15ad40 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0a5c15b330 con 0x7f0a5c0b3400 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a61219640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0a5c15eb90 con 0x7f0a5c0b3860 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46738/0 (socket says 172.21.15.152:46738) 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 -- 172.21.15.152:0/4062872356 learned_addr learned my addr 172.21.15.152:0/4062872356 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5ad9d640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c152800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5a59c640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c0b3860 0x7f0a5c0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 -- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c0b3860 msgr2=0x7f0a5c0b1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c0b3860 0x7f0a5c0b1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 -- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a5c0b3400 msgr2=0x7f0a5c152800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c152800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 -- 172.21.15.152:0/4062872356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a5c0c9230 con 0x7f0a5c15ad40 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a5b59e640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400b9a0 tx=0x7f0a5400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.191+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54019070 con 0x7f0a5c15ad40 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.192+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a5400cba0 con 0x7f0a5c15ad40 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.192+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a5c0c9510 con 0x7f0a5c15ad40 2024-03-18T15:01:40.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.192+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a54014440 con 0x7f0a5c15ad40 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.192+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a5c0c9ad0 con 0x7f0a5c15ad40 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.193+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a5c04f5b0 con 0x7f0a5c15ad40 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.193+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0a5401c070 con 0x7f0a5c15ad40 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.194+0000 7f0a437fe640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 0x7f0a4806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.194+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f0a5408a300 con 0x7f0a5c15ad40 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.194+0000 7f0a5ad9d640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 0x7f0a4806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.194+0000 7f0a5ad9d640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 0x7f0a4806e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00aac0 tx=0x7f0a4c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.198+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0a54058b80 con 0x7f0a5c15ad40 2024-03-18T15:01:40.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.443+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f0a5c071ad0 con 0x7f0a5c15ad40 2024-03-18T15:01:40.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.447+0000 7f0a437fe640 1 -- 172.21.15.152:0/4062872356 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v7) ==== 90+0+0 (secure 0 0 0) 0x7f0a5405cc20 con 0x7f0a5c15ad40 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 msgr2=0x7f0a4806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 0x7f0a4806e090 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00aac0 tx=0x7f0a4c008040 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 msgr2=0x7f0a5c0cb1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f0a5400b9a0 tx=0x7f0a5400be60 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 shutdown_connections 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0a5c15ad40 0x7f0a5c0cb1b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0a4806bbd0 0x7f0a4806e090 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0a5c0b3860 0x7f0a5c0b1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 --2- 172.21.15.152:0/4062872356 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0a5c0b3400 0x7f0a5c152800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 >> 172.21.15.152:0/4062872356 conn(0x7f0a5c06b5e0 msgr2=0x7f0a5c06b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 shutdown_connections 2024-03-18T15:01:40.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.449+0000 7f0a61219640 1 -- 172.21.15.152:0/4062872356 wait complete. 2024-03-18T15:01:40.461 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-03-18T15:01:40.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.561+0000 7ffb4c30c640 1 Processor -- start 2024-03-18T15:01:40.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 -- start start 2024-03-18T15:01:40.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb441622b0 0x7ffb440d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ffb4415ea90 0x7ffb4415eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb440b3440 con 0x7ffb44162690 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7ffb440d16c0 con 0x7ffb441622b0 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.562+0000 7ffb4c30c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ffb440d2660 con 0x7ffb4415ea90 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb441622b0 0x7ffb440d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7ffb441622b0 0x7ffb440d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46712/0 (socket says 172.21.15.152:46712) 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2877910545 learned_addr learned my addr 172.21.15.152:0/2877910545 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:40.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a8a9640 1 --2- 172.21.15.152:0/2877910545 >> v2:172.21.15.186:3300/0 conn(0x7ffb4415ea90 0x7ffb4415eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2877910545 >> v2:172.21.15.186:3300/0 conn(0x7ffb4415ea90 msgr2=0x7ffb4415eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 --2- 172.21.15.152:0/2877910545 >> v2:172.21.15.186:3300/0 conn(0x7ffb4415ea90 0x7ffb4415eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2877910545 >> v1:172.21.15.186:6789/0 conn(0x7ffb44162690 legacy=0x7ffb44162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.563+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2877910545 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb440d20a0 con 0x7ffb441622b0 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb4a0a8640 1 --2- 172.21.15.152:0/2877910545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb441622b0 0x7ffb440d10d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009870 tx=0x7ffb4002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6307f8f3b4eba2d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb490a6640 1 -- 172.21.15.152:0/2877910545 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4002e070 con 0x7ffb441622b0 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb490a6640 1 -- 172.21.15.152:0/2877910545 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb40037070 con 0x7ffb441622b0 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb490a6640 1 -- 172.21.15.152:0/2877910545 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40031a00 con 0x7ffb441622b0 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2877910545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb441622b0 msgr2=0x7ffb440d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.564+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2877910545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb441622b0 0x7ffb440d10d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7ffb40009870 tx=0x7ffb4002b880 comp rx=0 tx=0).stop 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2877910545 shutdown_connections 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2877910545 >> v2:172.21.15.186:3300/0 conn(0x7ffb4415ea90 0x7ffb4415eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2877910545 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb441622b0 0x7ffb440d10d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2877910545 >> 172.21.15.152:0/2877910545 conn(0x7ffb440d4070 msgr2=0x7ffb440d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2877910545 shutdown_connections 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.565+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2877910545 wait complete. 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 Processor -- start 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 -- start start 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb441622b0 0x7ffb440b9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb44162690 0x7ffb440b9a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ffb440cfc90 con 0x7ffb4415ea90 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ffb440d2ab0 con 0x7ffb441622b0 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4c30c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ffb440cfe10 con 0x7ffb44162690 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.566+0000 7ffb4a0a8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46728/0 (socket says 172.21.15.152:46728) 2024-03-18T15:01:40.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2773582792 learned_addr learned my addr 172.21.15.152:0/2773582792 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb44162690 msgr2=0x7ffb440b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb44162690 0x7ffb440b9a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb441622b0 msgr2=0x7ffb440b9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb441622b0 0x7ffb440b9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 -- 172.21.15.152:0/2773582792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb440cc8f0 con 0x7ffb4415ea90 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4a0a8640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb4002b8c0 tx=0x7ffb400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40032670 con 0x7ffb4415ea90 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb40032810 con 0x7ffb4415ea90 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb40032c00 con 0x7ffb4415ea90 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb440ccbd0 con 0x7ffb4415ea90 2024-03-18T15:01:40.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.567+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb440cd190 con 0x7ffb4415ea90 2024-03-18T15:01:40.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.568+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb4404f5b0 con 0x7ffb4415ea90 2024-03-18T15:01:40.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.568+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ffb4004c060 con 0x7ffb4415ea90 2024-03-18T15:01:40.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.569+0000 7ffb36ffd640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 0x7ffb2806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.569+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7ffb400ac080 con 0x7ffb4415ea90 2024-03-18T15:01:40.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.569+0000 7ffb498a7640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 0x7ffb2806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.569+0000 7ffb498a7640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 0x7ffb2806e0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000f60 tx=0x7ffb380079d0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.574 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.573+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ffb40040070 con 0x7ffb4415ea90 2024-03-18T15:01:40.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.815+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7ffb440ca660 con 0x7ffb4415ea90 2024-03-18T15:01:40.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.818+0000 7ffb36ffd640 1 -- 172.21.15.152:0/2773582792 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v8) ==== 90+0+0 (secure 0 0 0) 0x7ffb4007aec0 con 0x7ffb4415ea90 2024-03-18T15:01:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 msgr2=0x7ffb2806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 0x7ffb2806e0c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000f60 tx=0x7ffb380079d0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 msgr2=0x7ffb441f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7ffb4002b8c0 tx=0x7ffb400046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 shutdown_connections 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ffb2806bc00 0x7ffb2806e0c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ffb44162690 0x7ffb440b9a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ffb441622b0 0x7ffb440b9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 --2- 172.21.15.152:0/2773582792 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ffb4415ea90 0x7ffb441f3b00 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 >> 172.21.15.152:0/2773582792 conn(0x7ffb440d4070 msgr2=0x7ffb441603a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 shutdown_connections 2024-03-18T15:01:40.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.820+0000 7ffb4c30c640 1 -- 172.21.15.152:0/2773582792 wait complete. 2024-03-18T15:01:40.832 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-03-18T15:01:40.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.933+0000 7ff6ee5d3640 1 Processor -- start 2024-03-18T15:01:40.934 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.933+0000 7ff6ee5d3640 1 -- start start 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ee5d3640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff6e815ad40 0x7ff6e80ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ee5d3640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e815ee60 con 0x7ff6e80d07f0 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ee5d3640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6e815f140 con 0x7ff6e80b3400 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ee5d3640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff6e815f420 con 0x7ff6e815ad40 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ecb70640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7ff6e80d07f0 0x7ff6e80722c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:51972/0 (socket says 172.21.15.152:51972) 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6ecb70640 1 -- 172.21.15.152:0/1483422476 learned_addr learned my addr 172.21.15.152:0/1483422476 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3957494928 0 0) 0x7ff6e815ee60 con 0x7ff6e80d07f0 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff6d0003520 con 0x7ff6e80d07f0 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e7fff640 1 --2- 172.21.15.152:0/1483422476 >> v2:172.21.15.186:3300/0 conn(0x7ff6e815ad40 0x7ff6e80ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1156276592 0 0) 0x7ff6d0003520 con 0x7ff6e80d07f0 2024-03-18T15:01:40.938 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 >> v2:172.21.15.186:3300/0 conn(0x7ff6e815ad40 msgr2=0x7ff6e80ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 --2- 172.21.15.152:0/1483422476 >> v2:172.21.15.186:3300/0 conn(0x7ff6e815ad40 0x7ff6e80ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 >> v1:172.21.15.186:6789/0 conn(0x7ff6e80b3400 legacy=0x7ff6e80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e815f700 con 0x7ff6e80d07f0 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7ff6e00019f0 con 0x7ff6e80d07f0 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 >> v1:172.21.15.152:6789/0 conn(0x7ff6e80d07f0 legacy=0x7ff6e80722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6d0003a20 0x7ff6d0003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6d0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6d00052e0 0x7ff6d000b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e815f420 con 0x7ff6d0004800 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6d000c230 con 0x7ff6d0003a20 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff6d000c430 con 0x7ff6d00052e0 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6d0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.934+0000 7ff6e7fff640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6d0003a20 0x7ff6d0003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6ecb70640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6d00052e0 0x7ff6d000b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 -- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6d00052e0 msgr2=0x7ff6d000b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6d00052e0 0x7ff6d000b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 -- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6d0003a20 msgr2=0x7ff6d0003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6d0003a20 0x7ff6d0003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 -- 172.21.15.152:0/1483422476 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6d0003520 con 0x7ff6d0004800 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6ecb70640 1 -- 172.21.15.152:0/1483422476 reap_dead start 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.935+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6d0004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001720 tx=0x7ff6d0005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f84b21c2b8025c31 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc001370 con 0x7ff6d0004800 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6dc0052d0 con 0x7ff6d0004800 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6e6ffd640 1 -- 172.21.15.152:0/1483422476 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6dc003830 con 0x7ff6d0004800 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 msgr2=0x7ff6d0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6d0004c80 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc001720 tx=0x7ff6d0005830 comp rx=0 tx=0).stop 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/1483422476 shutdown_connections 2024-03-18T15:01:40.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/1483422476 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6d0004c80 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/1483422476 >> 172.21.15.152:0/1483422476 conn(0x7ff6e806b5e0 msgr2=0x7ff6e806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:40.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/1483422476 shutdown_connections 2024-03-18T15:01:40.941 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.936+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/1483422476 wait complete. 2024-03-18T15:01:40.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.937+0000 7ff6ee5d3640 1 Processor -- start 2024-03-18T15:01:40.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 -- start start 2024-03-18T15:01:40.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e809c590 0x7ff6e809aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6e809af90 0x7ff6e8155490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e815ea10 con 0x7ff6d0004800 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff6e815b330 con 0x7ff6e809c590 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6ee5d3640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff6e815eb90 con 0x7ff6e809af90 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6e7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46742/0 (socket says 172.21.15.152:46742) 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.938+0000 7ff6e7fff640 1 -- 172.21.15.152:0/2949097897 learned_addr learned my addr 172.21.15.152:0/2949097897 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 -- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6e809af90 msgr2=0x7ff6e8155490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6e809af90 0x7ff6e8155490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 -- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e809c590 msgr2=0x7ff6e809aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e809c590 0x7ff6e809aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 -- 172.21.15.152:0/2949097897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6e809b4f0 con 0x7ff6d0004800 2024-03-18T15:01:40.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e7fff640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b7f0 tx=0x7ff6d800bcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8018070 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6d80107d0 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6e809b7d0 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8010bc0 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.939+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6e809bd90 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.940+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6e804f5b0 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.940+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff6d801b070 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.941+0000 7ff6e4ff9640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 0x7ff6d406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.941+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7ff6d808ab00 con 0x7ff6d0004800 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.941+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 0x7ff6d406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:40.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.941+0000 7ff6e77fe640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 0x7ff6d406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc033000 tx=0x7ff6dc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:40.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:40.945+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7ff6d80599d0 con 0x7ff6d0004800 2024-03-18T15:01:41.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.186+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7ff6e8071ad0 con 0x7ff6d0004800 2024-03-18T15:01:41.189 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.188+0000 7ff6e4ff9640 1 -- 172.21.15.152:0/2949097897 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v9) ==== 97+0+0 (secure 0 0 0) 0x7ff6d80592d0 con 0x7ff6d0004800 2024-03-18T15:01:41.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 msgr2=0x7ff6d406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 0x7ff6d406e090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff6dc033000 tx=0x7ff6dc02f000 comp rx=0 tx=0).stop 2024-03-18T15:01:41.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 msgr2=0x7ff6e81478e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7ff6d800b7f0 tx=0x7ff6d800bcb0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 shutdown_connections 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff6d406bbd0 0x7ff6d406e090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff6e809af90 0x7ff6e8155490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff6e809c590 0x7ff6e809aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 --2- 172.21.15.152:0/2949097897 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff6d0004800 0x7ff6e81478e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 >> 172.21.15.152:0/2949097897 conn(0x7ff6e806b5e0 msgr2=0x7ff6e80ad7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 shutdown_connections 2024-03-18T15:01:41.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.191+0000 7ff6ee5d3640 1 -- 172.21.15.152:0/2949097897 wait complete. 2024-03-18T15:01:41.203 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-03-18T15:01:41.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.302+0000 7f2030cae640 1 Processor -- start 2024-03-18T15:01:41.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.302+0000 7f2030cae640 1 -- start start 2024-03-18T15:01:41.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f2030cae640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f202c0d10d0 0x7f202c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f2030cae640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f202c15ea90 0x7f202c15eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f2030cae640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f202c0b3440 con 0x7f202c1622b0 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f2030cae640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f202c0d16c0 con 0x7f202c15ea90 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f2030cae640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f202c0d2660 con 0x7f202c0d10d0 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f202ad9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f202c15ea90 0x7f202c15eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f202ad9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f202c15ea90 0x7f202c15eee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46746/0 (socket says 172.21.15.152:46746) 2024-03-18T15:01:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.303+0000 7f202ad9d640 1 -- 172.21.15.152:0/2035030794 learned_addr learned my addr 172.21.15.152:0/2035030794 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f2029d9b640 1 --2- 172.21.15.152:0/2035030794 >> v2:172.21.15.186:3300/0 conn(0x7f202c0d10d0 0x7f202c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f202ad9d640 1 -- 172.21.15.152:0/2035030794 >> v2:172.21.15.186:3300/0 conn(0x7f202c0d10d0 msgr2=0x7f202c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f202ad9d640 1 --2- 172.21.15.152:0/2035030794 >> v2:172.21.15.186:3300/0 conn(0x7f202c0d10d0 0x7f202c162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f202ad9d640 1 -- 172.21.15.152:0/2035030794 >> v1:172.21.15.186:6789/0 conn(0x7f202c1622b0 legacy=0x7f202c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f202ad9d640 1 -- 172.21.15.152:0/2035030794 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c0d20a0 con 0x7f202c15ea90 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.304+0000 7f202ad9d640 1 --2- 172.21.15.152:0/2035030794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c15ea90 0x7f202c15eee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2024009870 tx=0x7f202402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a611add11093fd server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f202959a640 1 -- 172.21.15.152:0/2035030794 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f202402e070 con 0x7f202c15ea90 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f202959a640 1 -- 172.21.15.152:0/2035030794 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2024037070 con 0x7f202c15ea90 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f202959a640 1 -- 172.21.15.152:0/2035030794 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024031a00 con 0x7f202c15ea90 2024-03-18T15:01:41.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 -- 172.21.15.152:0/2035030794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c15ea90 msgr2=0x7f202c15eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 --2- 172.21.15.152:0/2035030794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c15ea90 0x7f202c15eee0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f2024009870 tx=0x7f202402b880 comp rx=0 tx=0).stop 2024-03-18T15:01:41.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 -- 172.21.15.152:0/2035030794 shutdown_connections 2024-03-18T15:01:41.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 --2- 172.21.15.152:0/2035030794 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c15ea90 0x7f202c15eee0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 --2- 172.21.15.152:0/2035030794 >> v2:172.21.15.186:3300/0 conn(0x7f202c0d10d0 0x7f202c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 -- 172.21.15.152:0/2035030794 >> 172.21.15.152:0/2035030794 conn(0x7f202c0d4070 msgr2=0x7f202c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 -- 172.21.15.152:0/2035030794 shutdown_connections 2024-03-18T15:01:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.305+0000 7f2030cae640 1 -- 172.21.15.152:0/2035030794 wait complete. 2024-03-18T15:01:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 Processor -- start 2024-03-18T15:01:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 -- start start 2024-03-18T15:01:41.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 0x7f202c1f84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f202c15ea90 0x7f202c0b5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0cfc90 con 0x7f202c1622b0 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f202c0d2ab0 con 0x7f202c0d10d0 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f2030cae640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f202c0cfe10 con 0x7f202c15ea90 2024-03-18T15:01:41.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.307+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46760/0 (socket says 172.21.15.152:46760) 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 -- 172.21.15.152:0/999708943 learned_addr learned my addr 172.21.15.152:0/999708943 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202a59c640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 0x7f202c1f84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f2029d9b640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f202c15ea90 0x7f202c0b5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 -- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f202c15ea90 msgr2=0x7f202c0b5650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.321 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f202c15ea90 0x7f202c0b5650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 -- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 msgr2=0x7f202c1f84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 0x7f202c1f84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 -- 172.21.15.152:0/999708943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f202c0b7140 con 0x7f202c1622b0 2024-03-18T15:01:41.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202a59c640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 0x7f202c1f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:41.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f202ad9d640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20240090b0 tx=0x7f20240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024032670 con 0x7f202c1622b0 2024-03-18T15:01:41.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2024032830 con 0x7f202c1622b0 2024-03-18T15:01:41.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f202c0b7420 con 0x7f202c1622b0 2024-03-18T15:01:41.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2024032c20 con 0x7f202c1622b0 2024-03-18T15:01:41.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.308+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f202c0b79e0 con 0x7f202c1622b0 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.309+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f202c04f5b0 con 0x7f202c1622b0 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.310+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f202404c060 con 0x7f202c1622b0 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.310+0000 7f201affd640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 0x7f200c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.310+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f20240ac250 con 0x7f202c1622b0 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.310+0000 7f202a59c640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 0x7f200c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.310+0000 7f202a59c640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 0x7f200c06e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f201c001e00 tx=0x7f201c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.314+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2024040070 con 0x7f202c1622b0 2024-03-18T15:01:41.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.551+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f202c0d18d0 con 0x7f202c1622b0 2024-03-18T15:01:41.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.553+0000 7f201affd640 1 -- 172.21.15.152:0/999708943 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f202407b000 con 0x7f202c1622b0 2024-03-18T15:01:41.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 msgr2=0x7f200c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 0x7f200c06e090 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f201c001e00 tx=0x7f201c009040 comp rx=0 tx=0).stop 2024-03-18T15:01:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 msgr2=0x7f202c0b81e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f20240090b0 tx=0x7f20240046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 shutdown_connections 2024-03-18T15:01:41.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f202c1622b0 0x7f202c0b81e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f200c06bbd0 0x7f200c06e090 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f202c15ea90 0x7f202c0b5650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 --2- 172.21.15.152:0/999708943 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f202c0d10d0 0x7f202c1f84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 >> 172.21.15.152:0/999708943 conn(0x7f202c0d4070 msgr2=0x7f202c06cd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 shutdown_connections 2024-03-18T15:01:41.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.556+0000 7f2030cae640 1 -- 172.21.15.152:0/999708943 wait complete. 2024-03-18T15:01:41.568 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:41.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.668+0000 7f69885f4640 1 Processor -- start 2024-03-18T15:01:41.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.668+0000 7f69885f4640 1 -- start start 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f69885f4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f698015e4f0 0x7f698006e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f69885f4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 0x7f698006ef10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f69885f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f698006f450 con 0x7f698015e110 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f69885f4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6980071930 con 0x7f698015e4f0 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f69885f4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6980071c10 con 0x7f69800cfd30 2024-03-18T15:01:41.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f698015e4f0 0x7f698006e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f698015e4f0 0x7f698006e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46768/0 (socket says 172.21.15.152:46768) 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 -- 172.21.15.152:0/3417355905 learned_addr learned my addr 172.21.15.152:0/3417355905 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6986b91640 1 --2- 172.21.15.152:0/3417355905 >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 0x7f698006ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 -- 172.21.15.152:0/3417355905 >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 msgr2=0x7f698006ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 --2- 172.21.15.152:0/3417355905 >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 0x7f698006ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 -- 172.21.15.152:0/3417355905 >> v1:172.21.15.186:6789/0 conn(0x7f698015e110 legacy=0x7f69800cf620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6985b8f640 1 -- 172.21.15.152:0/3417355905 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6980071ef0 con 0x7f698015e4f0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.669+0000 7f6986b91640 1 --2- 172.21.15.152:0/3417355905 >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 0x7f698006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f6985b8f640 1 --2- 172.21.15.152:0/3417355905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e4f0 0x7f698006e9d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69800ceeb0 tx=0x7f697002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89d4333b6dc8820 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f698538e640 1 -- 172.21.15.152:0/3417355905 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970035020 con 0x7f698015e4f0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f698538e640 1 -- 172.21.15.152:0/3417355905 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6970031870 con 0x7f698015e4f0 2024-03-18T15:01:41.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f698538e640 1 -- 172.21.15.152:0/3417355905 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970031c40 con 0x7f698015e4f0 2024-03-18T15:01:41.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f69885f4640 1 -- 172.21.15.152:0/3417355905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e4f0 msgr2=0x7f698006e9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.670+0000 7f69885f4640 1 --2- 172.21.15.152:0/3417355905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e4f0 0x7f698006e9d0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f69800ceeb0 tx=0x7f697002b910 comp rx=0 tx=0).stop 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 -- 172.21.15.152:0/3417355905 shutdown_connections 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 --2- 172.21.15.152:0/3417355905 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e4f0 0x7f698006e9d0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 --2- 172.21.15.152:0/3417355905 >> v2:172.21.15.186:3300/0 conn(0x7f69800cfd30 0x7f698006ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 -- 172.21.15.152:0/3417355905 >> 172.21.15.152:0/3417355905 conn(0x7f69800ccfb0 msgr2=0x7f69800cd3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 -- 172.21.15.152:0/3417355905 shutdown_connections 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.671+0000 7f69885f4640 1 -- 172.21.15.152:0/3417355905 wait complete. 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 Processor -- start 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 -- start start 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69800cfd30 0x7f69800b4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 0x7f69800b37b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f69800ada40 con 0x7f698015e110 2024-03-18T15:01:41.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f69800ad8c0 con 0x7f698015e4f0 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.672+0000 7f69885f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f69800adbc0 con 0x7f69800cfd30 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46778/0 (socket says 172.21.15.152:46778) 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 -- 172.21.15.152:0/2879702168 learned_addr learned my addr 172.21.15.152:0/2879702168 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 -- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69800cfd30 msgr2=0x7f69800b4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6986390640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69800cfd30 0x7f69800b4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6986b91640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 0x7f69800b37b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69800cfd30 0x7f69800b4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 -- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 msgr2=0x7f69800b37b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 0x7f69800b37b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 -- 172.21.15.152:0/2879702168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69800b3e20 con 0x7f698015e110 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6986b91640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 0x7f69800b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:41.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6985b8f640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f697002b950 tx=0x7f69700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970040070 con 0x7f698015e110 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f697003a420 con 0x7f698015e110 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69800b4100 con 0x7f698015e110 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6970035040 con 0x7f698015e110 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.673+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69800b46c0 con 0x7f698015e110 2024-03-18T15:01:41.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.674+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f698004f5b0 con 0x7f698015e110 2024-03-18T15:01:41.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.675+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f697004b060 con 0x7f698015e110 2024-03-18T15:01:41.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.675+0000 7f6976ffd640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 0x7f696406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.675+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f69700ac530 con 0x7f698015e110 2024-03-18T15:01:41.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.675+0000 7f6986390640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 0x7f696406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.676+0000 7f6986390640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 0x7f696406e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f697c003d90 tx=0x7f697c009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.679+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f697007b400 con 0x7f698015e110 2024-03-18T15:01:41.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.853+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f69800aeb10 con 0x7f698015e110 2024-03-18T15:01:41.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.854+0000 7f6976ffd640 1 -- 172.21.15.152:0/2879702168 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) ==== 74+0+12939 (secure 0 0 0) 0x7f697007ad00 con 0x7f698015e110 2024-03-18T15:01:41.855 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:41.855 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":31,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:38.964399+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":20,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:41.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.855+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 msgr2=0x7f696406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 0x7f696406e0c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f697c003d90 tx=0x7f697c009040 comp rx=0 tx=0).stop 2024-03-18T15:01:41.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 msgr2=0x7f6980142ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f697002b950 tx=0x7f69700046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.857 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 shutdown_connections 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f698015e4f0 0x7f69800b37b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f698015e110 0x7f6980142ba0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f696406bc00 0x7f696406e0c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 --2- 172.21.15.152:0/2879702168 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f69800cfd30 0x7f69800b4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 >> 172.21.15.152:0/2879702168 conn(0x7f69800ccfb0 msgr2=0x7f69800cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 shutdown_connections 2024-03-18T15:01:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.856+0000 7f69885f4640 1 -- 172.21.15.152:0/2879702168 wait complete. 2024-03-18T15:01:41.868 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T15:01:41.868 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T15:01:41.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.970+0000 7fda1255b640 1 Processor -- start 2024-03-18T15:01:41.972 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda1255b640 1 -- start start 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda1255b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda0c0cfca0 0x7fda0c0cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda1255b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0c0cc370 con 0x7fda0c15b120 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda1255b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fda0c0cc650 con 0x7fda0c0cd410 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda1255b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fda0c0cc930 con 0x7fda0c0cfca0 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda10af8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fda0c0cfca0 0x7fda0c0cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda0bfff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fda0c15b120 0x7fda0c0cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:51988/0 (socket says 172.21.15.152:51988) 2024-03-18T15:01:41.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.971+0000 7fda0bfff640 1 -- 172.21.15.152:0/3048299807 learned_addr learned my addr 172.21.15.152:0/3048299807 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:41.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.972+0000 7fda10af8640 1 -- 172.21.15.152:0/3048299807 >> v1:172.21.15.186:6789/0 conn(0x7fda0c0cd410 legacy=0x7fda0c06ddc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:41.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.972+0000 7fda10af8640 1 -- 172.21.15.152:0/3048299807 >> v1:172.21.15.152:6789/0 conn(0x7fda0c15b120 legacy=0x7fda0c0cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.972+0000 7fda10af8640 1 -- 172.21.15.152:0/3048299807 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c0ccc10 con 0x7fda0c0cfca0 2024-03-18T15:01:41.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.972+0000 7fda0affd640 1 -- 172.21.15.152:0/3048299807 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 18278811 0 0) 0x7fda0c0cc370 con 0x7fda0c15b120 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.972+0000 7fda10af8640 1 --2- 172.21.15.152:0/3048299807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0cbd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda04009d90 tx=0x7fda0402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7d37552982c8f38 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda0affd640 1 -- 172.21.15.152:0/3048299807 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04039070 con 0x7fda0c0cfca0 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda0affd640 1 -- 172.21.15.152:0/3048299807 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda0402cbd0 con 0x7fda0c0cfca0 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda0affd640 1 -- 172.21.15.152:0/3048299807 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda04034440 con 0x7fda0c0cfca0 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 -- 172.21.15.152:0/3048299807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cfca0 msgr2=0x7fda0c0cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 --2- 172.21.15.152:0/3048299807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0cbd00 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fda04009d90 tx=0x7fda0402be20 comp rx=0 tx=0).stop 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 -- 172.21.15.152:0/3048299807 shutdown_connections 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 --2- 172.21.15.152:0/3048299807 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0cbd00 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 -- 172.21.15.152:0/3048299807 >> 172.21.15.152:0/3048299807 conn(0x7fda0c0d0da0 msgr2=0x7fda0c0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:41.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 -- 172.21.15.152:0/3048299807 shutdown_connections 2024-03-18T15:01:41.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.973+0000 7fda1255b640 1 -- 172.21.15.152:0/3048299807 wait complete. 2024-03-18T15:01:41.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.974+0000 7fda1255b640 1 Processor -- start 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 -- start start 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0b6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda0c15b120 0x7fda0c1f7770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0cf1e0 con 0x7fda0c0cd410 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fda0c0cf060 con 0x7fda0c0cfca0 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda1255b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fda0c071d60 con 0x7fda0c15b120 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda0bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46796/0 (socket says 172.21.15.152:46796) 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.975+0000 7fda0bfff640 1 -- 172.21.15.152:0/2800494694 learned_addr learned my addr 172.21.15.152:0/2800494694 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 -- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda0c15b120 msgr2=0x7fda0c1f7770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda0c15b120 0x7fda0c1f7770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 -- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda0c0cfca0 msgr2=0x7fda0c0b6440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0b6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 -- 172.21.15.152:0/2800494694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda0c15a690 con 0x7fda0c0cd410 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda0bfff640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c430 tx=0x7fd9fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc0074e0 con 0x7fda0c0cd410 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd9fc0047e0 con 0x7fda0c0cd410 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9fc004bd0 con 0x7fda0c0cd410 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda0c0c6730 con 0x7fda0c0cd410 2024-03-18T15:01:41.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.976+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda0c0c6cf0 con 0x7fda0c0cd410 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.977+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda0c04f540 con 0x7fda0c0cd410 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.977+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd9fc011070 con 0x7fda0c0cd410 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.978+0000 7fda08ff9640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 0x7fd9f806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.978+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7fd9fc08a3e0 con 0x7fda0c0cd410 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.978+0000 7fda0b7fe640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 0x7fd9f806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:41.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.978+0000 7fda0b7fe640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 0x7fd9f806e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0c4a60 tx=0x7fda000079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:41.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:41.982+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd9fc059220 con 0x7fda0c0cd410 2024-03-18T15:01:42.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.155+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fda0c153660 con 0x7fda0c0cd410 2024-03-18T15:01:42.156 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.155+0000 7fda08ff9640 1 -- 172.21.15.152:0/2800494694 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v31) ==== 93+0+10 (secure 0 0 0) 0x7fd9fc058b20 con 0x7fda0c0cd410 2024-03-18T15:01:42.157 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 msgr2=0x7fd9f806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 0x7fd9f806e090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fda0c0c4a60 tx=0x7fda000079b0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 msgr2=0x7fda0c1530c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fd9fc00c430 tx=0x7fd9fc00c8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 shutdown_connections 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd9f806bbd0 0x7fd9f806e090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fda0c15b120 0x7fda0c1f7770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fda0c0cfca0 0x7fda0c0b6440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 --2- 172.21.15.152:0/2800494694 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fda0c0cd410 0x7fda0c1530c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 >> 172.21.15.152:0/2800494694 conn(0x7fda0c0d0da0 msgr2=0x7fda0c0720f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:42.159 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 shutdown_connections 2024-03-18T15:01:42.160 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.157+0000 7fda1255b640 1 -- 172.21.15.152:0/2800494694 wait complete. 2024-03-18T15:01:42.170 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-03-18T15:01:42.270 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.269+0000 7efee543d640 1 Processor -- start 2024-03-18T15:01:42.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.269+0000 7efee543d640 1 -- start start 2024-03-18T15:01:42.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efee543d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efee00d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efee543d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00d1200 con 0x7efee00d2d50 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efee543d640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efee00d14e0 con 0x7efee015e5a0 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efee543d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efee00cff90 con 0x7efee00d1e40 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efede7fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7efee00d2d50 0x7efee00b3c40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:51990/0 (socket says 172.21.15.152:51990) 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efede7fc640 1 -- 172.21.15.152:0/51330421 learned_addr learned my addr 172.21.15.152:0/51330421 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.270+0000 7efedf7fe640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efee00d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 425874262 0 0) 0x7efee00d1200 con 0x7efee00d2d50 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efec8003520 con 0x7efee00d2d50 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3651677491 0 0) 0x7efec8003520 con 0x7efee00d2d50 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 msgr2=0x7efee00d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efee00d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 >> v1:172.21.15.186:6789/0 conn(0x7efee015e5a0 legacy=0x7efee00d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee00d17c0 con 0x7efee00d2d50 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7efed4001670 con 0x7efee00d2d50 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 >> v1:172.21.15.152:6789/0 conn(0x7efee00d2d50 legacy=0x7efee00b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efec8003a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efec8003fd0 0x7efec8004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec8004d40 0x7efec80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efec800bb80 con 0x7efec8004d40 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efec800bd30 con 0x7efec8003fd0 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efec800bf30 con 0x7efee00d1e40 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec8004d40 0x7efec80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedeffd640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efec8003a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efede7fc640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efec8003fd0 0x7efec8004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 -- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 msgr2=0x7efec8003a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efee00d1e40 0x7efec8003a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 -- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efec8003fd0 msgr2=0x7efec8004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efec8003fd0 0x7efec8004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efedf7fe640 1 -- 172.21.15.152:0/51330421 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efec8003520 con 0x7efec8004d40 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.271+0000 7efede7fc640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efec8003fd0 0x7efec8004800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.272+0000 7efedf7fe640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec8004d40 0x7efec80051c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efed8009a90 tx=0x7efec8005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f19a384dc23a84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.272+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8039070 con 0x7efec8004d40 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.272+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed802c680 con 0x7efec8004d40 2024-03-18T15:01:42.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.272+0000 7efeddffb640 1 -- 172.21.15.152:0/51330421 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8009690 con 0x7efec8004d40 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 -- 172.21.15.152:0/51330421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec8004d40 msgr2=0x7efec80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 --2- 172.21.15.152:0/51330421 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efec8004d40 0x7efec80051c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7efed8009a90 tx=0x7efec8005830 comp rx=0 tx=0).stop 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efedf7fe640 1 -- 172.21.15.152:0/51330421 reap_dead start 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 -- 172.21.15.152:0/51330421 shutdown_connections 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 -- 172.21.15.152:0/51330421 >> 172.21.15.152:0/51330421 conn(0x7efee00d4060 msgr2=0x7efee00d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 -- 172.21.15.152:0/51330421 shutdown_connections 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.273+0000 7efee543d640 1 -- 172.21.15.152:0/51330421 wait complete. 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.274+0000 7efee543d640 1 Processor -- start 2024-03-18T15:01:42.279 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.274+0000 7efee543d640 1 -- start start 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efec8004d40 0x7efee00b9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0156930 0x7efee01543b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7efee00d4f50 con 0x7efee01f7460 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7efee00d4dd0 con 0x7efee0156930 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efee543d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7efee00b34d0 con 0x7efec8004d40 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46800/0 (socket says 172.21.15.152:46800) 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 -- 172.21.15.152:0/3789191452 learned_addr learned my addr 172.21.15.152:0/3789191452 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedeffd640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efec8004d40 0x7efee00b9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efede7fc640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0156930 0x7efee01543b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 -- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efec8004d40 msgr2=0x7efee00b9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efec8004d40 0x7efee00b9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 -- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0156930 msgr2=0x7efee01543b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0156930 0x7efee01543b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 -- 172.21.15.152:0/3789191452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efee0156ed0 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.275+0000 7efedf7fe640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efed802c2f0 tx=0x7efed8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.276+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8039070 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.276+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efed8043070 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.276+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efee01571b0 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.276+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed8009690 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.276+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efee0157490 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.277+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efee00cbf50 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.277+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7efed8034ad0 con 0x7efee01f7460 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.278+0000 7efec77fe640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 0x7efecc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.278+0000 7efedeffd640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 0x7efecc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.278+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7efed80ab990 con 0x7efee01f7460 2024-03-18T15:01:42.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.278+0000 7efedeffd640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 0x7efecc06e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efed0001ee0 tx=0x7efed0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.282+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7efed804c020 con 0x7efee01f7460 2024-03-18T15:01:42.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.459+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efee004f5b0 con 0x7efee01f7460 2024-03-18T15:01:42.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.460+0000 7efec77fe640 1 -- 172.21.15.152:0/3789191452 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v31) ==== 84+0+65 (secure 0 0 0) 0x7efed807a180 con 0x7efee01f7460 2024-03-18T15:01:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:42.461 INFO:teuthology.orchestra.run.smithi152.stdout:[ 2024-03-18T15:01:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: { 2024-03-18T15:01:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: "poolnum": 1, 2024-03-18T15:01:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: "poolname": ".mgr" 2024-03-18T15:01:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: } 2024-03-18T15:01:42.462 INFO:teuthology.orchestra.run.smithi152.stdout:] 2024-03-18T15:01:42.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 msgr2=0x7efecc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 0x7efecc06e090 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7efed0001ee0 tx=0x7efed0009040 comp rx=0 tx=0).stop 2024-03-18T15:01:42.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 msgr2=0x7efee01f78e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7efed802c2f0 tx=0x7efed8004730 comp rx=0 tx=0).stop 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 shutdown_connections 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7efee01f7460 0x7efee01f78e0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7efee0156930 0x7efee01543b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7efecc06bbd0 0x7efecc06e090 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 --2- 172.21.15.152:0/3789191452 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7efec8004d40 0x7efee00b9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 >> 172.21.15.152:0/3789191452 conn(0x7efee00d4060 msgr2=0x7efee006d190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 shutdown_connections 2024-03-18T15:01:42.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.462+0000 7efee543d640 1 -- 172.21.15.152:0/3789191452 wait complete. 2024-03-18T15:01:42.474 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-03-18T15:01:42.474 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-03-18T15:01:42.567 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:01:42.570 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:01:42.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.578+0000 7f0df1634640 1 Processor -- start 2024-03-18T15:01:42.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.578+0000 7f0df1634640 1 -- start start 2024-03-18T15:01:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0df1634640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f0dec15b130 0x7f0dec06e300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0df1634640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec072320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0df1634640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0dec0cf2c0 con 0x7f0dec072cb0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0df1634640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f0dec073160 con 0x7f0dec15b130 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0df1634640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec0cf560 con 0x7f0dec071e90 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0dea7fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f0dec072cb0 0x7f0dec0d0600 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:51996/0 (socket says 172.21.15.152:51996) 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0dea7fc640 1 -- 172.21.15.152:0/3403427937 learned_addr learned my addr 172.21.15.152:0/3403427937 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0deaffd640 1 --2- 172.21.15.152:0/3403427937 >> v2:172.21.15.186:3300/0 conn(0x7f0dec15b130 0x7f0dec06e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.579+0000 7f0deb7fe640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec072320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3294498470 0 0) 0x7f0dec0cf2c0 con 0x7f0dec072cb0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0dd4003520 con 0x7f0dec072cb0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0deaffd640 1 -- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 msgr2=0x7f0dec072320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0deaffd640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec072320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0deaffd640 1 -- 172.21.15.152:0/3403427937 >> v1:172.21.15.152:6789/0 conn(0x7f0dec072cb0 legacy=0x7f0dec0d0600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3653775233 0 0) 0x7f0dd4003520 con 0x7f0dec072cb0 2024-03-18T15:01:42.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0deaffd640 1 -- 172.21.15.152:0/3403427937 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec0cf840 con 0x7f0dec15b130 2024-03-18T15:01:42.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.580+0000 7f0deb7fe640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.581+0000 7f0deaffd640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec06e300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097a0 tx=0x7f0ddc02b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5d3e8f4af76a32ec server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.581+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ddc037070 con 0x7f0dec15b130 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.581+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ddc030510 con 0x7f0dec15b130 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.581+0000 7f0de9ffb640 1 -- 172.21.15.152:0/3403427937 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0001670 con 0x7f0dec15b130 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 -- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 msgr2=0x7f0dec06e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec06e300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc0097a0 tx=0x7f0ddc02b790 comp rx=0 tx=0).stop 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 -- 172.21.15.152:0/3403427937 shutdown_connections 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec072320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 --2- 172.21.15.152:0/3403427937 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec06e300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 -- 172.21.15.152:0/3403427937 >> 172.21.15.152:0/3403427937 conn(0x7f0dec0d0da0 msgr2=0x7f0dec0d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 -- 172.21.15.152:0/3403427937 shutdown_connections 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.582+0000 7f0df1634640 1 -- 172.21.15.152:0/3403427937 wait complete. 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.583+0000 7f0df1634640 1 Processor -- start 2024-03-18T15:01:42.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.583+0000 7f0df1634640 1 -- start start 2024-03-18T15:01:42.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec0cc280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0d00e0 con 0x7f0dec072cb0 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f0dec0cfe00 con 0x7f0dec15b130 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0df1634640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f0dec15b510 con 0x7f0dec071e90 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46806/0 (socket says 172.21.15.152:46806) 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 -- 172.21.15.152:0/1894168546 learned_addr learned my addr 172.21.15.152:0/1894168546 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0deaffd640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0deb7fe640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec0cc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 -- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 msgr2=0x7f0dec1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec1493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 -- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 msgr2=0x7f0dec0cc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec0cc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:42.588 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 -- 172.21.15.152:0/1894168546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dec14c3f0 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.584+0000 7f0dea7fc640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0de00017e0 tx=0x7f0de000cb20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.585+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de000ce60 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.585+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0de0005af0 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.585+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dec14c6d0 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.585+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0de0007070 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.585+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dec0b5b20 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.586+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dec04f540 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.586+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f0de0007210 con 0x7f0dec072cb0 2024-03-18T15:01:42.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.586+0000 7f0dd37fe640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 0x7f0dd806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.587+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4857+0+0 (secure 0 0 0) 0x7f0de008a310 con 0x7f0dec072cb0 2024-03-18T15:01:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.587+0000 7f0deaffd640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 0x7f0dd806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:42.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.587+0000 7f0deaffd640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 0x7f0dd806e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc034000 tx=0x7f0ddc02f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:42.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.593+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f0de00591e0 con 0x7f0dec072cb0 2024-03-18T15:01:42.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:42.769+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f0dec0b1d60 con 0x7f0dec072cb0 2024-03-18T15:01:43.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.556+0000 7f0dd37fe640 1 -- 172.21.15.152:0/1894168546 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v32) ==== 138+0+0 (secure 0 0 0) 0x7f0de0058ae0 con 0x7f0dec072cb0 2024-03-18T15:01:43.558 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' created 2024-03-18T15:01:43.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 msgr2=0x7f0dd806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 0x7f0dd806e090 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f0ddc034000 tx=0x7f0ddc02f000 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 msgr2=0x7f0dec14bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f0de00017e0 tx=0x7f0de000cb20 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 shutdown_connections 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f0dec15b130 0x7f0dec0cc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f0dec072cb0 0x7f0dec14bb60 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f0dd806bbd0 0x7f0dd806e090 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 --2- 172.21.15.152:0/1894168546 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f0dec071e90 0x7f0dec1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 >> 172.21.15.152:0/1894168546 conn(0x7f0dec0d0da0 msgr2=0x7f0dec15df80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 shutdown_connections 2024-03-18T15:01:43.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.559+0000 7f0df1634640 1 -- 172.21.15.152:0/1894168546 wait complete. 2024-03-18T15:01:43.575 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-03-18T15:01:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.685+0000 7f4b83d0c640 1 Processor -- start 2024-03-18T15:01:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.685+0000 7f4b83d0c640 1 -- start start 2024-03-18T15:01:43.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.686+0000 7f4b83d0c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.686+0000 7f4b83d0c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.686+0000 7f4b83d0c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b7c15aa30 con 0x7f4b7c0ca940 2024-03-18T15:01:43.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.686+0000 7f4b83d0c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4b7c06e7a0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.686+0000 7f4b83d0c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c06e190 con 0x7f4b7c0ce100 2024-03-18T15:01:43.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b81aa8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b81aa8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:40736/0 (socket says 172.21.15.152:40736) 2024-03-18T15:01:43.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:58204/0 (socket says 172.21.15.152:58204) 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b822a9640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f4b7c0ca940 0x7f4b7c0cad90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:39504/0 (socket says 172.21.15.152:39504) 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b81aa8640 1 -- 172.21.15.152:0/1489061643 learned_addr learned my addr 172.21.15.152:0/1489061643 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 -- 172.21.15.152:0/1489061643 >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 msgr2=0x7f4b7c06ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 --2- 172.21.15.152:0/1489061643 >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 -- 172.21.15.152:0/1489061643 >> v1:172.21.15.186:6789/0 conn(0x7f4b7c0ca940 legacy=0x7f4b7c0cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b812a7640 1 -- 172.21.15.152:0/1489061643 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c0ce6c0 con 0x7f4b7c0ce100 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b80aa6640 1 -- 172.21.15.152:0/1489061643 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1750673594 0 0) 0x7f4b74001110 con 0x7f4b7c0ca940 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.687+0000 7f4b81aa8640 1 --2- 172.21.15.152:0/1489061643 >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.688+0000 7f4b812a7640 1 --2- 172.21.15.152:0/1489061643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0097a0 tx=0x7f4b6c02b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=42b3e5f456ad9f8c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.688+0000 7f4b80aa6640 1 -- 172.21.15.152:0/1489061643 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c031780 con 0x7f4b7c0ce100 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.688+0000 7f4b80aa6640 1 -- 172.21.15.152:0/1489061643 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c037070 con 0x7f4b7c0ce100 2024-03-18T15:01:43.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.688+0000 7f4b80aa6640 1 -- 172.21.15.152:0/1489061643 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c031b40 con 0x7f4b7c0ce100 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 -- 172.21.15.152:0/1489061643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 msgr2=0x7f4b7c06cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/1489061643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0097a0 tx=0x7f4b6c02b820 comp rx=0 tx=0).stop 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 -- 172.21.15.152:0/1489061643 shutdown_connections 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/1489061643 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c06cdc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/1489061643 >> v2:172.21.15.186:3300/0 conn(0x7f4b7c0cd7c0 0x7f4b7c06ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 -- 172.21.15.152:0/1489061643 >> 172.21.15.152:0/1489061643 conn(0x7f4b7c0cfbf0 msgr2=0x7f4b7c0cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:43.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 -- 172.21.15.152:0/1489061643 shutdown_connections 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.689+0000 7f4b83d0c640 1 -- 172.21.15.152:0/1489061643 wait complete. 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.690+0000 7f4b83d0c640 1 Processor -- start 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.690+0000 7f4b83d0c640 1 -- start start 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b7c0ca940 0x7f4b7c14f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0ce9a0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4b7c0cb4a0 con 0x7f4b7c0ca940 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4b7c0cc260 con 0x7f4b7c0ce100 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46820/0 (socket says 172.21.15.152:46820) 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 -- 172.21.15.152:0/4281327805 learned_addr learned my addr 172.21.15.152:0/4281327805 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:43.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b822a9640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b81aa8640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b7c0ca940 0x7f4b7c14f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 -- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 msgr2=0x7f4b7c159280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c159280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 -- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b7c0ca940 msgr2=0x7f4b7c14f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b7c0ca940 0x7f4b7c14f710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 -- 172.21.15.152:0/4281327805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b7c1f1ea0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b812a7640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0097a0 tx=0x7f4b6c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c004230 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4b6c031ec0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b7c0b38b0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c003610 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.691+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b7c0b3e70 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.693+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b7c1f2070 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.693+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4b6c0037b0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.693+0000 7f4b727fc640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.693+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5227+0+0 (secure 0 0 0) 0x7f4b6c0ac5b0 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.693+0000 7f4b81aa8640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:43.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.694+0000 7f4b81aa8640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 0x7f4b6006e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b780072c0 tx=0x7f4b7800b040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:43.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.698+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4b6c041070 con 0x7f4b7c0cd7c0 2024-03-18T15:01:43.873 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:43.872+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4b7c04f540 con 0x7f4b7c0cd7c0 2024-03-18T15:01:44.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.562+0000 7f4b727fc640 1 -- 172.21.15.152:0/4281327805 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v33) ==== 170+0+0 (secure 0 0 0) 0x7f4b6c02f050 con 0x7f4b7c0cd7c0 2024-03-18T15:01:44.563 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' created 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 msgr2=0x7f4b6006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 0x7f4b6006e090 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4b780072c0 tx=0x7f4b7800b040 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 msgr2=0x7f4b7c158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0097a0 tx=0x7f4b6c0046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 shutdown_connections 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4b6006bbd0 0x7f4b6006e090 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4b7c0ce100 0x7f4b7c159280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4b7c0cd7c0 0x7f4b7c158d40 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 --2- 172.21.15.152:0/4281327805 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4b7c0ca940 0x7f4b7c14f710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 >> 172.21.15.152:0/4281327805 conn(0x7f4b7c0cfbf0 msgr2=0x7f4b7c159e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:44.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 shutdown_connections 2024-03-18T15:01:44.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.565+0000 7f4b83d0c640 1 -- 172.21.15.152:0/4281327805 wait complete. 2024-03-18T15:01:44.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-03-18T15:01:44.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.694+0000 7f76e7722640 1 Processor -- start 2024-03-18T15:01:44.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.694+0000 7f76e7722640 1 -- start start 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e7722640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76e006c570 0x7f76e006ea80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e7722640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f76e006b930 0x7f76e006bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e7722640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76e006d700 con 0x7f76e00716a0 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e7722640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f76e006efc0 con 0x7f76e006b930 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e7722640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f76e006b1c0 con 0x7f76e006c570 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e5cbf640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f76e006b930 0x7f76e006bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e5cbf640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f76e006b930 0x7f76e006bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46822/0 (socket says 172.21.15.152:46822) 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.695+0000 7f76e5cbf640 1 -- 172.21.15.152:0/2435171202 learned_addr learned my addr 172.21.15.152:0/2435171202 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:44.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e4cbd640 1 --2- 172.21.15.152:0/2435171202 >> v2:172.21.15.186:3300/0 conn(0x7f76e006c570 0x7f76e006ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e5cbf640 1 -- 172.21.15.152:0/2435171202 >> v2:172.21.15.186:3300/0 conn(0x7f76e006c570 msgr2=0x7f76e006ea80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:44.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e5cbf640 1 --2- 172.21.15.152:0/2435171202 >> v2:172.21.15.186:3300/0 conn(0x7f76e006c570 0x7f76e006ea80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e5cbf640 1 -- 172.21.15.152:0/2435171202 >> v1:172.21.15.186:6789/0 conn(0x7f76e00716a0 legacy=0x7f76e0071a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e5cbf640 1 -- 172.21.15.152:0/2435171202 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e006d9e0 con 0x7f76e006b930 2024-03-18T15:01:44.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76e5cbf640 1 --2- 172.21.15.152:0/2435171202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e006b930 0x7f76e006bdc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f76e006ccc0 tx=0x7f76d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa3748251de9de23 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:44.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.696+0000 7f76d7fff640 1 -- 172.21.15.152:0/2435171202 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8034070 con 0x7f76e006b930 2024-03-18T15:01:44.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76d7fff640 1 -- 172.21.15.152:0/2435171202 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8030860 con 0x7f76e006b930 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76d7fff640 1 -- 172.21.15.152:0/2435171202 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8030c30 con 0x7f76e006b930 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 -- 172.21.15.152:0/2435171202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e006b930 msgr2=0x7f76e006bdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 --2- 172.21.15.152:0/2435171202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e006b930 0x7f76e006bdc0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f76e006ccc0 tx=0x7f76d802b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 -- 172.21.15.152:0/2435171202 shutdown_connections 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 --2- 172.21.15.152:0/2435171202 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e006b930 0x7f76e006bdc0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 --2- 172.21.15.152:0/2435171202 >> v2:172.21.15.186:3300/0 conn(0x7f76e006c570 0x7f76e006ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 -- 172.21.15.152:0/2435171202 >> 172.21.15.152:0/2435171202 conn(0x7f76e00cd040 msgr2=0x7f76e00cd450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 -- 172.21.15.152:0/2435171202 shutdown_connections 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.697+0000 7f76e7722640 1 -- 172.21.15.152:0/2435171202 wait complete. 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.698+0000 7f76e7722640 1 Processor -- start 2024-03-18T15:01:44.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.698+0000 7f76e7722640 1 -- start start 2024-03-18T15:01:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76e006b930 0x7f76e01500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76e006c570 0x7f76e01f7b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76e00cef60 con 0x7f76e00716a0 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f76e006b4a0 con 0x7f76e006b930 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e7722640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76e00cf0e0 con 0x7f76e006c570 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46838/0 (socket says 172.21.15.152:46838) 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 -- 172.21.15.152:0/902931783 learned_addr learned my addr 172.21.15.152:0/902931783 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e54be640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76e006b930 0x7f76e01500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e4cbd640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76e006c570 0x7f76e01f7b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 -- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76e006c570 msgr2=0x7f76e01f7b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76e006c570 0x7f76e01f7b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 -- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76e006b930 msgr2=0x7f76e01500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76e006b930 0x7f76e01500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:44.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.699+0000 7f76e5cbf640 1 -- 172.21.15.152:0/902931783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e015aa20 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76e5cbf640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f76d802b9e0 tx=0x7f76d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8048070 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76d8030660 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e0150600 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8034040 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.700+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e01f8800 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.701+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e004f540 con 0x7f76e00716a0 2024-03-18T15:01:44.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.701+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f76d804b070 con 0x7f76e00716a0 2024-03-18T15:01:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.702+0000 7f76d5ffb640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 0x7f76c406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.702+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5609+0+0 (secure 0 0 0) 0x7f76d80ac970 con 0x7f76e00716a0 2024-03-18T15:01:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.702+0000 7f76e54be640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 0x7f76c406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:44.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.702+0000 7f76e54be640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 0x7f76c406e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001e70 tx=0x7f76dc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:44.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.706+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f76d8030830 con 0x7f76e00716a0 2024-03-18T15:01:44.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:44.917+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f76e01f8a40 con 0x7f76e00716a0 2024-03-18T15:01:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.563+0000 7f76d5ffb640 1 -- 172.21.15.152:0/902931783 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v11) ==== 172+0+0 (secure 0 0 0) 0x7f76d807afc0 con 0x7f76e00716a0 2024-03-18T15:01:45.565 INFO:teuthology.orchestra.run.smithi152.stderr:new fs with metadata pool 4 and data pool 5 2024-03-18T15:01:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.569+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 msgr2=0x7f76c406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.569+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 0x7f76c406e0c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76dc001e70 tx=0x7f76dc009040 comp rx=0 tx=0).stop 2024-03-18T15:01:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.569+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 msgr2=0x7f76e006e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.569+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f76d802b9e0 tx=0x7f76d8004730 comp rx=0 tx=0).stop 2024-03-18T15:01:45.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 shutdown_connections 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76e00716a0 0x7f76e006e110 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76c406bc00 0x7f76c406e0c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76e006c570 0x7f76e01f7b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 --2- 172.21.15.152:0/902931783 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76e006b930 0x7f76e01500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 >> 172.21.15.152:0/902931783 conn(0x7f76e00cd040 msgr2=0x7f76e0071a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.570+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 shutdown_connections 2024-03-18T15:01:45.572 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.571+0000 7f76e7722640 1 -- 172.21.15.152:0/902931783 wait complete. 2024-03-18T15:01:45.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.702+0000 7fbc5679f640 1 Processor -- start 2024-03-18T15:01:45.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.702+0000 7fbc5679f640 1 -- start start 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc5679f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006f940 0x7fbc500b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc5679f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc5006b9d0 0x7fbc5006ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc5679f640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc5006c060 con 0x7fbc500b4150 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc5679f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbc500b45b0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc5679f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbc50161d10 con 0x7fbc5006f940 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc55f9e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbc5006b9d0 0x7fbc5006ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc54f9c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fbc500b4150 0x7fbc5006b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:51998/0 (socket says 172.21.15.152:51998) 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc54f9c640 1 -- 172.21.15.152:0/484643793 learned_addr learned my addr 172.21.15.152:0/484643793 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:45.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.703+0000 7fbc55f9e640 1 --2- 172.21.15.152:0/484643793 >> v2:172.21.15.152:3300/0 conn(0x7fbc5006b9d0 0x7fbc5006ddc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46848/0 (socket says 172.21.15.152:46848) 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc5579d640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006f940 0x7fbc500b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc55f9e640 1 -- 172.21.15.152:0/484643793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006f940 msgr2=0x7fbc500b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc55f9e640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006f940 0x7fbc500b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc55f9e640 1 -- 172.21.15.152:0/484643793 >> v1:172.21.15.152:6789/0 conn(0x7fbc500b4150 legacy=0x7fbc5006b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc55f9e640 1 -- 172.21.15.152:0/484643793 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc50161ff0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc47fff640 1 -- 172.21.15.152:0/484643793 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3887372749 0 0) 0x7fbc5006c060 con 0x7fbc500b4150 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.704+0000 7fbc55f9e640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc5006ddc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097a0 tx=0x7fbc4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d33755a0ded38caf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc47fff640 1 -- 172.21.15.152:0/484643793 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48035020 con 0x7fbc5006b9d0 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc47fff640 1 -- 172.21.15.152:0/484643793 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc48031830 con 0x7fbc5006b9d0 2024-03-18T15:01:45.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc47fff640 1 -- 172.21.15.152:0/484643793 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc48031c00 con 0x7fbc5006b9d0 2024-03-18T15:01:45.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 -- 172.21.15.152:0/484643793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 msgr2=0x7fbc5006ddc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc5006ddc0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbc480097a0 tx=0x7fbc4802b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 -- 172.21.15.152:0/484643793 shutdown_connections 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc5006ddc0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 --2- 172.21.15.152:0/484643793 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc5006f940 0x7fbc500b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 -- 172.21.15.152:0/484643793 >> 172.21.15.152:0/484643793 conn(0x7fbc500b2910 msgr2=0x7fbc500b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 -- 172.21.15.152:0/484643793 shutdown_connections 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.705+0000 7fbc5679f640 1 -- 172.21.15.152:0/484643793 wait complete. 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.706+0000 7fbc5679f640 1 Processor -- start 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.706+0000 7fbc5679f640 1 -- start start 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 0x7fbc500ae080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 0x7fbc500ae5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbc50162ad0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbc501625b0 con 0x7fbc5006f940 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5679f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbc5006e300 con 0x7fbc500b4150 2024-03-18T15:01:45.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5579d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5579d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46854/0 (socket says 172.21.15.152:46854) 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc5579d640 1 -- 172.21.15.152:0/1773727134 learned_addr learned my addr 172.21.15.152:0/1773727134 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc54f9c640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 0x7fbc500ae080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.707+0000 7fbc55f9e640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 0x7fbc500ae5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 -- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 msgr2=0x7fbc500ae5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 0x7fbc500ae5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 -- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 msgr2=0x7fbc500ae080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 0x7fbc500ae080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 -- 172.21.15.152:0/1773727134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc500c9db0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc55f9e640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 0x7fbc500ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc54f9c640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 0x7fbc500ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5579d640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00ce10 tx=0x7fbc4c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c003b90 con 0x7fbc5006b9d0 2024-03-18T15:01:45.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc4c003d30 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc500cf4e0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc4c004240 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.708+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc500cfaa0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.709+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc5004f540 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.709+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fbc4c0043e0 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.710+0000 7fbc45ffb640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 0x7fbc3406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.710+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fbc4c08b560 con 0x7fbc5006b9d0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.710+0000 7fbc54f9c640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 0x7fbc3406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:45.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.710+0000 7fbc54f9c640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 0x7fbc3406e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007fd0 tx=0x7fbc40007dc0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:45.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.715+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fbc4c01d340 con 0x7fbc5006b9d0 2024-03-18T15:01:45.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.889+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbc50074d40 con 0x7fbc5006b9d0 2024-03-18T15:01:45.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.890+0000 7fbc45ffb640 1 -- 172.21.15.152:0/1773727134 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16730 (secure 0 0 0) 0x7fbc4c05a050 con 0x7fbc5006b9d0 2024-03-18T15:01:45.891 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:45.892 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":34,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:44.919529+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:45.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 msgr2=0x7fbc3406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 0x7fbc3406e090 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fbc40007fd0 tx=0x7fbc40007dc0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 msgr2=0x7fbc501613d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fbc4c00ce10 tx=0x7fbc4c00a660 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 shutdown_connections 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbc3406bbd0 0x7fbc3406e090 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbc500b4150 0x7fbc500ae5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbc5006f940 0x7fbc500ae080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 --2- 172.21.15.152:0/1773727134 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbc5006b9d0 0x7fbc501613d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 >> 172.21.15.152:0/1773727134 conn(0x7fbc500b2910 msgr2=0x7fbc50071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 shutdown_connections 2024-03-18T15:01:45.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:45.892+0000 7fbc5679f640 1 -- 172.21.15.152:0/1773727134 wait complete. 2024-03-18T15:01:45.905 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.004+0000 7f9bc9a8c640 1 Processor -- start 2024-03-18T15:01:46.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.004+0000 7f9bc9a8c640 1 -- start start 2024-03-18T15:01:46.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.004+0000 7f9bc9a8c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc9a8c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9bc4162690 0x7f9bc4162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc9a8c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9bc40b3440 con 0x7f9bc40cec80 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc9a8c640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f9bc40d16c0 con 0x7f9bc4162690 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc9a8c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc40d2660 con 0x7f9bc41622b0 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc2ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9bc4162690 0x7f9bc4162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc37fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:58248/0 (socket says 172.21.15.152:58248) 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc3fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9bc40cec80 0x7f9bc40cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:39530/0 (socket says 172.21.15.152:39530) 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc37fe640 1 -- 172.21.15.152:0/513433527 learned_addr learned my addr 172.21.15.152:0/513433527 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 msgr2=0x7f9bc40d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc2ffd640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/513433527 >> v1:172.21.15.186:6789/0 conn(0x7f9bc40cec80 legacy=0x7f9bc40cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/513433527 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc40d20a0 con 0x7f9bc4162690 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc27fc640 1 -- 172.21.15.152:0/513433527 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1440065238 0 0) 0x7f9bc40b3440 con 0x7f9bc40cec80 2024-03-18T15:01:46.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.005+0000 7f9bc37fe640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.006+0000 7f9bc2ffd640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc4162690 0x7f9bc4162af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097a0 tx=0x7f9bb802b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61eb71c7c94cbab server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.006+0000 7f9bc27fc640 1 -- 172.21.15.152:0/513433527 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8038070 con 0x7f9bc4162690 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.006+0000 7f9bc27fc640 1 -- 172.21.15.152:0/513433527 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8031700 con 0x7f9bc4162690 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.006+0000 7f9bc27fc640 1 -- 172.21.15.152:0/513433527 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8031ad0 con 0x7f9bc4162690 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc4162690 msgr2=0x7f9bc4162af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.009 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc4162690 0x7f9bc4162af0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f9bb80097a0 tx=0x7f9bb802b7a0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/513433527 shutdown_connections 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc4162690 0x7f9bc4162af0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/513433527 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc41622b0 0x7f9bc40d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/513433527 >> 172.21.15.152:0/513433527 conn(0x7f9bc40d4070 msgr2=0x7f9bc40d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/513433527 shutdown_connections 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.007+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/513433527 wait complete. 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.008+0000 7f9bc9a8c640 1 Processor -- start 2024-03-18T15:01:46.010 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.008+0000 7f9bc9a8c640 1 -- start start 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc40cec80 0x7f9bc41f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc4162690 0x7f9bc40b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc415faa0 con 0x7f9bc41622b0 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9bc40d2ab0 con 0x7f9bc40cec80 2024-03-18T15:01:46.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc9a8c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9bc415fc20 con 0x7f9bc4162690 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46864/0 (socket says 172.21.15.152:46864) 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/1705358415 learned_addr learned my addr 172.21.15.152:0/1705358415 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc37fe640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc40cec80 0x7f9bc41f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc3fff640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc4162690 0x7f9bc40b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc4162690 msgr2=0x7f9bc40b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc4162690 0x7f9bc40b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc40cec80 msgr2=0x7f9bc41f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc40cec80 0x7f9bc41f4cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 -- 172.21.15.152:0/1705358415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9bc415bf80 con 0x7f9bc41622b0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.009+0000 7f9bc2ffd640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.010+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb8038040 con 0x7f9bc41622b0 2024-03-18T15:01:46.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.010+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9bb8004250 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.010+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9bc415c260 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.010+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9bb803e650 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.010+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9bc415c820 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.011+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9bc404f5b0 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.011+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9bb803e7f0 con 0x7f9bc41622b0 2024-03-18T15:01:46.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.012+0000 7f9babfff640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 0x7f9bb006e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.012+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9bb80ac660 con 0x7f9bc41622b0 2024-03-18T15:01:46.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.012+0000 7f9bc37fe640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 0x7f9bb006e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.012+0000 7f9bc37fe640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 0x7f9bb006e0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009630 tx=0x7f9bb4009240 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.016+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9bb8043020 con 0x7f9bc41622b0 2024-03-18T15:01:46.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.191+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9bc40d18d0 con 0x7f9bc41622b0 2024-03-18T15:01:46.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.192+0000 7f9babfff640 1 -- 172.21.15.152:0/1705358415 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16730 (secure 0 0 0) 0x7f9bb8030070 con 0x7f9bc41622b0 2024-03-18T15:01:46.193 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:46.194 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":34,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:44.919529+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:46.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 msgr2=0x7f9bb006e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 0x7f9bb006e0c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9bb4009630 tx=0x7f9bb4009240 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 msgr2=0x7f9bc415b730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f9bb8000c00 tx=0x7f9bb80046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 shutdown_connections 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9bb006bc00 0x7f9bb006e0c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9bc4162690 0x7f9bc40b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9bc41622b0 0x7f9bc415b730 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 --2- 172.21.15.152:0/1705358415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9bc40cec80 0x7f9bc41f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 >> 172.21.15.152:0/1705358415 conn(0x7f9bc40d4070 msgr2=0x7f9bc406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 shutdown_connections 2024-03-18T15:01:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.195+0000 7f9bc9a8c640 1 -- 172.21.15.152:0/1705358415 wait complete. 2024-03-18T15:01:46.207 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-03-18T15:01:46.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.309+0000 7f913935b640 1 Processor -- start 2024-03-18T15:01:46.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.309+0000 7f913935b640 1 -- start start 2024-03-18T15:01:46.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f913935b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9134161ac0 0x7f91340b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f913935b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f91340cfcb0 0x7f91340d0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f913935b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9134161ea0 con 0x7f91340d0a40 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f913935b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f91340d4bb0 con 0x7f91340cfcb0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f913935b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f91340d4e90 con 0x7f9134161ac0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f91340cfcb0 0x7f91340d0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f912a7fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f91340d0a40 0x7f91340d1c60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52010/0 (socket says 172.21.15.152:52010) 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f912a7fc640 1 -- 172.21.15.152:0/3423931254 learned_addr learned my addr 172.21.15.152:0/3423931254 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f9132ffd640 1 --2- 172.21.15.152:0/3423931254 >> v2:172.21.15.186:3300/0 conn(0x7f9134161ac0 0x7f91340b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 -- 172.21.15.152:0/3423931254 >> v2:172.21.15.186:3300/0 conn(0x7f9134161ac0 msgr2=0x7f91340b4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 --2- 172.21.15.152:0/3423931254 >> v2:172.21.15.186:3300/0 conn(0x7f9134161ac0 0x7f91340b4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 -- 172.21.15.152:0/3423931254 >> v1:172.21.15.152:6789/0 conn(0x7f91340d0a40 legacy=0x7f91340d1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 -- 172.21.15.152:0/3423931254 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91340b4390 con 0x7f91340cfcb0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91327fc640 1 -- 172.21.15.152:0/3423931254 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4047077792 0 0) 0x7f9134161ea0 con 0x7f91340d0a40 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91337fe640 1 --2- 172.21.15.152:0/3423931254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91340cfcb0 0x7f91340d0ef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f912c009d90 tx=0x7f912c02be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9daacda1fad9916 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91327fc640 1 -- 172.21.15.152:0/3423931254 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c039070 con 0x7f91340cfcb0 2024-03-18T15:01:46.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91327fc640 1 -- 172.21.15.152:0/3423931254 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c02cbd0 con 0x7f91340cfcb0 2024-03-18T15:01:46.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.311+0000 7f91327fc640 1 -- 172.21.15.152:0/3423931254 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c034440 con 0x7f91340cfcb0 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 -- 172.21.15.152:0/3423931254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91340cfcb0 msgr2=0x7f91340d0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 --2- 172.21.15.152:0/3423931254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91340cfcb0 0x7f91340d0ef0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f912c009d90 tx=0x7f912c02be20 comp rx=0 tx=0).stop 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 -- 172.21.15.152:0/3423931254 shutdown_connections 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 --2- 172.21.15.152:0/3423931254 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f91340cfcb0 0x7f91340d0ef0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 --2- 172.21.15.152:0/3423931254 >> v2:172.21.15.186:3300/0 conn(0x7f9134161ac0 0x7f91340b4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 -- 172.21.15.152:0/3423931254 >> 172.21.15.152:0/3423931254 conn(0x7f91340d4090 msgr2=0x7f91340d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 -- 172.21.15.152:0/3423931254 shutdown_connections 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.312+0000 7f913935b640 1 -- 172.21.15.152:0/3423931254 wait complete. 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.313+0000 7f913935b640 1 Processor -- start 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.313+0000 7f913935b640 1 -- start start 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 0x7f913415ed20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91340d0a40 0x7f913406cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f91340b55a0 con 0x7f9134161ac0 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f91340b4950 con 0x7f91340cfcb0 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f913935b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f91340b5720 con 0x7f91340d0a40 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46880/0 (socket says 172.21.15.152:46880) 2024-03-18T15:01:46.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 -- 172.21.15.152:0/39157899 learned_addr learned my addr 172.21.15.152:0/39157899 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f9132ffd640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 0x7f913415ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f912a7fc640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91340d0a40 0x7f913406cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 -- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91340d0a40 msgr2=0x7f913406cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91340d0a40 0x7f913406cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 -- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 msgr2=0x7f913415ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 0x7f913415ed20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 -- 172.21.15.152:0/39157899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f913415e8f0 con 0x7f9134161ac0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f9132ffd640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 0x7f913415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.314+0000 7f91337fe640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f912c009d90 tx=0x7f912c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.315+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c039050 con 0x7f9134161ac0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.315+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f912c045070 con 0x7f9134161ac0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.315+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91340c8db0 con 0x7f9134161ac0 2024-03-18T15:01:46.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.315+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c03e830 con 0x7f9134161ac0 2024-03-18T15:01:46.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.315+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91340c9370 con 0x7f9134161ac0 2024-03-18T15:01:46.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.316+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91340b6bd0 con 0x7f9134161ac0 2024-03-18T15:01:46.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.316+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f912c03e9d0 con 0x7f9134161ac0 2024-03-18T15:01:46.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.316+0000 7f912bfff640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 0x7f911406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.316+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f912c0ad820 con 0x7f9134161ac0 2024-03-18T15:01:46.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.316+0000 7f9132ffd640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 0x7f911406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.317+0000 7f9132ffd640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 0x7f911406e090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9124006fd0 tx=0x7f9124008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.322 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.322+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f912c032e20 con 0x7f9134161ac0 2024-03-18T15:01:46.531 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.530+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f9134161170 con 0x7f9134161ac0 2024-03-18T15:01:46.578 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.577+0000 7f912bfff640 1 -- 172.21.15.152:0/39157899 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) ==== 118+0+0 (secure 0 0 0) 0x7f912c07c310 con 0x7f9134161ac0 2024-03-18T15:01:46.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.579+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 msgr2=0x7f911406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.579+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 0x7f911406e090 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9124006fd0 tx=0x7f9124008040 comp rx=0 tx=0).stop 2024-03-18T15:01:46.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.579+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 msgr2=0x7f913415b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.579+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f912c009d90 tx=0x7f912c004a40 comp rx=0 tx=0).stop 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 shutdown_connections 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9134161ac0 0x7f913415b6c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f911406bbd0 0x7f911406e090 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f91340d0a40 0x7f913406cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 --2- 172.21.15.152:0/39157899 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f91340cfcb0 0x7f913415ed20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 >> 172.21.15.152:0/39157899 conn(0x7f91340d4090 msgr2=0x7f91340d0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 shutdown_connections 2024-03-18T15:01:46.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.580+0000 7f913935b640 1 -- 172.21.15.152:0/39157899 wait complete. 2024-03-18T15:01:46.596 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-03-18T15:01:46.596 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-03-18T15:01:46.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.699+0000 7f6d19044640 1 Processor -- start 2024-03-18T15:01:46.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.699+0000 7f6d19044640 1 -- start start 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d19044640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6d140ceee0 0x7f6d1406cac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d19044640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d140cd090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d19044640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d140cf2c0 con 0x7f6d1406d000 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d19044640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6d14161c70 con 0x7f6d140ceee0 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d19044640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140d1590 con 0x7f6d140d0c50 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d0bfff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6d1406d000 0x7f6d140d0540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52016/0 (socket says 172.21.15.152:52016) 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d0bfff640 1 -- 172.21.15.152:0/2462789374 learned_addr learned my addr 172.21.15.152:0/2462789374 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d12d9d640 1 --2- 172.21.15.152:0/2462789374 >> v2:172.21.15.186:3300/0 conn(0x7f6d140ceee0 0x7f6d1406cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3879749493 0 0) 0x7f6d140cf2c0 con 0x7f6d1406d000 2024-03-18T15:01:46.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1359e640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d140cd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00003520 con 0x7f6d1406d000 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 538864933 0 0) 0x7f6d00003520 con 0x7f6d1406d000 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 msgr2=0x7f6d140cd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d140cd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 >> v2:172.21.15.186:3300/0 conn(0x7f6d140ceee0 msgr2=0x7f6d1406cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 --2- 172.21.15.152:0/2462789374 >> v2:172.21.15.186:3300/0 conn(0x7f6d140ceee0 0x7f6d1406cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d1406d440 con 0x7f6d1406d000 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f6cfc001670 con 0x7f6d1406d000 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 >> v1:172.21.15.152:6789/0 conn(0x7f6d1406d000 legacy=0x7f6d140d0540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d000039b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d00003f30 0x7f6d00004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00004d40 0x7f6d000051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.700+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d14161c70 con 0x7f6d00003f30 2024-03-18T15:01:46.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140d1590 con 0x7f6d00004d40 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6d0000ba10 con 0x7f6d140d0c50 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d00003f30 0x7f6d00004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d12d9d640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d000039b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d1359e640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00004d40 0x7f6d000051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 -- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 msgr2=0x7f6d000039b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d140d0c50 0x7f6d000039b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 -- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00004d40 msgr2=0x7f6d000051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00004d40 0x7f6d000051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.701+0000 7f6d0bfff640 1 -- 172.21.15.152:0/2462789374 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d00003520 con 0x7f6d00003f30 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d00003f30 0x7f6d00004800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00c210 tx=0x7f6d00005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ca95e0fb4182226 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc007d70 con 0x7f6d00003f30 2024-03-18T15:01:46.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cfc030070 con 0x7f6d00003f30 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d1259c640 1 -- 172.21.15.152:0/2462789374 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cfc02cd60 con 0x7f6d00003f30 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 -- 172.21.15.152:0/2462789374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d00003f30 msgr2=0x7f6d00004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 --2- 172.21.15.152:0/2462789374 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d00003f30 0x7f6d00004800 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6cfc00c210 tx=0x7f6d00005830 comp rx=0 tx=0).stop 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d1359e640 1 -- 172.21.15.152:0/2462789374 reap_dead start 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 -- 172.21.15.152:0/2462789374 shutdown_connections 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 -- 172.21.15.152:0/2462789374 >> 172.21.15.152:0/2462789374 conn(0x7f6d1409b160 msgr2=0x7f6d140d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 -- 172.21.15.152:0/2462789374 shutdown_connections 2024-03-18T15:01:46.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.702+0000 7f6d19044640 1 -- 172.21.15.152:0/2462789374 wait complete. 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 Processor -- start 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 -- start start 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00003f30 0x7f6d141531b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 0x7f6d140b4d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140cc5b0 con 0x7f6d1409e3b0 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6d140ccc00 con 0x7f6d00003f30 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.704+0000 7f6d19044640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6d140cc890 con 0x7f6d1409df30 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46888/0 (socket says 172.21.15.152:46888) 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 -- 172.21.15.152:0/3976898600 learned_addr learned my addr 172.21.15.152:0/3976898600 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d12d9d640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00003f30 0x7f6d141531b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 0x7f6d140b4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 -- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 msgr2=0x7f6d140b4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 0x7f6d140b4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 -- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00003f30 msgr2=0x7f6d141531b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00003f30 0x7f6d141531b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 -- 172.21.15.152:0/3976898600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d140b3cc0 con 0x7f6d1409e3b0 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d0bfff640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 0x7f6d140b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:46.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d1359e640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d140cfc30 tx=0x7f6d0c00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c00fce0 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c01d070 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d140b3fa0 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c015670 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.705+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d140b4560 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.706+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d1404f540 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.707+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6d0c015810 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.707+0000 7f6d0b7fe640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 0x7f6cf406e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.707+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f6d0c08b210 con 0x7f6d1409e3b0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.707+0000 7f6d12d9d640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 0x7f6cf406e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:46.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.708+0000 7f6d12d9d640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 0x7f6cf406e0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009bc0 tx=0x7f6d04009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:46.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.712+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6d0c010040 con 0x7f6d1409e3b0 2024-03-18T15:01:46.931 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:46.929+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f6d140cf4b0 con 0x7f6d1409e3b0 2024-03-18T15:01:47.586 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.585+0000 7f6d0b7fe640 1 -- 172.21.15.152:0/3976898600 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) ==== 122+0+0 (secure 0 0 0) 0x7f6d0c059d00 con 0x7f6d1409e3b0 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 msgr2=0x7f6cf406e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 0x7f6cf406e0c0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f6d04009bc0 tx=0x7f6d04009190 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 msgr2=0x7f6d140b52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f6d140cfc30 tx=0x7f6d0c00f1b0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 shutdown_connections 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6d1409e3b0 0x7f6d140b52a0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6cf406bc00 0x7f6cf406e0c0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6d1409df30 0x7f6d140b4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 --2- 172.21.15.152:0/3976898600 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6d00003f30 0x7f6d141531b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 >> 172.21.15.152:0/3976898600 conn(0x7f6d1409b160 msgr2=0x7f6d140cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 shutdown_connections 2024-03-18T15:01:47.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.587+0000 7f6d19044640 1 -- 172.21.15.152:0/3976898600 wait complete. 2024-03-18T15:01:47.600 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-03-18T15:01:47.600 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.704+0000 7f4cf853b640 1 Processor -- start 2024-03-18T15:01:47.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.704+0000 7f4cf853b640 1 -- start start 2024-03-18T15:01:47.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.705+0000 7f4cf853b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00cdf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.705+0000 7f4cf853b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 0x7f4cf015fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.705+0000 7f4cf853b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4cf01603e0 con 0x7f4cf015c160 2024-03-18T15:01:47.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.705+0000 7f4cf853b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4cf00b49c0 con 0x7f4cf00cf5b0 2024-03-18T15:01:47.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.705+0000 7f4cf853b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf0160c80 con 0x7f4cf006b8d0 2024-03-18T15:01:47.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf6ad8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 0x7f4cf015fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf5ad6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00cdf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf6ad8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 0x7f4cf015fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:40850/0 (socket says 172.21.15.152:40850) 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf6ad8640 1 -- 172.21.15.152:0/3045774291 learned_addr learned my addr 172.21.15.152:0/3045774291 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf62d7640 1 --1- 172.21.15.152:0/3045774291 >> v1:172.21.15.186:6789/0 conn(0x7f4cf015c160 0x7f4cf006b1c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:39540/0 (socket says 172.21.15.152:39540) 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf5ad6640 1 -- 172.21.15.152:0/3045774291 >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 msgr2=0x7f4cf015fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf5ad6640 1 --2- 172.21.15.152:0/3045774291 >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 0x7f4cf015fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf5ad6640 1 -- 172.21.15.152:0/3045774291 >> v1:172.21.15.186:6789/0 conn(0x7f4cf015c160 legacy=0x7f4cf006b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.706+0000 7f4cf5ad6640 1 -- 172.21.15.152:0/3045774291 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf01606c0 con 0x7f4cf006b8d0 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.707+0000 7f4cf5ad6640 1 --2- 172.21.15.152:0/3045774291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00cdf00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40097a0 tx=0x7f4ce402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0a8615dfa82a5b1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.707+0000 7f4cf52d5640 1 -- 172.21.15.152:0/3045774291 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4035020 con 0x7f4cf006b8d0 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.707+0000 7f4cf52d5640 1 -- 172.21.15.152:0/3045774291 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce4031830 con 0x7f4cf006b8d0 2024-03-18T15:01:47.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.707+0000 7f4cf52d5640 1 -- 172.21.15.152:0/3045774291 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4031c00 con 0x7f4cf006b8d0 2024-03-18T15:01:47.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 -- 172.21.15.152:0/3045774291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 msgr2=0x7f4cf00cdf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 --2- 172.21.15.152:0/3045774291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00cdf00 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40097a0 tx=0x7f4ce402b8d0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 -- 172.21.15.152:0/3045774291 shutdown_connections 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 --2- 172.21.15.152:0/3045774291 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00cdf00 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 --2- 172.21.15.152:0/3045774291 >> v2:172.21.15.186:3300/0 conn(0x7f4cf00cf5b0 0x7f4cf015fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 -- 172.21.15.152:0/3045774291 >> 172.21.15.152:0/3045774291 conn(0x7f4cf00b2ab0 msgr2=0x7f4cf00b2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 -- 172.21.15.152:0/3045774291 shutdown_connections 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.708+0000 7f4cf853b640 1 -- 172.21.15.152:0/3045774291 wait complete. 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.709+0000 7f4cf853b640 1 Processor -- start 2024-03-18T15:01:47.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.709+0000 7f4cf853b640 1 -- start start 2024-03-18T15:01:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00afaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cf00cf5b0 0x7f4cf00b5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf015c540 con 0x7f4cf015c160 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4cf00b4bf0 con 0x7f4cf00cf5b0 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf853b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4cf00b5110 con 0x7f4cf006b8d0 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46902/0 (socket says 172.21.15.152:46902) 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 -- 172.21.15.152:0/322818467 learned_addr learned my addr 172.21.15.152:0/322818467 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf62d7640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00afaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf5ad6640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cf00cf5b0 0x7f4cf00b5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 -- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 msgr2=0x7f4cf00afaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00afaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 -- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cf00cf5b0 msgr2=0x7f4cf00b5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cf00cf5b0 0x7f4cf00b5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 -- 172.21.15.152:0/322818467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cf006fac0 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.710+0000 7f4cf6ad8640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000efc0 tx=0x7f4ce000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.711+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce000cd20 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.711+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ce0003990 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.711+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cf00aefc0 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.711+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce0003d80 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.711+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cf0151b00 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.712+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cf004f5b0 con 0x7f4cf015c160 2024-03-18T15:01:47.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.712+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4ce0012050 con 0x7f4cf015c160 2024-03-18T15:01:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.713+0000 7f4ceeffd640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 0x7f4cdc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.713+0000 7f4cf62d7640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 0x7f4cdc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.713+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f4ce008af30 con 0x7f4cf015c160 2024-03-18T15:01:47.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.713+0000 7f4cf62d7640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 0x7f4cdc06e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f60 tx=0x7f4ce8007ce0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:47.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.717+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4ce0010040 con 0x7f4cf015c160 2024-03-18T15:01:47.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.936+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cf00cf160 con 0x7f4cf015c160 2024-03-18T15:01:47.936 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.936+0000 7f4ceeffd640 1 -- 172.21.15.152:0/322818467 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7f4ce0059ab0 con 0x7f4cf015c160 2024-03-18T15:01:47.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:47.937 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T15:01:47.937 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 msgr2=0x7f4cdc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 0x7f4cdc06e090 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8000f60 tx=0x7f4ce8007ce0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 msgr2=0x7f4cf0157890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f4ce000efc0 tx=0x7f4ce000c490 comp rx=0 tx=0).stop 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 shutdown_connections 2024-03-18T15:01:47.939 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4cf015c160 0x7f4cf0157890 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4cf00cf5b0 0x7f4cf00b5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4cdc06bbd0 0x7f4cdc06e090 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 --2- 172.21.15.152:0/322818467 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4cf006b8d0 0x7f4cf00afaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.938+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 >> 172.21.15.152:0/322818467 conn(0x7f4cf00b2ab0 msgr2=0x7f4cf00d0010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.939+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 shutdown_connections 2024-03-18T15:01:47.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:47.939+0000 7f4cf853b640 1 -- 172.21.15.152:0/322818467 wait complete. 2024-03-18T15:01:47.950 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T15:01:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.051+0000 7f3c1a6fe640 1 Processor -- start 2024-03-18T15:01:48.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 -- start start 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f3c1415c3a0 0x7f3c140d2980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c140cef80 0x7f3c140af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3c140cd510 con 0x7f3c1415c780 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f3c140cd7f0 con 0x7f3c140cef80 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c1a6fe640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f3c140cdad0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c18c9b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f3c140cef80 0x7f3c140af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c137fe640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3c1415c780 0x7f3c140ce870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52024/0 (socket says 172.21.15.152:52024) 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.052+0000 7f3c137fe640 1 -- 172.21.15.152:0/2465098443 learned_addr learned my addr 172.21.15.152:0/2465098443 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:48.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c13fff640 1 --2- 172.21.15.152:0/2465098443 >> v2:172.21.15.186:3300/0 conn(0x7f3c1415c3a0 0x7f3c140d2980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c18c9b640 1 -- 172.21.15.152:0/2465098443 >> v2:172.21.15.186:3300/0 conn(0x7f3c1415c3a0 msgr2=0x7f3c140d2980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c18c9b640 1 --2- 172.21.15.152:0/2465098443 >> v2:172.21.15.186:3300/0 conn(0x7f3c1415c3a0 0x7f3c140d2980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c18c9b640 1 -- 172.21.15.152:0/2465098443 >> v1:172.21.15.152:6789/0 conn(0x7f3c1415c780 legacy=0x7f3c140ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c12ffd640 1 -- 172.21.15.152:0/2465098443 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2799285116 0 0) 0x7f3c140cd510 con 0x7f3c1415c780 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.053+0000 7f3c18c9b640 1 -- 172.21.15.152:0/2465098443 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c140cddb0 con 0x7f3c140cef80 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c18c9b640 1 --2- 172.21.15.152:0/2465098443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c140cef80 0x7f3c140af000 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3c140722e0 tx=0x7f3c0c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47282ae89f92b04b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c12ffd640 1 -- 172.21.15.152:0/2465098443 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c039070 con 0x7f3c140cef80 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c12ffd640 1 -- 172.21.15.152:0/2465098443 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c0c02cc80 con 0x7f3c140cef80 2024-03-18T15:01:48.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c12ffd640 1 -- 172.21.15.152:0/2465098443 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c0c034660 con 0x7f3c140cef80 2024-03-18T15:01:48.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/2465098443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c140cef80 msgr2=0x7f3c140af000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/2465098443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c140cef80 0x7f3c140af000 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f3c140722e0 tx=0x7f3c0c02bed0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/2465098443 shutdown_connections 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/2465098443 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c140cef80 0x7f3c140af000 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/2465098443 >> v2:172.21.15.186:3300/0 conn(0x7f3c1415c3a0 0x7f3c140d2980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/2465098443 >> 172.21.15.152:0/2465098443 conn(0x7f3c140d1e60 msgr2=0x7f3c140d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/2465098443 shutdown_connections 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.054+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/2465098443 wait complete. 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.055+0000 7f3c1a6fe640 1 Processor -- start 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 -- start start 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c140cef80 0x7f3c14156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c1415c780 0x7f3c1415e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3c140cf570 con 0x7f3c1415c3a0 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3c140cf3f0 con 0x7f3c1415c780 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c1a6fe640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3c14153c50 con 0x7f3c140cef80 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.056+0000 7f3c137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46912/0 (socket says 172.21.15.152:46912) 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 -- 172.21.15.152:0/3271128015 learned_addr learned my addr 172.21.15.152:0/3271128015 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c13fff640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c140cef80 0x7f3c14156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c18c9b640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c1415c780 0x7f3c1415e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 -- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c140cef80 msgr2=0x7f3c14156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c140cef80 0x7f3c14156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 -- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c1415c780 msgr2=0x7f3c1415e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c1415c780 0x7f3c1415e600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 -- 172.21.15.152:0/3271128015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c14153ea0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c137fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c4d0 tx=0x7f3c0800c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08018070 con 0x7f3c1415c3a0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c08007500 con 0x7f3c1415c3a0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c14154180 con 0x7f3c1415c3a0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c08004a20 con 0x7f3c1415c3a0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.057+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c14156f70 con 0x7f3c1415c3a0 2024-03-18T15:01:48.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.058+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c1404f5b0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.059+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3c0801b070 con 0x7f3c1415c3a0 2024-03-18T15:01:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.059+0000 7f3c10ff9640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.059+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f3c08089dd0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.059+0000 7f3c13fff640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.062 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.060+0000 7f3c13fff640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 0x7f3c0006e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3c04006fd0 tx=0x7f3c04008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.064+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3c080588c0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.252+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3c1415aed0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.253+0000 7f3c10ff9640 1 -- 172.21.15.152:0/3271128015 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f3c080581c0 con 0x7f3c1415c3a0 2024-03-18T15:01:48.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:48.253 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:46.574201+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 msgr2=0x7f3c0006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 0x7f3c0006e090 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f3c04006fd0 tx=0x7f3c04008040 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 msgr2=0x7f3c1415e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f3c0800c4d0 tx=0x7f3c0800c990 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 shutdown_connections 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3c1415c780 0x7f3c1415e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3c1415c3a0 0x7f3c1415e0c0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3c0006bbd0 0x7f3c0006e090 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 --2- 172.21.15.152:0/3271128015 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3c140cef80 0x7f3c14156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 >> 172.21.15.152:0/3271128015 conn(0x7f3c140d1e60 msgr2=0x7f3c140c7600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 shutdown_connections 2024-03-18T15:01:48.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.255+0000 7f3c1a6fe640 1 -- 172.21.15.152:0/3271128015 wait complete. 2024-03-18T15:01:48.267 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-03-18T15:01:48.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:48.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.368+0000 7fdae0cd1640 1 Processor -- start 2024-03-18T15:01:48.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.368+0000 7fdae0cd1640 1 -- start start 2024-03-18T15:01:48.369 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdae0cd1640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdadc1622b0 0x7fdadc0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdae0cd1640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdadc0b3440 con 0x7fdadc15ea90 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdae0cd1640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdadc0d20a0 con 0x7fdadc162690 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdae0cd1640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdadc0d16c0 con 0x7fdadc1622b0 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdada59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdadc1622b0 0x7fdadc0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdadad9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fdadc15ea90 0x7fdadc15eee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52034/0 (socket says 172.21.15.152:52034) 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdadad9d640 1 -- 172.21.15.152:0/591855721 learned_addr learned my addr 172.21.15.152:0/591855721 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdada59c640 1 -- 172.21.15.152:0/591855721 >> v1:172.21.15.186:6789/0 conn(0x7fdadc162690 legacy=0x7fdadc162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdada59c640 1 -- 172.21.15.152:0/591855721 >> v1:172.21.15.152:6789/0 conn(0x7fdadc15ea90 legacy=0x7fdadc15eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdada59c640 1 -- 172.21.15.152:0/591855721 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0d2380 con 0x7fdadc1622b0 2024-03-18T15:01:48.370 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.369+0000 7fdad9d9b640 1 -- 172.21.15.152:0/591855721 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1805786784 0 0) 0x7fdadc0b3440 con 0x7fdadc15ea90 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.370+0000 7fdada59c640 1 --2- 172.21.15.152:0/591855721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0d10d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097d0 tx=0x7fdacc02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a4a0037b7827ddf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.370+0000 7fdad9d9b640 1 -- 172.21.15.152:0/591855721 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc038070 con 0x7fdadc1622b0 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.370+0000 7fdad9d9b640 1 -- 172.21.15.152:0/591855721 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdacc031700 con 0x7fdadc1622b0 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.370+0000 7fdad9d9b640 1 -- 172.21.15.152:0/591855721 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdacc031ad0 con 0x7fdadc1622b0 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 -- 172.21.15.152:0/591855721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 msgr2=0x7fdadc0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/591855721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0d10d0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fdacc0097d0 tx=0x7fdacc02b7a0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 -- 172.21.15.152:0/591855721 shutdown_connections 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/591855721 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0d10d0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 -- 172.21.15.152:0/591855721 >> 172.21.15.152:0/591855721 conn(0x7fdadc0d4070 msgr2=0x7fdadc0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 -- 172.21.15.152:0/591855721 shutdown_connections 2024-03-18T15:01:48.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.371+0000 7fdae0cd1640 1 -- 172.21.15.152:0/591855721 wait complete. 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.372+0000 7fdae0cd1640 1 Processor -- start 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.372+0000 7fdae0cd1640 1 -- start start 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdadc15ea90 0x7fdadc1f3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdadc162690 0x7fdadc0cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0cfc90 con 0x7fdadc1622b0 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdadc0d2660 con 0x7fdadc162690 2024-03-18T15:01:48.375 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdae0cd1640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdadc0cfe10 con 0x7fdadc15ea90 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46926/0 (socket says 172.21.15.152:46926) 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 -- 172.21.15.152:0/532507331 learned_addr learned my addr 172.21.15.152:0/532507331 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdadad9d640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdadc162690 0x7fdadc0cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdada59c640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdadc15ea90 0x7fdadc1f3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 -- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdadc15ea90 msgr2=0x7fdadc1f3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdadc15ea90 0x7fdadc1f3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 -- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdadc162690 msgr2=0x7fdadc0cd7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdadc162690 0x7fdadc0cd7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 -- 172.21.15.152:0/532507331 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdadc0cc9a0 con 0x7fdadc1622b0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.373+0000 7fdad3fff640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c430 tx=0x7fdac400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.374+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011790 con 0x7fdadc1622b0 2024-03-18T15:01:48.376 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.374+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdac4017070 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.374+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdadc0ccc80 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.374+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdac4011bb0 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.374+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdadc0b7f80 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.375+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdadc0cce50 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.375+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdac401c460 con 0x7fdadc1622b0 2024-03-18T15:01:48.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.375+0000 7fdad2ffd640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 0x7fdabc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.376+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fdac408a910 con 0x7fdadc1622b0 2024-03-18T15:01:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.376+0000 7fdada59c640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 0x7fdabc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.376+0000 7fdada59c640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 0x7fdabc06e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdacc035000 tx=0x7fdacc008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.380 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.380+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdac4059400 con 0x7fdadc1622b0 2024-03-18T15:01:48.549 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.548+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdadc068710 con 0x7fdabc06bbd0 2024-03-18T15:01:48.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.554+0000 7fdad2ffd640 1 -- 172.21.15.152:0/532507331 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247616 (secure 0 0 0) 0x7fdacc0043b0 con 0x7fdabc06bbd0 2024-03-18T15:01:48.557 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:48.559 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:48.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 msgr2=0x7fdabc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 0x7fdabc06e090 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fdacc035000 tx=0x7fdacc008030 comp rx=0 tx=0).stop 2024-03-18T15:01:48.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 msgr2=0x7fdadc0cd290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c430 tx=0x7fdac400c8f0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 shutdown_connections 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdadc162690 0x7fdadc0cd7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdadc1622b0 0x7fdadc0cd290 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdabc06bbd0 0x7fdabc06e090 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 --2- 172.21.15.152:0/532507331 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdadc15ea90 0x7fdadc1f3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 >> 172.21.15.152:0/532507331 conn(0x7fdadc0d4070 msgr2=0x7fdadc06bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 shutdown_connections 2024-03-18T15:01:48.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.557+0000 7fdae0cd1640 1 -- 172.21.15.152:0/532507331 wait complete. 2024-03-18T15:01:48.568 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-18T15:01:47.815884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224348,"kb_used_data":3988,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750372,"statfs":{"total":773094113280,"available":772864380928,"internally_reserved":0,"allocated":4083712,"data_stored":2289735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.256676"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573049+0000","last_change":"2024-03-18T15:01:44.573049+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573049+0000","last_undegraded":"2024-03-18T15:01:44.573049+0000","last_fullsized":"2024-03-18T15:01:44.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597219+0000","last_change":"2024-03-18T15:01:45.592575+0000","last_active":"2024-03-18T15:01:45.597219+0000","last_peered":"2024-03-18T15:01:45.597219+0000","last_clean":"2024-03-18T15:01:45.597219+0000","last_became_active":"2024-03-18T15:01:45.586032+0000","last_became_peered":"2024-03-18T15:01:45.586032+0000","last_unstale":"2024-03-18T15:01:45.597219+0000","last_undegraded":"2024-03-18T15:01:45.597219+0000","last_fullsized":"2024-03-18T15:01:45.597219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568109+0000","last_change":"2024-03-18T15:01:44.568109+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568109+0000","last_undegraded":"2024-03-18T15:01:44.568109+0000","last_fullsized":"2024-03-18T15:01:44.568109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.593867+0000","last_change":"2024-03-18T15:01:45.587946+0000","last_active":"2024-03-18T15:01:45.593867+0000","last_peered":"2024-03-18T15:01:45.593867+0000","last_clean":"2024-03-18T15:01:45.593867+0000","last_became_active":"2024-03-18T15:01:45.587670+0000","last_became_peered":"2024-03-18T15:01:45.587670+0000","last_unstale":"2024-03-18T15:01:45.593867+0000","last_undegraded":"2024-03-18T15:01:45.593867+0000","last_fullsized":"2024-03-18T15:01:45.593867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:25.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596088+0000","last_change":"2024-03-18T15:01:45.595395+0000","last_active":"2024-03-18T15:01:45.596088+0000","last_peered":"2024-03-18T15:01:45.596088+0000","last_clean":"2024-03-18T15:01:45.596088+0000","last_became_active":"2024-03-18T15:01:45.595169+0000","last_became_peered":"2024-03-18T15:01:45.595169+0000","last_unstale":"2024-03-18T15:01:45.596088+0000","last_undegraded":"2024-03-18T15:01:45.596088+0000","last_fullsized":"2024-03-18T15:01:45.596088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:39.240483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596426+0000","last_change":"2024-03-18T15:01:45.578000+0000","last_active":"2024-03-18T15:01:45.596426+0000","last_peered":"2024-03-18T15:01:45.596426+0000","last_clean":"2024-03-18T15:01:45.596426+0000","last_became_active":"2024-03-18T15:01:45.577724+0000","last_became_peered":"2024-03-18T15:01:45.577724+0000","last_unstale":"2024-03-18T15:01:45.596426+0000","last_undegraded":"2024-03-18T15:01:45.596426+0000","last_fullsized":"2024-03-18T15:01:45.596426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:12.206972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573339+0000","last_change":"2024-03-18T15:01:44.573339+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573339+0000","last_undegraded":"2024-03-18T15:01:44.573339+0000","last_fullsized":"2024-03-18T15:01:44.573339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.577069+0000","last_change":"2024-03-18T15:01:44.577069+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.577069+0000","last_undegraded":"2024-03-18T15:01:44.577069+0000","last_fullsized":"2024-03-18T15:01:44.577069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569073+0000","last_change":"2024-03-18T15:01:44.569073+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569073+0000","last_undegraded":"2024-03-18T15:01:44.569073+0000","last_fullsized":"2024-03-18T15:01:44.569073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.605685+0000","last_change":"2024-03-18T15:01:45.598002+0000","last_active":"2024-03-18T15:01:45.605685+0000","last_peered":"2024-03-18T15:01:45.605685+0000","last_clean":"2024-03-18T15:01:45.605685+0000","last_became_active":"2024-03-18T15:01:45.597734+0000","last_became_peered":"2024-03-18T15:01:45.597734+0000","last_unstale":"2024-03-18T15:01:45.605685+0000","last_undegraded":"2024-03-18T15:01:45.605685+0000","last_fullsized":"2024-03-18T15:01:45.605685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:27.068270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.576702+0000","last_change":"2024-03-18T15:01:44.576702+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.576702+0000","last_undegraded":"2024-03-18T15:01:44.576702+0000","last_fullsized":"2024-03-18T15:01:44.576702+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572384+0000","last_change":"2024-03-18T15:01:44.572384+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572384+0000","last_undegraded":"2024-03-18T15:01:44.572384+0000","last_fullsized":"2024-03-18T15:01:44.572384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585461+0000","last_change":"2024-03-18T15:01:45.583364+0000","last_active":"2024-03-18T15:01:45.585461+0000","last_peered":"2024-03-18T15:01:45.585461+0000","last_clean":"2024-03-18T15:01:45.585461+0000","last_became_active":"2024-03-18T15:01:45.582846+0000","last_became_peered":"2024-03-18T15:01:45.582846+0000","last_unstale":"2024-03-18T15:01:45.585461+0000","last_undegraded":"2024-03-18T15:01:45.585461+0000","last_fullsized":"2024-03-18T15:01:45.585461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:54:18.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596569+0000","last_change":"2024-03-18T15:01:45.581704+0000","last_active":"2024-03-18T15:01:45.596569+0000","last_peered":"2024-03-18T15:01:45.596569+0000","last_clean":"2024-03-18T15:01:45.596569+0000","last_became_active":"2024-03-18T15:01:45.581288+0000","last_became_peered":"2024-03-18T15:01:45.581288+0000","last_unstale":"2024-03-18T15:01:45.596569+0000","last_undegraded":"2024-03-18T15:01:45.596569+0000","last_fullsized":"2024-03-18T15:01:45.596569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:31.840893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569048+0000","last_change":"2024-03-18T15:01:44.569048+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569048+0000","last_undegraded":"2024-03-18T15:01:44.569048+0000","last_fullsized":"2024-03-18T15:01:44.569048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574131+0000","last_change":"2024-03-18T15:01:44.574131+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574131+0000","last_undegraded":"2024-03-18T15:01:44.574131+0000","last_fullsized":"2024-03-18T15:01:44.574131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573363+0000","last_change":"2024-03-18T15:01:44.573363+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573363+0000","last_undegraded":"2024-03-18T15:01:44.573363+0000","last_fullsized":"2024-03-18T15:01:44.573363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597291+0000","last_change":"2024-03-18T15:01:45.593046+0000","last_active":"2024-03-18T15:01:45.597291+0000","last_peered":"2024-03-18T15:01:45.597291+0000","last_clean":"2024-03-18T15:01:45.597291+0000","last_became_active":"2024-03-18T15:01:45.592791+0000","last_became_peered":"2024-03-18T15:01:45.592791+0000","last_unstale":"2024-03-18T15:01:45.597291+0000","last_undegraded":"2024-03-18T15:01:45.597291+0000","last_fullsized":"2024-03-18T15:01:45.597291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597370+0000","last_change":"2024-03-18T15:01:45.586629+0000","last_active":"2024-03-18T15:01:45.597370+0000","last_peered":"2024-03-18T15:01:45.597370+0000","last_clean":"2024-03-18T15:01:45.597370+0000","last_became_active":"2024-03-18T15:01:45.586335+0000","last_became_peered":"2024-03-18T15:01:45.586335+0000","last_unstale":"2024-03-18T15:01:45.597370+0000","last_undegraded":"2024-03-18T15:01:45.597370+0000","last_fullsized":"2024-03-18T15:01:45.597370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585516+0000","last_change":"2024-03-18T15:01:45.584429+0000","last_active":"2024-03-18T15:01:45.585516+0000","last_peered":"2024-03-18T15:01:45.585516+0000","last_clean":"2024-03-18T15:01:45.585516+0000","last_became_active":"2024-03-18T15:01:45.584158+0000","last_became_peered":"2024-03-18T15:01:45.584158+0000","last_unstale":"2024-03-18T15:01:45.585516+0000","last_undegraded":"2024-03-18T15:01:45.585516+0000","last_fullsized":"2024-03-18T15:01:45.585516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:25.504474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571378+0000","last_change":"2024-03-18T15:01:44.571378+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571378+0000","last_undegraded":"2024-03-18T15:01:44.571378+0000","last_fullsized":"2024-03-18T15:01:44.571378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569942+0000","last_change":"2024-03-18T15:01:44.569942+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569942+0000","last_undegraded":"2024-03-18T15:01:44.569942+0000","last_fullsized":"2024-03-18T15:01:44.569942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.567982+0000","last_change":"2024-03-18T15:01:44.567982+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.567982+0000","last_undegraded":"2024-03-18T15:01:44.567982+0000","last_fullsized":"2024-03-18T15:01:44.567982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585519+0000","last_change":"2024-03-18T15:01:45.583520+0000","last_active":"2024-03-18T15:01:45.585519+0000","last_peered":"2024-03-18T15:01:45.585519+0000","last_clean":"2024-03-18T15:01:45.585519+0000","last_became_active":"2024-03-18T15:01:45.583058+0000","last_became_peered":"2024-03-18T15:01:45.583058+0000","last_unstale":"2024-03-18T15:01:45.585519+0000","last_undegraded":"2024-03-18T15:01:45.585519+0000","last_fullsized":"2024-03-18T15:01:45.585519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:31:11.337881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596707+0000","last_change":"2024-03-18T15:01:45.581296+0000","last_active":"2024-03-18T15:01:45.596707+0000","last_peered":"2024-03-18T15:01:45.596707+0000","last_clean":"2024-03-18T15:01:45.596707+0000","last_became_active":"2024-03-18T15:01:45.581030+0000","last_became_peered":"2024-03-18T15:01:45.581030+0000","last_unstale":"2024-03-18T15:01:45.596707+0000","last_undegraded":"2024-03-18T15:01:45.596707+0000","last_fullsized":"2024-03-18T15:01:45.596707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:38:24.924212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595701+0000","last_change":"2024-03-18T15:01:45.593019+0000","last_active":"2024-03-18T15:01:45.595701+0000","last_peered":"2024-03-18T15:01:45.595701+0000","last_clean":"2024-03-18T15:01:45.595701+0000","last_became_active":"2024-03-18T15:01:45.592763+0000","last_became_peered":"2024-03-18T15:01:45.592763+0000","last_unstale":"2024-03-18T15:01:45.595701+0000","last_undegraded":"2024-03-18T15:01:45.595701+0000","last_fullsized":"2024-03-18T15:01:45.595701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:49.252348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569511+0000","last_change":"2024-03-18T15:01:44.569511+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569511+0000","last_undegraded":"2024-03-18T15:01:44.569511+0000","last_fullsized":"2024-03-18T15:01:44.569511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570921+0000","last_change":"2024-03-18T15:01:44.570921+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570921+0000","last_undegraded":"2024-03-18T15:01:44.570921+0000","last_fullsized":"2024-03-18T15:01:44.570921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574928+0000","last_change":"2024-03-18T15:01:44.574928+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574928+0000","last_undegraded":"2024-03-18T15:01:44.574928+0000","last_fullsized":"2024-03-18T15:01:44.574928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572711+0000","last_change":"2024-03-18T15:01:44.572711+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572711+0000","last_undegraded":"2024-03-18T15:01:44.572711+0000","last_fullsized":"2024-03-18T15:01:44.572711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575900+0000","last_change":"2024-03-18T15:01:44.575900+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575900+0000","last_undegraded":"2024-03-18T15:01:44.575900+0000","last_fullsized":"2024-03-18T15:01:44.575900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581654+0000","last_change":"2024-03-18T15:01:44.579276+0000","last_active":"2024-03-18T15:01:44.581654+0000","last_peered":"2024-03-18T15:01:44.581654+0000","last_clean":"2024-03-18T15:01:44.581654+0000","last_became_active":"2024-03-18T15:01:44.578958+0000","last_became_peered":"2024-03-18T15:01:44.578958+0000","last_unstale":"2024-03-18T15:01:44.581654+0000","last_undegraded":"2024-03-18T15:01:44.581654+0000","last_fullsized":"2024-03-18T15:01:44.581654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:40.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571575+0000","last_change":"2024-03-18T15:01:44.571575+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571575+0000","last_undegraded":"2024-03-18T15:01:44.571575+0000","last_fullsized":"2024-03-18T15:01:44.571575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570211+0000","last_change":"2024-03-18T15:01:44.570211+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570211+0000","last_undegraded":"2024-03-18T15:01:44.570211+0000","last_fullsized":"2024-03-18T15:01:44.570211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596755+0000","last_change":"2024-03-18T15:01:44.590824+0000","last_active":"2024-03-18T15:01:45.596755+0000","last_peered":"2024-03-18T15:01:45.596755+0000","last_clean":"2024-03-18T15:01:45.596755+0000","last_became_active":"2024-03-18T15:01:44.590495+0000","last_became_peered":"2024-03-18T15:01:44.590495+0000","last_unstale":"2024-03-18T15:01:45.596755+0000","last_undegraded":"2024-03-18T15:01:45.596755+0000","last_fullsized":"2024-03-18T15:01:45.596755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:03.804170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595667+0000","last_change":"2024-03-18T15:01:45.592391+0000","last_active":"2024-03-18T15:01:45.595667+0000","last_peered":"2024-03-18T15:01:45.595667+0000","last_clean":"2024-03-18T15:01:45.595667+0000","last_became_active":"2024-03-18T15:01:45.592134+0000","last_became_peered":"2024-03-18T15:01:45.592134+0000","last_unstale":"2024-03-18T15:01:45.595667+0000","last_undegraded":"2024-03-18T15:01:45.595667+0000","last_fullsized":"2024-03-18T15:01:45.595667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:17.013483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.583480+0000","last_change":"2024-03-18T15:01:44.582771+0000","last_active":"2024-03-18T15:01:45.583480+0000","last_peered":"2024-03-18T15:01:45.583480+0000","last_clean":"2024-03-18T15:01:45.583480+0000","last_became_active":"2024-03-18T15:01:44.582504+0000","last_became_peered":"2024-03-18T15:01:44.582504+0000","last_unstale":"2024-03-18T15:01:45.583480+0000","last_undegraded":"2024-03-18T15:01:45.583480+0000","last_fullsized":"2024-03-18T15:01:45.583480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:57.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574390+0000","last_change":"2024-03-18T15:01:44.574390+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574390+0000","last_undegraded":"2024-03-18T15:01:44.574390+0000","last_fullsized":"2024-03-18T15:01:44.574390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590485+0000","last_change":"2024-03-18T15:01:44.585074+0000","last_active":"2024-03-18T15:01:44.590485+0000","last_peered":"2024-03-18T15:01:44.590485+0000","last_clean":"2024-03-18T15:01:44.590485+0000","last_became_active":"2024-03-18T15:01:44.584724+0000","last_became_peered":"2024-03-18T15:01:44.584724+0000","last_unstale":"2024-03-18T15:01:44.590485+0000","last_undegraded":"2024-03-18T15:01:44.590485+0000","last_fullsized":"2024-03-18T15:01:44.590485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:42.564122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569108+0000","last_change":"2024-03-18T15:01:44.569108+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569108+0000","last_undegraded":"2024-03-18T15:01:44.569108+0000","last_fullsized":"2024-03-18T15:01:44.569108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584819+0000","last_change":"2024-03-18T15:01:44.581419+0000","last_active":"2024-03-18T15:01:44.584819+0000","last_peered":"2024-03-18T15:01:44.584819+0000","last_clean":"2024-03-18T15:01:44.584819+0000","last_became_active":"2024-03-18T15:01:44.580982+0000","last_became_peered":"2024-03-18T15:01:44.580982+0000","last_unstale":"2024-03-18T15:01:44.584819+0000","last_undegraded":"2024-03-18T15:01:44.584819+0000","last_fullsized":"2024-03-18T15:01:44.584819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:56:27.790579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569439+0000","last_change":"2024-03-18T15:01:44.569439+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569439+0000","last_undegraded":"2024-03-18T15:01:44.569439+0000","last_fullsized":"2024-03-18T15:01:44.569439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.567995+0000","last_change":"2024-03-18T15:01:44.583187+0000","last_active":"2024-03-18T15:01:45.567995+0000","last_peered":"2024-03-18T15:01:45.567995+0000","last_clean":"2024-03-18T15:01:45.567995+0000","last_became_active":"2024-03-18T15:01:44.582915+0000","last_became_peered":"2024-03-18T15:01:44.582915+0000","last_unstale":"2024-03-18T15:01:45.567995+0000","last_undegraded":"2024-03-18T15:01:45.567995+0000","last_fullsized":"2024-03-18T15:01:45.567995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595035+0000","last_change":"2024-03-18T15:01:45.591499+0000","last_active":"2024-03-18T15:01:45.595035+0000","last_peered":"2024-03-18T15:01:45.595035+0000","last_clean":"2024-03-18T15:01:45.595035+0000","last_became_active":"2024-03-18T15:01:45.591017+0000","last_became_peered":"2024-03-18T15:01:45.591017+0000","last_unstale":"2024-03-18T15:01:45.595035+0000","last_undegraded":"2024-03-18T15:01:45.595035+0000","last_fullsized":"2024-03-18T15:01:45.595035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:25.128904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577572+0000","last_change":"2024-03-18T15:01:44.576918+0000","last_active":"2024-03-18T15:01:44.577572+0000","last_peered":"2024-03-18T15:01:44.577572+0000","last_clean":"2024-03-18T15:01:44.577572+0000","last_became_active":"2024-03-18T15:01:44.576614+0000","last_became_peered":"2024-03-18T15:01:44.576614+0000","last_unstale":"2024-03-18T15:01:44.577572+0000","last_undegraded":"2024-03-18T15:01:44.577572+0000","last_fullsized":"2024-03-18T15:01:44.577572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:52.851001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569291+0000","last_change":"2024-03-18T15:01:44.569291+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569291+0000","last_undegraded":"2024-03-18T15:01:44.569291+0000","last_fullsized":"2024-03-18T15:01:44.569291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569820+0000","last_change":"2024-03-18T15:01:44.582920+0000","last_active":"2024-03-18T15:01:45.569820+0000","last_peered":"2024-03-18T15:01:45.569820+0000","last_clean":"2024-03-18T15:01:45.569820+0000","last_became_active":"2024-03-18T15:01:44.582314+0000","last_became_peered":"2024-03-18T15:01:44.582314+0000","last_unstale":"2024-03-18T15:01:45.569820+0000","last_undegraded":"2024-03-18T15:01:45.569820+0000","last_fullsized":"2024-03-18T15:01:45.569820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:26.066141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597238+0000","last_change":"2024-03-18T15:01:45.592592+0000","last_active":"2024-03-18T15:01:45.597238+0000","last_peered":"2024-03-18T15:01:45.597238+0000","last_clean":"2024-03-18T15:01:45.597238+0000","last_became_active":"2024-03-18T15:01:45.592306+0000","last_became_peered":"2024-03-18T15:01:45.592306+0000","last_unstale":"2024-03-18T15:01:45.597238+0000","last_undegraded":"2024-03-18T15:01:45.597238+0000","last_fullsized":"2024-03-18T15:01:45.597238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597532+0000","last_change":"2024-03-18T15:01:45.583531+0000","last_active":"2024-03-18T15:01:45.597532+0000","last_peered":"2024-03-18T15:01:45.597532+0000","last_clean":"2024-03-18T15:01:45.597532+0000","last_became_active":"2024-03-18T15:01:45.583282+0000","last_became_peered":"2024-03-18T15:01:45.583282+0000","last_unstale":"2024-03-18T15:01:45.597532+0000","last_undegraded":"2024-03-18T15:01:45.597532+0000","last_fullsized":"2024-03-18T15:01:45.597532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:15:21.257890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584775+0000","last_change":"2024-03-18T15:01:44.581812+0000","last_active":"2024-03-18T15:01:44.584775+0000","last_peered":"2024-03-18T15:01:44.584775+0000","last_clean":"2024-03-18T15:01:44.584775+0000","last_became_active":"2024-03-18T15:01:44.581380+0000","last_became_peered":"2024-03-18T15:01:44.581380+0000","last_unstale":"2024-03-18T15:01:44.584775+0000","last_undegraded":"2024-03-18T15:01:44.584775+0000","last_fullsized":"2024-03-18T15:01:44.584775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568590+0000","last_change":"2024-03-18T15:01:44.568590+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568590+0000","last_undegraded":"2024-03-18T15:01:44.568590+0000","last_fullsized":"2024-03-18T15:01:44.568590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.607177+0000","last_change":"2024-03-18T15:01:44.590920+0000","last_active":"2024-03-18T15:01:45.607177+0000","last_peered":"2024-03-18T15:01:45.607177+0000","last_clean":"2024-03-18T15:01:45.607177+0000","last_became_active":"2024-03-18T15:01:44.590650+0000","last_became_peered":"2024-03-18T15:01:44.590650+0000","last_unstale":"2024-03-18T15:01:45.607177+0000","last_undegraded":"2024-03-18T15:01:45.607177+0000","last_fullsized":"2024-03-18T15:01:45.607177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:26.743158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595114+0000","last_change":"2024-03-18T15:01:45.591643+0000","last_active":"2024-03-18T15:01:45.595114+0000","last_peered":"2024-03-18T15:01:45.595114+0000","last_clean":"2024-03-18T15:01:45.595114+0000","last_became_active":"2024-03-18T15:01:45.591094+0000","last_became_peered":"2024-03-18T15:01:45.591094+0000","last_unstale":"2024-03-18T15:01:45.595114+0000","last_undegraded":"2024-03-18T15:01:45.595114+0000","last_fullsized":"2024-03-18T15:01:45.595114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:04.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576742+0000","last_change":"2024-03-18T15:01:44.575992+0000","last_active":"2024-03-18T15:01:44.576742+0000","last_peered":"2024-03-18T15:01:44.576742+0000","last_clean":"2024-03-18T15:01:44.576742+0000","last_became_active":"2024-03-18T15:01:44.575239+0000","last_became_peered":"2024-03-18T15:01:44.575239+0000","last_unstale":"2024-03-18T15:01:44.576742+0000","last_undegraded":"2024-03-18T15:01:44.576742+0000","last_fullsized":"2024-03-18T15:01:44.576742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:59:37.202070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597457+0000","last_change":"2024-03-18T15:01:45.586654+0000","last_active":"2024-03-18T15:01:45.597457+0000","last_peered":"2024-03-18T15:01:45.597457+0000","last_clean":"2024-03-18T15:01:45.597457+0000","last_became_active":"2024-03-18T15:01:45.586351+0000","last_became_peered":"2024-03-18T15:01:45.586351+0000","last_unstale":"2024-03-18T15:01:45.597457+0000","last_undegraded":"2024-03-18T15:01:45.597457+0000","last_fullsized":"2024-03-18T15:01:45.597457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.577947+0000","last_change":"2024-03-18T15:01:44.583555+0000","last_active":"2024-03-18T15:01:45.577947+0000","last_peered":"2024-03-18T15:01:45.577947+0000","last_clean":"2024-03-18T15:01:45.577947+0000","last_became_active":"2024-03-18T15:01:44.583318+0000","last_became_peered":"2024-03-18T15:01:44.583318+0000","last_unstale":"2024-03-18T15:01:45.577947+0000","last_undegraded":"2024-03-18T15:01:45.577947+0000","last_fullsized":"2024-03-18T15:01:45.577947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:05.767566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575481+0000","last_change":"2024-03-18T15:01:44.575481+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575481+0000","last_undegraded":"2024-03-18T15:01:44.575481+0000","last_fullsized":"2024-03-18T15:01:44.575481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.568017+0000","last_change":"2024-03-18T15:01:44.584486+0000","last_active":"2024-03-18T15:01:45.568017+0000","last_peered":"2024-03-18T15:01:45.568017+0000","last_clean":"2024-03-18T15:01:45.568017+0000","last_became_active":"2024-03-18T15:01:44.583996+0000","last_became_peered":"2024-03-18T15:01:44.583996+0000","last_unstale":"2024-03-18T15:01:45.568017+0000","last_undegraded":"2024-03-18T15:01:45.568017+0000","last_fullsized":"2024-03-18T15:01:45.568017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:24.126775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571710+0000","last_change":"2024-03-18T15:01:44.571710+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571710+0000","last_undegraded":"2024-03-18T15:01:44.571710+0000","last_fullsized":"2024-03-18T15:01:44.571710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597289+0000","last_change":"2024-03-18T15:01:44.591019+0000","last_active":"2024-03-18T15:01:45.597289+0000","last_peered":"2024-03-18T15:01:45.597289+0000","last_clean":"2024-03-18T15:01:45.597289+0000","last_became_active":"2024-03-18T15:01:44.590748+0000","last_became_peered":"2024-03-18T15:01:44.590748+0000","last_unstale":"2024-03-18T15:01:45.597289+0000","last_undegraded":"2024-03-18T15:01:45.597289+0000","last_fullsized":"2024-03-18T15:01:45.597289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:16.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570596+0000","last_change":"2024-03-18T15:01:44.570596+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570596+0000","last_undegraded":"2024-03-18T15:01:44.570596+0000","last_fullsized":"2024-03-18T15:01:44.570596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597685+0000","last_change":"2024-03-18T15:01:44.586226+0000","last_active":"2024-03-18T15:01:45.597685+0000","last_peered":"2024-03-18T15:01:45.597685+0000","last_clean":"2024-03-18T15:01:45.597685+0000","last_became_active":"2024-03-18T15:01:44.585825+0000","last_became_peered":"2024-03-18T15:01:44.585825+0000","last_unstale":"2024-03-18T15:01:45.597685+0000","last_undegraded":"2024-03-18T15:01:45.597685+0000","last_fullsized":"2024-03-18T15:01:45.597685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570804+0000","last_change":"2024-03-18T15:01:44.570804+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570804+0000","last_undegraded":"2024-03-18T15:01:44.570804+0000","last_fullsized":"2024-03-18T15:01:44.570804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.582127+0000","last_change":"2024-03-18T15:01:44.577960+0000","last_active":"2024-03-18T15:01:44.582127+0000","last_peered":"2024-03-18T15:01:44.582127+0000","last_clean":"2024-03-18T15:01:44.582127+0000","last_became_active":"2024-03-18T15:01:44.577693+0000","last_became_peered":"2024-03-18T15:01:44.577693+0000","last_unstale":"2024-03-18T15:01:44.582127+0000","last_undegraded":"2024-03-18T15:01:44.582127+0000","last_fullsized":"2024-03-18T15:01:44.582127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:53:24.880750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595916+0000","last_change":"2024-03-18T15:01:45.593734+0000","last_active":"2024-03-18T15:01:45.595916+0000","last_peered":"2024-03-18T15:01:45.595916+0000","last_clean":"2024-03-18T15:01:45.595916+0000","last_became_active":"2024-03-18T15:01:45.593152+0000","last_became_peered":"2024-03-18T15:01:45.593152+0000","last_unstale":"2024-03-18T15:01:45.595916+0000","last_undegraded":"2024-03-18T15:01:45.595916+0000","last_fullsized":"2024-03-18T15:01:45.595916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:27.745287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584851+0000","last_change":"2024-03-18T15:01:44.581685+0000","last_active":"2024-03-18T15:01:44.584851+0000","last_peered":"2024-03-18T15:01:44.584851+0000","last_clean":"2024-03-18T15:01:44.584851+0000","last_became_active":"2024-03-18T15:01:44.580454+0000","last_became_peered":"2024-03-18T15:01:44.580454+0000","last_unstale":"2024-03-18T15:01:44.584851+0000","last_undegraded":"2024-03-18T15:01:44.584851+0000","last_fullsized":"2024-03-18T15:01:44.584851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:30:26.393760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588258+0000","last_change":"2024-03-18T15:01:45.584816+0000","last_active":"2024-03-18T15:01:45.588258+0000","last_peered":"2024-03-18T15:01:45.588258+0000","last_clean":"2024-03-18T15:01:45.588258+0000","last_became_active":"2024-03-18T15:01:45.584207+0000","last_became_peered":"2024-03-18T15:01:45.584207+0000","last_unstale":"2024-03-18T15:01:45.588258+0000","last_undegraded":"2024-03-18T15:01:45.588258+0000","last_fullsized":"2024-03-18T15:01:45.588258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:34.107092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584869+0000","last_change":"2024-03-18T15:01:44.581724+0000","last_active":"2024-03-18T15:01:44.584869+0000","last_peered":"2024-03-18T15:01:44.584869+0000","last_clean":"2024-03-18T15:01:44.584869+0000","last_became_active":"2024-03-18T15:01:44.581433+0000","last_became_peered":"2024-03-18T15:01:44.581433+0000","last_unstale":"2024-03-18T15:01:44.584869+0000","last_undegraded":"2024-03-18T15:01:44.584869+0000","last_fullsized":"2024-03-18T15:01:44.584869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:32:35.465739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.591216+0000","last_change":"2024-03-18T15:01:45.588729+0000","last_active":"2024-03-18T15:01:45.591216+0000","last_peered":"2024-03-18T15:01:45.591216+0000","last_clean":"2024-03-18T15:01:45.591216+0000","last_became_active":"2024-03-18T15:01:45.588437+0000","last_became_peered":"2024-03-18T15:01:45.588437+0000","last_unstale":"2024-03-18T15:01:45.591216+0000","last_undegraded":"2024-03-18T15:01:45.591216+0000","last_fullsized":"2024-03-18T15:01:45.591216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:35.550334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585440+0000","last_change":"2024-03-18T15:01:45.583341+0000","last_active":"2024-03-18T15:01:45.585440+0000","last_peered":"2024-03-18T15:01:45.585440+0000","last_clean":"2024-03-18T15:01:45.585440+0000","last_became_active":"2024-03-18T15:01:45.581780+0000","last_became_peered":"2024-03-18T15:01:45.581780+0000","last_unstale":"2024-03-18T15:01:45.585440+0000","last_undegraded":"2024-03-18T15:01:45.585440+0000","last_fullsized":"2024-03-18T15:01:45.585440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:00:44.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590297+0000","last_change":"2024-03-18T15:01:44.586298+0000","last_active":"2024-03-18T15:01:44.590297+0000","last_peered":"2024-03-18T15:01:44.590297+0000","last_clean":"2024-03-18T15:01:44.590297+0000","last_became_active":"2024-03-18T15:01:44.586027+0000","last_became_peered":"2024-03-18T15:01:44.586027+0000","last_unstale":"2024-03-18T15:01:44.590297+0000","last_undegraded":"2024-03-18T15:01:44.590297+0000","last_fullsized":"2024-03-18T15:01:44.590297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:20:43.058800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588225+0000","last_change":"2024-03-18T15:01:45.582437+0000","last_active":"2024-03-18T15:01:45.588225+0000","last_peered":"2024-03-18T15:01:45.588225+0000","last_clean":"2024-03-18T15:01:45.588225+0000","last_became_active":"2024-03-18T15:01:45.582184+0000","last_became_peered":"2024-03-18T15:01:45.582184+0000","last_unstale":"2024-03-18T15:01:45.588225+0000","last_undegraded":"2024-03-18T15:01:45.588225+0000","last_fullsized":"2024-03-18T15:01:45.588225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:58.583093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584827+0000","last_change":"2024-03-18T15:01:44.579707+0000","last_active":"2024-03-18T15:01:44.584827+0000","last_peered":"2024-03-18T15:01:44.584827+0000","last_clean":"2024-03-18T15:01:44.584827+0000","last_became_active":"2024-03-18T15:01:44.579403+0000","last_became_peered":"2024-03-18T15:01:44.579403+0000","last_unstale":"2024-03-18T15:01:44.584827+0000","last_undegraded":"2024-03-18T15:01:44.584827+0000","last_fullsized":"2024-03-18T15:01:44.584827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:38:07.748919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574547+0000","last_change":"2024-03-18T15:01:44.574547+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574547+0000","last_undegraded":"2024-03-18T15:01:44.574547+0000","last_fullsized":"2024-03-18T15:01:44.574547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581953+0000","last_change":"2024-03-18T15:01:44.580696+0000","last_active":"2024-03-18T15:01:44.581953+0000","last_peered":"2024-03-18T15:01:44.581953+0000","last_clean":"2024-03-18T15:01:44.581953+0000","last_became_active":"2024-03-18T15:01:44.580427+0000","last_became_peered":"2024-03-18T15:01:44.580427+0000","last_unstale":"2024-03-18T15:01:44.581953+0000","last_undegraded":"2024-03-18T15:01:44.581953+0000","last_fullsized":"2024-03-18T15:01:44.581953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585403+0000","last_change":"2024-03-18T15:01:45.581595+0000","last_active":"2024-03-18T15:01:45.585403+0000","last_peered":"2024-03-18T15:01:45.585403+0000","last_clean":"2024-03-18T15:01:45.585403+0000","last_became_active":"2024-03-18T15:01:45.581349+0000","last_became_peered":"2024-03-18T15:01:45.581349+0000","last_unstale":"2024-03-18T15:01:45.585403+0000","last_undegraded":"2024-03-18T15:01:45.585403+0000","last_fullsized":"2024-03-18T15:01:45.585403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:30.207924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.599364+0000","last_change":"2024-03-18T15:01:44.586423+0000","last_active":"2024-03-18T15:01:45.599364+0000","last_peered":"2024-03-18T15:01:45.599364+0000","last_clean":"2024-03-18T15:01:45.599364+0000","last_became_active":"2024-03-18T15:01:44.586184+0000","last_became_peered":"2024-03-18T15:01:44.586184+0000","last_unstale":"2024-03-18T15:01:45.599364+0000","last_undegraded":"2024-03-18T15:01:45.599364+0000","last_fullsized":"2024-03-18T15:01:45.599364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568072+0000","last_change":"2024-03-18T15:01:44.568072+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568072+0000","last_undegraded":"2024-03-18T15:01:44.568072+0000","last_fullsized":"2024-03-18T15:01:44.568072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578345+0000","last_change":"2024-03-18T15:01:44.582617+0000","last_active":"2024-03-18T15:01:45.578345+0000","last_peered":"2024-03-18T15:01:45.578345+0000","last_clean":"2024-03-18T15:01:45.578345+0000","last_became_active":"2024-03-18T15:01:44.582360+0000","last_became_peered":"2024-03-18T15:01:44.582360+0000","last_unstale":"2024-03-18T15:01:45.578345+0000","last_undegraded":"2024-03-18T15:01:45.578345+0000","last_fullsized":"2024-03-18T15:01:45.578345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:21.996890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572458+0000","last_change":"2024-03-18T15:01:44.572458+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572458+0000","last_undegraded":"2024-03-18T15:01:44.572458+0000","last_fullsized":"2024-03-18T15:01:44.572458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578092+0000","last_change":"2024-03-18T15:01:44.581622+0000","last_active":"2024-03-18T15:01:45.578092+0000","last_peered":"2024-03-18T15:01:45.578092+0000","last_clean":"2024-03-18T15:01:45.578092+0000","last_became_active":"2024-03-18T15:01:44.581349+0000","last_became_peered":"2024-03-18T15:01:44.581349+0000","last_unstale":"2024-03-18T15:01:45.578092+0000","last_undegraded":"2024-03-18T15:01:45.578092+0000","last_fullsized":"2024-03-18T15:01:45.578092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:56.837150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597387+0000","last_change":"2024-03-18T15:01:45.594192+0000","last_active":"2024-03-18T15:01:45.597387+0000","last_peered":"2024-03-18T15:01:45.597387+0000","last_clean":"2024-03-18T15:01:45.597387+0000","last_became_active":"2024-03-18T15:01:45.586383+0000","last_became_peered":"2024-03-18T15:01:45.586383+0000","last_unstale":"2024-03-18T15:01:45.597387+0000","last_undegraded":"2024-03-18T15:01:45.597387+0000","last_fullsized":"2024-03-18T15:01:45.597387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576169+0000","last_change":"2024-03-18T15:01:44.575596+0000","last_active":"2024-03-18T15:01:44.576169+0000","last_peered":"2024-03-18T15:01:44.576169+0000","last_clean":"2024-03-18T15:01:44.576169+0000","last_became_active":"2024-03-18T15:01:44.575268+0000","last_became_peered":"2024-03-18T15:01:44.575268+0000","last_unstale":"2024-03-18T15:01:44.576169+0000","last_undegraded":"2024-03-18T15:01:44.576169+0000","last_fullsized":"2024-03-18T15:01:44.576169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:24:52.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569827+0000","last_change":"2024-03-18T15:01:44.569827+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569827+0000","last_undegraded":"2024-03-18T15:01:44.569827+0000","last_fullsized":"2024-03-18T15:01:44.569827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569177+0000","last_change":"2024-03-18T15:01:44.583590+0000","last_active":"2024-03-18T15:01:45.569177+0000","last_peered":"2024-03-18T15:01:45.569177+0000","last_clean":"2024-03-18T15:01:45.569177+0000","last_became_active":"2024-03-18T15:01:44.583339+0000","last_became_peered":"2024-03-18T15:01:44.583339+0000","last_unstale":"2024-03-18T15:01:45.569177+0000","last_undegraded":"2024-03-18T15:01:45.569177+0000","last_fullsized":"2024-03-18T15:01:45.569177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:48.250219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573669+0000","last_change":"2024-03-18T15:01:44.573669+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573669+0000","last_undegraded":"2024-03-18T15:01:44.573669+0000","last_fullsized":"2024-03-18T15:01:44.573669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.587387+0000","last_change":"2024-03-18T15:01:44.583257+0000","last_active":"2024-03-18T15:01:44.587387+0000","last_peered":"2024-03-18T15:01:44.587387+0000","last_clean":"2024-03-18T15:01:44.587387+0000","last_became_active":"2024-03-18T15:01:44.582921+0000","last_became_peered":"2024-03-18T15:01:44.582921+0000","last_unstale":"2024-03-18T15:01:44.587387+0000","last_undegraded":"2024-03-18T15:01:44.587387+0000","last_fullsized":"2024-03-18T15:01:44.587387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:22:13.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577275+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:01:44.577275+0000","last_peered":"2024-03-18T15:01:44.577275+0000","last_clean":"2024-03-18T15:01:44.577275+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:01:44.577275+0000","last_undegraded":"2024-03-18T15:01:44.577275+0000","last_fullsized":"2024-03-18T15:01:44.577275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":731019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":718935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:48.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.712+0000 7f2fe1012640 1 Processor -- start 2024-03-18T15:01:48.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.712+0000 7f2fe1012640 1 -- start start 2024-03-18T15:01:48.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fe1012640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2fdc15e550 0x7f2fdc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fe1012640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc0cc4b0 con 0x7f2fdc06d870 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fe1012640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2fdc06dcf0 con 0x7f2fdc0cf310 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fe1012640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f2fdc0ccda0 con 0x7f2fdc15e550 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fdb59e640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f2fdc06d870 0x7f2fdc0cd230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52046/0 (socket says 172.21.15.152:52046) 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.713+0000 7f2fdb59e640 1 -- 172.21.15.152:0/1902611108 learned_addr learned my addr 172.21.15.152:0/1902611108 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1823952081 0 0) 0x7f2fdc0cc4b0 con 0x7f2fdc06d870 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdad9d640 1 --2- 172.21.15.152:0/1902611108 >> v2:172.21.15.186:3300/0 conn(0x7f2fdc15e550 0x7f2fdc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2fc4003520 con 0x7f2fdc06d870 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2322049948 0 0) 0x7f2fc4003520 con 0x7f2fdc06d870 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 >> v2:172.21.15.186:3300/0 conn(0x7f2fdc15e550 msgr2=0x7f2fdc06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 --2- 172.21.15.152:0/1902611108 >> v2:172.21.15.186:3300/0 conn(0x7f2fdc15e550 0x7f2fdc06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 >> v1:172.21.15.186:6789/0 conn(0x7f2fdc0cf310 legacy=0x7f2fdc0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc0cc750 con 0x7f2fdc06d870 2024-03-18T15:01:48.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f2fd40019f0 con 0x7f2fdc06d870 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 >> v1:172.21.15.152:6789/0 conn(0x7f2fdc06d870 legacy=0x7f2fdc0cd230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fc4003a20 0x7f2fc4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0ccda0 con 0x7f2fc40051c0 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2fc400c0d0 con 0x7f2fc4004800 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2fc400c2d0 con 0x7f2fc4003a20 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fda59c640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdad9d640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fc4003a20 0x7f2fc4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 -- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fc4003a20 msgr2=0x7f2fc4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fc4003a20 0x7f2fc4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 -- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fc4004800 msgr2=0x7f2fc4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fc4004800 0x7f2fc4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.714+0000 7f2fdb59e640 1 -- 172.21.15.152:0/1902611108 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fc4003520 con 0x7f2fc40051c0 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.715+0000 7f2fdb59e640 1 -- 172.21.15.152:0/1902611108 reap_dead start 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.715+0000 7f2fdb59e640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cc460 tx=0x7f2fc4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce3c92129c61089 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.715+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd400a480 con 0x7f2fc40051c0 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.715+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd4034630 con 0x7f2fc40051c0 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.715+0000 7f2fd9d9b640 1 -- 172.21.15.152:0/1902611108 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd4034a20 con 0x7f2fc40051c0 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 -- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 msgr2=0x7f2fc400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f2fdc0cc460 tx=0x7f2fc4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 -- 172.21.15.152:0/1902611108 shutdown_connections 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 --2- 172.21.15.152:0/1902611108 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fc400b9c0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 -- 172.21.15.152:0/1902611108 >> 172.21.15.152:0/1902611108 conn(0x7f2fdc0d1e60 msgr2=0x7f2fdc0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 -- 172.21.15.152:0/1902611108 shutdown_connections 2024-03-18T15:01:48.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.716+0000 7f2fe1012640 1 -- 172.21.15.152:0/1902611108 wait complete. 2024-03-18T15:01:48.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.717+0000 7f2fe1012640 1 Processor -- start 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.718+0000 7f2fe1012640 1 -- start start 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.718+0000 7f2fe1012640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fdc151c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.718+0000 7f2fe1012640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 0x7f2fdc1f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.718+0000 7f2fe1012640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fdc0c9b90 0x7f2fdc0ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.718+0000 7f2fe1012640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc15e930 con 0x7f2fc40051c0 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fe1012640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f2fdc0aebb0 con 0x7f2fdc0c9b90 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fe1012640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2fdc15eab0 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fdad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fdc151c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 0x7f2fdc1f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fdad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fdc151c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46940/0 (socket says 172.21.15.152:46940) 2024-03-18T15:01:48.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fdad9d640 1 -- 172.21.15.152:0/3781672570 learned_addr learned my addr 172.21.15.152:0/3781672570 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fdb59e640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fdc0c9b90 0x7f2fdc0ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 -- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fdc0c9b90 msgr2=0x7f2fdc0ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fdc0c9b90 0x7f2fdc0ca040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 -- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 msgr2=0x7f2fdc151c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fdc151c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 -- 172.21.15.152:0/3781672570 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fdc1f4930 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.719+0000 7f2fda59c640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 0x7f2fdc1f5220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000f520 tx=0x7f2fd000f920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.720+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd00053a0 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.720+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2fd0018070 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.720+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fdc0c90d0 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.720+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fd0003830 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.720+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fdc0c9690 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.721+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fdc04f5b0 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.721+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f2fd00039d0 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.722+0000 7f2fc37fe640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 0x7f2fc806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.722+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f2fd008a650 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.722+0000 7f2fdad9d640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 0x7f2fc806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:48.725 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.722+0000 7f2fdad9d640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 0x7f2fc806e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009c40 tx=0x7f2fcc009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:48.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.727+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2fd0059140 con 0x7f2fdc1f4dc0 2024-03-18T15:01:48.902 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.902+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2fdc161bc0 con 0x7f2fc806bbd0 2024-03-18T15:01:48.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.908+0000 7f2fc37fe640 1 -- 172.21.15.152:0/3781672570 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247616 (secure 0 0 0) 0x7f2fdc161bc0 con 0x7f2fc806bbd0 2024-03-18T15:01:48.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:48.912 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 msgr2=0x7f2fc806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 0x7f2fc806e090 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2fcc009c40 tx=0x7f2fcc009190 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 msgr2=0x7f2fdc1f5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 0x7f2fdc1f5220 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f2fd000f520 tx=0x7f2fd000f920 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 shutdown_connections 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2fdc0c9b90 0x7f2fdc0ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f2fc806bbd0 0x7f2fc806e090 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f2fdc1f4dc0 0x7f2fdc1f5220 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 --2- 172.21.15.152:0/3781672570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f2fc40051c0 0x7f2fdc151c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:48.914 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.911+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 >> 172.21.15.152:0/3781672570 conn(0x7f2fdc0d1e60 msgr2=0x7f2fdc0ce6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:48.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.912+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 shutdown_connections 2024-03-18T15:01:48.915 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:48.912+0000 7f2fe1012640 1 -- 172.21.15.152:0/3781672570 wait complete. 2024-03-18T15:01:48.923 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-18T15:01:47.815884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224348,"kb_used_data":3988,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750372,"statfs":{"total":773094113280,"available":772864380928,"internally_reserved":0,"allocated":4083712,"data_stored":2289735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.256676"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573049+0000","last_change":"2024-03-18T15:01:44.573049+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573049+0000","last_undegraded":"2024-03-18T15:01:44.573049+0000","last_fullsized":"2024-03-18T15:01:44.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597219+0000","last_change":"2024-03-18T15:01:45.592575+0000","last_active":"2024-03-18T15:01:45.597219+0000","last_peered":"2024-03-18T15:01:45.597219+0000","last_clean":"2024-03-18T15:01:45.597219+0000","last_became_active":"2024-03-18T15:01:45.586032+0000","last_became_peered":"2024-03-18T15:01:45.586032+0000","last_unstale":"2024-03-18T15:01:45.597219+0000","last_undegraded":"2024-03-18T15:01:45.597219+0000","last_fullsized":"2024-03-18T15:01:45.597219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568109+0000","last_change":"2024-03-18T15:01:44.568109+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568109+0000","last_undegraded":"2024-03-18T15:01:44.568109+0000","last_fullsized":"2024-03-18T15:01:44.568109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.593867+0000","last_change":"2024-03-18T15:01:45.587946+0000","last_active":"2024-03-18T15:01:45.593867+0000","last_peered":"2024-03-18T15:01:45.593867+0000","last_clean":"2024-03-18T15:01:45.593867+0000","last_became_active":"2024-03-18T15:01:45.587670+0000","last_became_peered":"2024-03-18T15:01:45.587670+0000","last_unstale":"2024-03-18T15:01:45.593867+0000","last_undegraded":"2024-03-18T15:01:45.593867+0000","last_fullsized":"2024-03-18T15:01:45.593867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:25.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596088+0000","last_change":"2024-03-18T15:01:45.595395+0000","last_active":"2024-03-18T15:01:45.596088+0000","last_peered":"2024-03-18T15:01:45.596088+0000","last_clean":"2024-03-18T15:01:45.596088+0000","last_became_active":"2024-03-18T15:01:45.595169+0000","last_became_peered":"2024-03-18T15:01:45.595169+0000","last_unstale":"2024-03-18T15:01:45.596088+0000","last_undegraded":"2024-03-18T15:01:45.596088+0000","last_fullsized":"2024-03-18T15:01:45.596088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:39.240483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596426+0000","last_change":"2024-03-18T15:01:45.578000+0000","last_active":"2024-03-18T15:01:45.596426+0000","last_peered":"2024-03-18T15:01:45.596426+0000","last_clean":"2024-03-18T15:01:45.596426+0000","last_became_active":"2024-03-18T15:01:45.577724+0000","last_became_peered":"2024-03-18T15:01:45.577724+0000","last_unstale":"2024-03-18T15:01:45.596426+0000","last_undegraded":"2024-03-18T15:01:45.596426+0000","last_fullsized":"2024-03-18T15:01:45.596426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:12.206972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573339+0000","last_change":"2024-03-18T15:01:44.573339+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573339+0000","last_undegraded":"2024-03-18T15:01:44.573339+0000","last_fullsized":"2024-03-18T15:01:44.573339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.577069+0000","last_change":"2024-03-18T15:01:44.577069+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.577069+0000","last_undegraded":"2024-03-18T15:01:44.577069+0000","last_fullsized":"2024-03-18T15:01:44.577069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569073+0000","last_change":"2024-03-18T15:01:44.569073+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569073+0000","last_undegraded":"2024-03-18T15:01:44.569073+0000","last_fullsized":"2024-03-18T15:01:44.569073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.605685+0000","last_change":"2024-03-18T15:01:45.598002+0000","last_active":"2024-03-18T15:01:45.605685+0000","last_peered":"2024-03-18T15:01:45.605685+0000","last_clean":"2024-03-18T15:01:45.605685+0000","last_became_active":"2024-03-18T15:01:45.597734+0000","last_became_peered":"2024-03-18T15:01:45.597734+0000","last_unstale":"2024-03-18T15:01:45.605685+0000","last_undegraded":"2024-03-18T15:01:45.605685+0000","last_fullsized":"2024-03-18T15:01:45.605685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:27.068270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.576702+0000","last_change":"2024-03-18T15:01:44.576702+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.576702+0000","last_undegraded":"2024-03-18T15:01:44.576702+0000","last_fullsized":"2024-03-18T15:01:44.576702+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572384+0000","last_change":"2024-03-18T15:01:44.572384+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572384+0000","last_undegraded":"2024-03-18T15:01:44.572384+0000","last_fullsized":"2024-03-18T15:01:44.572384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585461+0000","last_change":"2024-03-18T15:01:45.583364+0000","last_active":"2024-03-18T15:01:45.585461+0000","last_peered":"2024-03-18T15:01:45.585461+0000","last_clean":"2024-03-18T15:01:45.585461+0000","last_became_active":"2024-03-18T15:01:45.582846+0000","last_became_peered":"2024-03-18T15:01:45.582846+0000","last_unstale":"2024-03-18T15:01:45.585461+0000","last_undegraded":"2024-03-18T15:01:45.585461+0000","last_fullsized":"2024-03-18T15:01:45.585461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:54:18.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596569+0000","last_change":"2024-03-18T15:01:45.581704+0000","last_active":"2024-03-18T15:01:45.596569+0000","last_peered":"2024-03-18T15:01:45.596569+0000","last_clean":"2024-03-18T15:01:45.596569+0000","last_became_active":"2024-03-18T15:01:45.581288+0000","last_became_peered":"2024-03-18T15:01:45.581288+0000","last_unstale":"2024-03-18T15:01:45.596569+0000","last_undegraded":"2024-03-18T15:01:45.596569+0000","last_fullsized":"2024-03-18T15:01:45.596569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:31.840893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569048+0000","last_change":"2024-03-18T15:01:44.569048+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569048+0000","last_undegraded":"2024-03-18T15:01:44.569048+0000","last_fullsized":"2024-03-18T15:01:44.569048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574131+0000","last_change":"2024-03-18T15:01:44.574131+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574131+0000","last_undegraded":"2024-03-18T15:01:44.574131+0000","last_fullsized":"2024-03-18T15:01:44.574131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573363+0000","last_change":"2024-03-18T15:01:44.573363+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573363+0000","last_undegraded":"2024-03-18T15:01:44.573363+0000","last_fullsized":"2024-03-18T15:01:44.573363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597291+0000","last_change":"2024-03-18T15:01:45.593046+0000","last_active":"2024-03-18T15:01:45.597291+0000","last_peered":"2024-03-18T15:01:45.597291+0000","last_clean":"2024-03-18T15:01:45.597291+0000","last_became_active":"2024-03-18T15:01:45.592791+0000","last_became_peered":"2024-03-18T15:01:45.592791+0000","last_unstale":"2024-03-18T15:01:45.597291+0000","last_undegraded":"2024-03-18T15:01:45.597291+0000","last_fullsized":"2024-03-18T15:01:45.597291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597370+0000","last_change":"2024-03-18T15:01:45.586629+0000","last_active":"2024-03-18T15:01:45.597370+0000","last_peered":"2024-03-18T15:01:45.597370+0000","last_clean":"2024-03-18T15:01:45.597370+0000","last_became_active":"2024-03-18T15:01:45.586335+0000","last_became_peered":"2024-03-18T15:01:45.586335+0000","last_unstale":"2024-03-18T15:01:45.597370+0000","last_undegraded":"2024-03-18T15:01:45.597370+0000","last_fullsized":"2024-03-18T15:01:45.597370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585516+0000","last_change":"2024-03-18T15:01:45.584429+0000","last_active":"2024-03-18T15:01:45.585516+0000","last_peered":"2024-03-18T15:01:45.585516+0000","last_clean":"2024-03-18T15:01:45.585516+0000","last_became_active":"2024-03-18T15:01:45.584158+0000","last_became_peered":"2024-03-18T15:01:45.584158+0000","last_unstale":"2024-03-18T15:01:45.585516+0000","last_undegraded":"2024-03-18T15:01:45.585516+0000","last_fullsized":"2024-03-18T15:01:45.585516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:25.504474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571378+0000","last_change":"2024-03-18T15:01:44.571378+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571378+0000","last_undegraded":"2024-03-18T15:01:44.571378+0000","last_fullsized":"2024-03-18T15:01:44.571378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569942+0000","last_change":"2024-03-18T15:01:44.569942+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569942+0000","last_undegraded":"2024-03-18T15:01:44.569942+0000","last_fullsized":"2024-03-18T15:01:44.569942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.567982+0000","last_change":"2024-03-18T15:01:44.567982+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.567982+0000","last_undegraded":"2024-03-18T15:01:44.567982+0000","last_fullsized":"2024-03-18T15:01:44.567982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585519+0000","last_change":"2024-03-18T15:01:45.583520+0000","last_active":"2024-03-18T15:01:45.585519+0000","last_peered":"2024-03-18T15:01:45.585519+0000","last_clean":"2024-03-18T15:01:45.585519+0000","last_became_active":"2024-03-18T15:01:45.583058+0000","last_became_peered":"2024-03-18T15:01:45.583058+0000","last_unstale":"2024-03-18T15:01:45.585519+0000","last_undegraded":"2024-03-18T15:01:45.585519+0000","last_fullsized":"2024-03-18T15:01:45.585519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:31:11.337881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596707+0000","last_change":"2024-03-18T15:01:45.581296+0000","last_active":"2024-03-18T15:01:45.596707+0000","last_peered":"2024-03-18T15:01:45.596707+0000","last_clean":"2024-03-18T15:01:45.596707+0000","last_became_active":"2024-03-18T15:01:45.581030+0000","last_became_peered":"2024-03-18T15:01:45.581030+0000","last_unstale":"2024-03-18T15:01:45.596707+0000","last_undegraded":"2024-03-18T15:01:45.596707+0000","last_fullsized":"2024-03-18T15:01:45.596707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:38:24.924212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595701+0000","last_change":"2024-03-18T15:01:45.593019+0000","last_active":"2024-03-18T15:01:45.595701+0000","last_peered":"2024-03-18T15:01:45.595701+0000","last_clean":"2024-03-18T15:01:45.595701+0000","last_became_active":"2024-03-18T15:01:45.592763+0000","last_became_peered":"2024-03-18T15:01:45.592763+0000","last_unstale":"2024-03-18T15:01:45.595701+0000","last_undegraded":"2024-03-18T15:01:45.595701+0000","last_fullsized":"2024-03-18T15:01:45.595701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:49.252348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569511+0000","last_change":"2024-03-18T15:01:44.569511+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569511+0000","last_undegraded":"2024-03-18T15:01:44.569511+0000","last_fullsized":"2024-03-18T15:01:44.569511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570921+0000","last_change":"2024-03-18T15:01:44.570921+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570921+0000","last_undegraded":"2024-03-18T15:01:44.570921+0000","last_fullsized":"2024-03-18T15:01:44.570921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574928+0000","last_change":"2024-03-18T15:01:44.574928+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574928+0000","last_undegraded":"2024-03-18T15:01:44.574928+0000","last_fullsized":"2024-03-18T15:01:44.574928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572711+0000","last_change":"2024-03-18T15:01:44.572711+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572711+0000","last_undegraded":"2024-03-18T15:01:44.572711+0000","last_fullsized":"2024-03-18T15:01:44.572711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575900+0000","last_change":"2024-03-18T15:01:44.575900+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575900+0000","last_undegraded":"2024-03-18T15:01:44.575900+0000","last_fullsized":"2024-03-18T15:01:44.575900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581654+0000","last_change":"2024-03-18T15:01:44.579276+0000","last_active":"2024-03-18T15:01:44.581654+0000","last_peered":"2024-03-18T15:01:44.581654+0000","last_clean":"2024-03-18T15:01:44.581654+0000","last_became_active":"2024-03-18T15:01:44.578958+0000","last_became_peered":"2024-03-18T15:01:44.578958+0000","last_unstale":"2024-03-18T15:01:44.581654+0000","last_undegraded":"2024-03-18T15:01:44.581654+0000","last_fullsized":"2024-03-18T15:01:44.581654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:40.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571575+0000","last_change":"2024-03-18T15:01:44.571575+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571575+0000","last_undegraded":"2024-03-18T15:01:44.571575+0000","last_fullsized":"2024-03-18T15:01:44.571575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570211+0000","last_change":"2024-03-18T15:01:44.570211+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570211+0000","last_undegraded":"2024-03-18T15:01:44.570211+0000","last_fullsized":"2024-03-18T15:01:44.570211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596755+0000","last_change":"2024-03-18T15:01:44.590824+0000","last_active":"2024-03-18T15:01:45.596755+0000","last_peered":"2024-03-18T15:01:45.596755+0000","last_clean":"2024-03-18T15:01:45.596755+0000","last_became_active":"2024-03-18T15:01:44.590495+0000","last_became_peered":"2024-03-18T15:01:44.590495+0000","last_unstale":"2024-03-18T15:01:45.596755+0000","last_undegraded":"2024-03-18T15:01:45.596755+0000","last_fullsized":"2024-03-18T15:01:45.596755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:03.804170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595667+0000","last_change":"2024-03-18T15:01:45.592391+0000","last_active":"2024-03-18T15:01:45.595667+0000","last_peered":"2024-03-18T15:01:45.595667+0000","last_clean":"2024-03-18T15:01:45.595667+0000","last_became_active":"2024-03-18T15:01:45.592134+0000","last_became_peered":"2024-03-18T15:01:45.592134+0000","last_unstale":"2024-03-18T15:01:45.595667+0000","last_undegraded":"2024-03-18T15:01:45.595667+0000","last_fullsized":"2024-03-18T15:01:45.595667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:17.013483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.583480+0000","last_change":"2024-03-18T15:01:44.582771+0000","last_active":"2024-03-18T15:01:45.583480+0000","last_peered":"2024-03-18T15:01:45.583480+0000","last_clean":"2024-03-18T15:01:45.583480+0000","last_became_active":"2024-03-18T15:01:44.582504+0000","last_became_peered":"2024-03-18T15:01:44.582504+0000","last_unstale":"2024-03-18T15:01:45.583480+0000","last_undegraded":"2024-03-18T15:01:45.583480+0000","last_fullsized":"2024-03-18T15:01:45.583480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:57.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574390+0000","last_change":"2024-03-18T15:01:44.574390+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574390+0000","last_undegraded":"2024-03-18T15:01:44.574390+0000","last_fullsized":"2024-03-18T15:01:44.574390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590485+0000","last_change":"2024-03-18T15:01:44.585074+0000","last_active":"2024-03-18T15:01:44.590485+0000","last_peered":"2024-03-18T15:01:44.590485+0000","last_clean":"2024-03-18T15:01:44.590485+0000","last_became_active":"2024-03-18T15:01:44.584724+0000","last_became_peered":"2024-03-18T15:01:44.584724+0000","last_unstale":"2024-03-18T15:01:44.590485+0000","last_undegraded":"2024-03-18T15:01:44.590485+0000","last_fullsized":"2024-03-18T15:01:44.590485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:42.564122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569108+0000","last_change":"2024-03-18T15:01:44.569108+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569108+0000","last_undegraded":"2024-03-18T15:01:44.569108+0000","last_fullsized":"2024-03-18T15:01:44.569108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584819+0000","last_change":"2024-03-18T15:01:44.581419+0000","last_active":"2024-03-18T15:01:44.584819+0000","last_peered":"2024-03-18T15:01:44.584819+0000","last_clean":"2024-03-18T15:01:44.584819+0000","last_became_active":"2024-03-18T15:01:44.580982+0000","last_became_peered":"2024-03-18T15:01:44.580982+0000","last_unstale":"2024-03-18T15:01:44.584819+0000","last_undegraded":"2024-03-18T15:01:44.584819+0000","last_fullsized":"2024-03-18T15:01:44.584819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:56:27.790579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569439+0000","last_change":"2024-03-18T15:01:44.569439+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569439+0000","last_undegraded":"2024-03-18T15:01:44.569439+0000","last_fullsized":"2024-03-18T15:01:44.569439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.567995+0000","last_change":"2024-03-18T15:01:44.583187+0000","last_active":"2024-03-18T15:01:45.567995+0000","last_peered":"2024-03-18T15:01:45.567995+0000","last_clean":"2024-03-18T15:01:45.567995+0000","last_became_active":"2024-03-18T15:01:44.582915+0000","last_became_peered":"2024-03-18T15:01:44.582915+0000","last_unstale":"2024-03-18T15:01:45.567995+0000","last_undegraded":"2024-03-18T15:01:45.567995+0000","last_fullsized":"2024-03-18T15:01:45.567995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595035+0000","last_change":"2024-03-18T15:01:45.591499+0000","last_active":"2024-03-18T15:01:45.595035+0000","last_peered":"2024-03-18T15:01:45.595035+0000","last_clean":"2024-03-18T15:01:45.595035+0000","last_became_active":"2024-03-18T15:01:45.591017+0000","last_became_peered":"2024-03-18T15:01:45.591017+0000","last_unstale":"2024-03-18T15:01:45.595035+0000","last_undegraded":"2024-03-18T15:01:45.595035+0000","last_fullsized":"2024-03-18T15:01:45.595035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:25.128904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577572+0000","last_change":"2024-03-18T15:01:44.576918+0000","last_active":"2024-03-18T15:01:44.577572+0000","last_peered":"2024-03-18T15:01:44.577572+0000","last_clean":"2024-03-18T15:01:44.577572+0000","last_became_active":"2024-03-18T15:01:44.576614+0000","last_became_peered":"2024-03-18T15:01:44.576614+0000","last_unstale":"2024-03-18T15:01:44.577572+0000","last_undegraded":"2024-03-18T15:01:44.577572+0000","last_fullsized":"2024-03-18T15:01:44.577572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:52.851001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569291+0000","last_change":"2024-03-18T15:01:44.569291+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569291+0000","last_undegraded":"2024-03-18T15:01:44.569291+0000","last_fullsized":"2024-03-18T15:01:44.569291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569820+0000","last_change":"2024-03-18T15:01:44.582920+0000","last_active":"2024-03-18T15:01:45.569820+0000","last_peered":"2024-03-18T15:01:45.569820+0000","last_clean":"2024-03-18T15:01:45.569820+0000","last_became_active":"2024-03-18T15:01:44.582314+0000","last_became_peered":"2024-03-18T15:01:44.582314+0000","last_unstale":"2024-03-18T15:01:45.569820+0000","last_undegraded":"2024-03-18T15:01:45.569820+0000","last_fullsized":"2024-03-18T15:01:45.569820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:26.066141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597238+0000","last_change":"2024-03-18T15:01:45.592592+0000","last_active":"2024-03-18T15:01:45.597238+0000","last_peered":"2024-03-18T15:01:45.597238+0000","last_clean":"2024-03-18T15:01:45.597238+0000","last_became_active":"2024-03-18T15:01:45.592306+0000","last_became_peered":"2024-03-18T15:01:45.592306+0000","last_unstale":"2024-03-18T15:01:45.597238+0000","last_undegraded":"2024-03-18T15:01:45.597238+0000","last_fullsized":"2024-03-18T15:01:45.597238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597532+0000","last_change":"2024-03-18T15:01:45.583531+0000","last_active":"2024-03-18T15:01:45.597532+0000","last_peered":"2024-03-18T15:01:45.597532+0000","last_clean":"2024-03-18T15:01:45.597532+0000","last_became_active":"2024-03-18T15:01:45.583282+0000","last_became_peered":"2024-03-18T15:01:45.583282+0000","last_unstale":"2024-03-18T15:01:45.597532+0000","last_undegraded":"2024-03-18T15:01:45.597532+0000","last_fullsized":"2024-03-18T15:01:45.597532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:15:21.257890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584775+0000","last_change":"2024-03-18T15:01:44.581812+0000","last_active":"2024-03-18T15:01:44.584775+0000","last_peered":"2024-03-18T15:01:44.584775+0000","last_clean":"2024-03-18T15:01:44.584775+0000","last_became_active":"2024-03-18T15:01:44.581380+0000","last_became_peered":"2024-03-18T15:01:44.581380+0000","last_unstale":"2024-03-18T15:01:44.584775+0000","last_undegraded":"2024-03-18T15:01:44.584775+0000","last_fullsized":"2024-03-18T15:01:44.584775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568590+0000","last_change":"2024-03-18T15:01:44.568590+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568590+0000","last_undegraded":"2024-03-18T15:01:44.568590+0000","last_fullsized":"2024-03-18T15:01:44.568590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.607177+0000","last_change":"2024-03-18T15:01:44.590920+0000","last_active":"2024-03-18T15:01:45.607177+0000","last_peered":"2024-03-18T15:01:45.607177+0000","last_clean":"2024-03-18T15:01:45.607177+0000","last_became_active":"2024-03-18T15:01:44.590650+0000","last_became_peered":"2024-03-18T15:01:44.590650+0000","last_unstale":"2024-03-18T15:01:45.607177+0000","last_undegraded":"2024-03-18T15:01:45.607177+0000","last_fullsized":"2024-03-18T15:01:45.607177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:26.743158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595114+0000","last_change":"2024-03-18T15:01:45.591643+0000","last_active":"2024-03-18T15:01:45.595114+0000","last_peered":"2024-03-18T15:01:45.595114+0000","last_clean":"2024-03-18T15:01:45.595114+0000","last_became_active":"2024-03-18T15:01:45.591094+0000","last_became_peered":"2024-03-18T15:01:45.591094+0000","last_unstale":"2024-03-18T15:01:45.595114+0000","last_undegraded":"2024-03-18T15:01:45.595114+0000","last_fullsized":"2024-03-18T15:01:45.595114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:04.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576742+0000","last_change":"2024-03-18T15:01:44.575992+0000","last_active":"2024-03-18T15:01:44.576742+0000","last_peered":"2024-03-18T15:01:44.576742+0000","last_clean":"2024-03-18T15:01:44.576742+0000","last_became_active":"2024-03-18T15:01:44.575239+0000","last_became_peered":"2024-03-18T15:01:44.575239+0000","last_unstale":"2024-03-18T15:01:44.576742+0000","last_undegraded":"2024-03-18T15:01:44.576742+0000","last_fullsized":"2024-03-18T15:01:44.576742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:59:37.202070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597457+0000","last_change":"2024-03-18T15:01:45.586654+0000","last_active":"2024-03-18T15:01:45.597457+0000","last_peered":"2024-03-18T15:01:45.597457+0000","last_clean":"2024-03-18T15:01:45.597457+0000","last_became_active":"2024-03-18T15:01:45.586351+0000","last_became_peered":"2024-03-18T15:01:45.586351+0000","last_unstale":"2024-03-18T15:01:45.597457+0000","last_undegraded":"2024-03-18T15:01:45.597457+0000","last_fullsized":"2024-03-18T15:01:45.597457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.577947+0000","last_change":"2024-03-18T15:01:44.583555+0000","last_active":"2024-03-18T15:01:45.577947+0000","last_peered":"2024-03-18T15:01:45.577947+0000","last_clean":"2024-03-18T15:01:45.577947+0000","last_became_active":"2024-03-18T15:01:44.583318+0000","last_became_peered":"2024-03-18T15:01:44.583318+0000","last_unstale":"2024-03-18T15:01:45.577947+0000","last_undegraded":"2024-03-18T15:01:45.577947+0000","last_fullsized":"2024-03-18T15:01:45.577947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:05.767566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575481+0000","last_change":"2024-03-18T15:01:44.575481+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575481+0000","last_undegraded":"2024-03-18T15:01:44.575481+0000","last_fullsized":"2024-03-18T15:01:44.575481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.568017+0000","last_change":"2024-03-18T15:01:44.584486+0000","last_active":"2024-03-18T15:01:45.568017+0000","last_peered":"2024-03-18T15:01:45.568017+0000","last_clean":"2024-03-18T15:01:45.568017+0000","last_became_active":"2024-03-18T15:01:44.583996+0000","last_became_peered":"2024-03-18T15:01:44.583996+0000","last_unstale":"2024-03-18T15:01:45.568017+0000","last_undegraded":"2024-03-18T15:01:45.568017+0000","last_fullsized":"2024-03-18T15:01:45.568017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:24.126775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571710+0000","last_change":"2024-03-18T15:01:44.571710+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571710+0000","last_undegraded":"2024-03-18T15:01:44.571710+0000","last_fullsized":"2024-03-18T15:01:44.571710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597289+0000","last_change":"2024-03-18T15:01:44.591019+0000","last_active":"2024-03-18T15:01:45.597289+0000","last_peered":"2024-03-18T15:01:45.597289+0000","last_clean":"2024-03-18T15:01:45.597289+0000","last_became_active":"2024-03-18T15:01:44.590748+0000","last_became_peered":"2024-03-18T15:01:44.590748+0000","last_unstale":"2024-03-18T15:01:45.597289+0000","last_undegraded":"2024-03-18T15:01:45.597289+0000","last_fullsized":"2024-03-18T15:01:45.597289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:16.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570596+0000","last_change":"2024-03-18T15:01:44.570596+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570596+0000","last_undegraded":"2024-03-18T15:01:44.570596+0000","last_fullsized":"2024-03-18T15:01:44.570596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597685+0000","last_change":"2024-03-18T15:01:44.586226+0000","last_active":"2024-03-18T15:01:45.597685+0000","last_peered":"2024-03-18T15:01:45.597685+0000","last_clean":"2024-03-18T15:01:45.597685+0000","last_became_active":"2024-03-18T15:01:44.585825+0000","last_became_peered":"2024-03-18T15:01:44.585825+0000","last_unstale":"2024-03-18T15:01:45.597685+0000","last_undegraded":"2024-03-18T15:01:45.597685+0000","last_fullsized":"2024-03-18T15:01:45.597685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570804+0000","last_change":"2024-03-18T15:01:44.570804+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570804+0000","last_undegraded":"2024-03-18T15:01:44.570804+0000","last_fullsized":"2024-03-18T15:01:44.570804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.582127+0000","last_change":"2024-03-18T15:01:44.577960+0000","last_active":"2024-03-18T15:01:44.582127+0000","last_peered":"2024-03-18T15:01:44.582127+0000","last_clean":"2024-03-18T15:01:44.582127+0000","last_became_active":"2024-03-18T15:01:44.577693+0000","last_became_peered":"2024-03-18T15:01:44.577693+0000","last_unstale":"2024-03-18T15:01:44.582127+0000","last_undegraded":"2024-03-18T15:01:44.582127+0000","last_fullsized":"2024-03-18T15:01:44.582127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:53:24.880750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595916+0000","last_change":"2024-03-18T15:01:45.593734+0000","last_active":"2024-03-18T15:01:45.595916+0000","last_peered":"2024-03-18T15:01:45.595916+0000","last_clean":"2024-03-18T15:01:45.595916+0000","last_became_active":"2024-03-18T15:01:45.593152+0000","last_became_peered":"2024-03-18T15:01:45.593152+0000","last_unstale":"2024-03-18T15:01:45.595916+0000","last_undegraded":"2024-03-18T15:01:45.595916+0000","last_fullsized":"2024-03-18T15:01:45.595916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:27.745287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584851+0000","last_change":"2024-03-18T15:01:44.581685+0000","last_active":"2024-03-18T15:01:44.584851+0000","last_peered":"2024-03-18T15:01:44.584851+0000","last_clean":"2024-03-18T15:01:44.584851+0000","last_became_active":"2024-03-18T15:01:44.580454+0000","last_became_peered":"2024-03-18T15:01:44.580454+0000","last_unstale":"2024-03-18T15:01:44.584851+0000","last_undegraded":"2024-03-18T15:01:44.584851+0000","last_fullsized":"2024-03-18T15:01:44.584851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:30:26.393760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588258+0000","last_change":"2024-03-18T15:01:45.584816+0000","last_active":"2024-03-18T15:01:45.588258+0000","last_peered":"2024-03-18T15:01:45.588258+0000","last_clean":"2024-03-18T15:01:45.588258+0000","last_became_active":"2024-03-18T15:01:45.584207+0000","last_became_peered":"2024-03-18T15:01:45.584207+0000","last_unstale":"2024-03-18T15:01:45.588258+0000","last_undegraded":"2024-03-18T15:01:45.588258+0000","last_fullsized":"2024-03-18T15:01:45.588258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:34.107092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584869+0000","last_change":"2024-03-18T15:01:44.581724+0000","last_active":"2024-03-18T15:01:44.584869+0000","last_peered":"2024-03-18T15:01:44.584869+0000","last_clean":"2024-03-18T15:01:44.584869+0000","last_became_active":"2024-03-18T15:01:44.581433+0000","last_became_peered":"2024-03-18T15:01:44.581433+0000","last_unstale":"2024-03-18T15:01:44.584869+0000","last_undegraded":"2024-03-18T15:01:44.584869+0000","last_fullsized":"2024-03-18T15:01:44.584869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:32:35.465739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.591216+0000","last_change":"2024-03-18T15:01:45.588729+0000","last_active":"2024-03-18T15:01:45.591216+0000","last_peered":"2024-03-18T15:01:45.591216+0000","last_clean":"2024-03-18T15:01:45.591216+0000","last_became_active":"2024-03-18T15:01:45.588437+0000","last_became_peered":"2024-03-18T15:01:45.588437+0000","last_unstale":"2024-03-18T15:01:45.591216+0000","last_undegraded":"2024-03-18T15:01:45.591216+0000","last_fullsized":"2024-03-18T15:01:45.591216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:35.550334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585440+0000","last_change":"2024-03-18T15:01:45.583341+0000","last_active":"2024-03-18T15:01:45.585440+0000","last_peered":"2024-03-18T15:01:45.585440+0000","last_clean":"2024-03-18T15:01:45.585440+0000","last_became_active":"2024-03-18T15:01:45.581780+0000","last_became_peered":"2024-03-18T15:01:45.581780+0000","last_unstale":"2024-03-18T15:01:45.585440+0000","last_undegraded":"2024-03-18T15:01:45.585440+0000","last_fullsized":"2024-03-18T15:01:45.585440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:00:44.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590297+0000","last_change":"2024-03-18T15:01:44.586298+0000","last_active":"2024-03-18T15:01:44.590297+0000","last_peered":"2024-03-18T15:01:44.590297+0000","last_clean":"2024-03-18T15:01:44.590297+0000","last_became_active":"2024-03-18T15:01:44.586027+0000","last_became_peered":"2024-03-18T15:01:44.586027+0000","last_unstale":"2024-03-18T15:01:44.590297+0000","last_undegraded":"2024-03-18T15:01:44.590297+0000","last_fullsized":"2024-03-18T15:01:44.590297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:20:43.058800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588225+0000","last_change":"2024-03-18T15:01:45.582437+0000","last_active":"2024-03-18T15:01:45.588225+0000","last_peered":"2024-03-18T15:01:45.588225+0000","last_clean":"2024-03-18T15:01:45.588225+0000","last_became_active":"2024-03-18T15:01:45.582184+0000","last_became_peered":"2024-03-18T15:01:45.582184+0000","last_unstale":"2024-03-18T15:01:45.588225+0000","last_undegraded":"2024-03-18T15:01:45.588225+0000","last_fullsized":"2024-03-18T15:01:45.588225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:58.583093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584827+0000","last_change":"2024-03-18T15:01:44.579707+0000","last_active":"2024-03-18T15:01:44.584827+0000","last_peered":"2024-03-18T15:01:44.584827+0000","last_clean":"2024-03-18T15:01:44.584827+0000","last_became_active":"2024-03-18T15:01:44.579403+0000","last_became_peered":"2024-03-18T15:01:44.579403+0000","last_unstale":"2024-03-18T15:01:44.584827+0000","last_undegraded":"2024-03-18T15:01:44.584827+0000","last_fullsized":"2024-03-18T15:01:44.584827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:38:07.748919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574547+0000","last_change":"2024-03-18T15:01:44.574547+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574547+0000","last_undegraded":"2024-03-18T15:01:44.574547+0000","last_fullsized":"2024-03-18T15:01:44.574547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581953+0000","last_change":"2024-03-18T15:01:44.580696+0000","last_active":"2024-03-18T15:01:44.581953+0000","last_peered":"2024-03-18T15:01:44.581953+0000","last_clean":"2024-03-18T15:01:44.581953+0000","last_became_active":"2024-03-18T15:01:44.580427+0000","last_became_peered":"2024-03-18T15:01:44.580427+0000","last_unstale":"2024-03-18T15:01:44.581953+0000","last_undegraded":"2024-03-18T15:01:44.581953+0000","last_fullsized":"2024-03-18T15:01:44.581953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585403+0000","last_change":"2024-03-18T15:01:45.581595+0000","last_active":"2024-03-18T15:01:45.585403+0000","last_peered":"2024-03-18T15:01:45.585403+0000","last_clean":"2024-03-18T15:01:45.585403+0000","last_became_active":"2024-03-18T15:01:45.581349+0000","last_became_peered":"2024-03-18T15:01:45.581349+0000","last_unstale":"2024-03-18T15:01:45.585403+0000","last_undegraded":"2024-03-18T15:01:45.585403+0000","last_fullsized":"2024-03-18T15:01:45.585403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:30.207924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.599364+0000","last_change":"2024-03-18T15:01:44.586423+0000","last_active":"2024-03-18T15:01:45.599364+0000","last_peered":"2024-03-18T15:01:45.599364+0000","last_clean":"2024-03-18T15:01:45.599364+0000","last_became_active":"2024-03-18T15:01:44.586184+0000","last_became_peered":"2024-03-18T15:01:44.586184+0000","last_unstale":"2024-03-18T15:01:45.599364+0000","last_undegraded":"2024-03-18T15:01:45.599364+0000","last_fullsized":"2024-03-18T15:01:45.599364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568072+0000","last_change":"2024-03-18T15:01:44.568072+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568072+0000","last_undegraded":"2024-03-18T15:01:44.568072+0000","last_fullsized":"2024-03-18T15:01:44.568072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578345+0000","last_change":"2024-03-18T15:01:44.582617+0000","last_active":"2024-03-18T15:01:45.578345+0000","last_peered":"2024-03-18T15:01:45.578345+0000","last_clean":"2024-03-18T15:01:45.578345+0000","last_became_active":"2024-03-18T15:01:44.582360+0000","last_became_peered":"2024-03-18T15:01:44.582360+0000","last_unstale":"2024-03-18T15:01:45.578345+0000","last_undegraded":"2024-03-18T15:01:45.578345+0000","last_fullsized":"2024-03-18T15:01:45.578345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:21.996890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572458+0000","last_change":"2024-03-18T15:01:44.572458+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572458+0000","last_undegraded":"2024-03-18T15:01:44.572458+0000","last_fullsized":"2024-03-18T15:01:44.572458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578092+0000","last_change":"2024-03-18T15:01:44.581622+0000","last_active":"2024-03-18T15:01:45.578092+0000","last_peered":"2024-03-18T15:01:45.578092+0000","last_clean":"2024-03-18T15:01:45.578092+0000","last_became_active":"2024-03-18T15:01:44.581349+0000","last_became_peered":"2024-03-18T15:01:44.581349+0000","last_unstale":"2024-03-18T15:01:45.578092+0000","last_undegraded":"2024-03-18T15:01:45.578092+0000","last_fullsized":"2024-03-18T15:01:45.578092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:56.837150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597387+0000","last_change":"2024-03-18T15:01:45.594192+0000","last_active":"2024-03-18T15:01:45.597387+0000","last_peered":"2024-03-18T15:01:45.597387+0000","last_clean":"2024-03-18T15:01:45.597387+0000","last_became_active":"2024-03-18T15:01:45.586383+0000","last_became_peered":"2024-03-18T15:01:45.586383+0000","last_unstale":"2024-03-18T15:01:45.597387+0000","last_undegraded":"2024-03-18T15:01:45.597387+0000","last_fullsized":"2024-03-18T15:01:45.597387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576169+0000","last_change":"2024-03-18T15:01:44.575596+0000","last_active":"2024-03-18T15:01:44.576169+0000","last_peered":"2024-03-18T15:01:44.576169+0000","last_clean":"2024-03-18T15:01:44.576169+0000","last_became_active":"2024-03-18T15:01:44.575268+0000","last_became_peered":"2024-03-18T15:01:44.575268+0000","last_unstale":"2024-03-18T15:01:44.576169+0000","last_undegraded":"2024-03-18T15:01:44.576169+0000","last_fullsized":"2024-03-18T15:01:44.576169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:24:52.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569827+0000","last_change":"2024-03-18T15:01:44.569827+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569827+0000","last_undegraded":"2024-03-18T15:01:44.569827+0000","last_fullsized":"2024-03-18T15:01:44.569827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569177+0000","last_change":"2024-03-18T15:01:44.583590+0000","last_active":"2024-03-18T15:01:45.569177+0000","last_peered":"2024-03-18T15:01:45.569177+0000","last_clean":"2024-03-18T15:01:45.569177+0000","last_became_active":"2024-03-18T15:01:44.583339+0000","last_became_peered":"2024-03-18T15:01:44.583339+0000","last_unstale":"2024-03-18T15:01:45.569177+0000","last_undegraded":"2024-03-18T15:01:45.569177+0000","last_fullsized":"2024-03-18T15:01:45.569177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:48.250219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573669+0000","last_change":"2024-03-18T15:01:44.573669+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573669+0000","last_undegraded":"2024-03-18T15:01:44.573669+0000","last_fullsized":"2024-03-18T15:01:44.573669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.587387+0000","last_change":"2024-03-18T15:01:44.583257+0000","last_active":"2024-03-18T15:01:44.587387+0000","last_peered":"2024-03-18T15:01:44.587387+0000","last_clean":"2024-03-18T15:01:44.587387+0000","last_became_active":"2024-03-18T15:01:44.582921+0000","last_became_peered":"2024-03-18T15:01:44.582921+0000","last_unstale":"2024-03-18T15:01:44.587387+0000","last_undegraded":"2024-03-18T15:01:44.587387+0000","last_fullsized":"2024-03-18T15:01:44.587387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:22:13.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577275+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:01:44.577275+0000","last_peered":"2024-03-18T15:01:44.577275+0000","last_clean":"2024-03-18T15:01:44.577275+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:01:44.577275+0000","last_undegraded":"2024-03-18T15:01:44.577275+0000","last_fullsized":"2024-03-18T15:01:44.577275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":731019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":718935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:48.927 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:48.950 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:01:48.950+0000 7f66609a5640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-03-18T15:01:49.051 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.051+0000 7f24a4fc6640 1 Processor -- start 2024-03-18T15:01:49.052 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.051+0000 7f24a4fc6640 1 -- start start 2024-03-18T15:01:49.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f24a4fc6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24a015ad40 0x7f24a00ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.053 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f24a4fc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 0x7f24a00722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f24a4fc6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f24a015ee60 con 0x7f24a00b3400 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f24a4fc6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f24a015f140 con 0x7f24a015ad40 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f24a4fc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f24a015f420 con 0x7f24a00d07f0 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249e59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f24a015ad40 0x7f24a00ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f2497fff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f24a00b3400 0x7f24a00d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52050/0 (socket says 172.21.15.152:52050) 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f2497fff640 1 -- 172.21.15.152:0/370738889 learned_addr learned my addr 172.21.15.152:0/370738889 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249ed9d640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 0x7f24a00722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249e59c640 1 -- 172.21.15.152:0/370738889 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 msgr2=0x7f24a00722c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249e59c640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 0x7f24a00722c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249e59c640 1 -- 172.21.15.152:0/370738889 >> v1:172.21.15.152:6789/0 conn(0x7f24a00b3400 legacy=0x7f24a00d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.054 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249e59c640 1 -- 172.21.15.152:0/370738889 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a015f700 con 0x7f24a015ad40 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249dd9b640 1 -- 172.21.15.152:0/370738889 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2564185131 0 0) 0x7f24a015ee60 con 0x7f24a00b3400 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.052+0000 7f249ed9d640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 0x7f24a00722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.053+0000 7f249e59c640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a015ad40 0x7f24a00ad800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f24900097a0 tx=0x7f249002b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5bde8a5d6f54ba9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.053+0000 7f249dd9b640 1 -- 172.21.15.152:0/370738889 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490031780 con 0x7f24a015ad40 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.053+0000 7f249dd9b640 1 -- 172.21.15.152:0/370738889 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2490037070 con 0x7f24a015ad40 2024-03-18T15:01:49.055 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.053+0000 7f249dd9b640 1 -- 172.21.15.152:0/370738889 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490031b40 con 0x7f24a015ad40 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 -- 172.21.15.152:0/370738889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a015ad40 msgr2=0x7f24a00ad800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a015ad40 0x7f24a00ad800 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f24900097a0 tx=0x7f249002b820 comp rx=0 tx=0).stop 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 -- 172.21.15.152:0/370738889 shutdown_connections 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a00d07f0 0x7f24a00722c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/370738889 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a015ad40 0x7f24a00ad800 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 -- 172.21.15.152:0/370738889 >> 172.21.15.152:0/370738889 conn(0x7f24a006b5e0 msgr2=0x7f24a006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 -- 172.21.15.152:0/370738889 shutdown_connections 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.054+0000 7f24a4fc6640 1 -- 172.21.15.152:0/370738889 wait complete. 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.055+0000 7f24a4fc6640 1 Processor -- start 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.055+0000 7f24a4fc6640 1 -- start start 2024-03-18T15:01:49.058 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24a00d07f0 0x7f24a006cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a015ad40 0x7f24a006d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f24a015eb90 con 0x7f24a00b3400 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f24a015ea10 con 0x7f24a00d07f0 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f24a4fc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f24a00b3860 con 0x7f24a015ad40 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46948/0 (socket says 172.21.15.152:46948) 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 -- 172.21.15.152:0/1970248258 learned_addr learned my addr 172.21.15.152:0/1970248258 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249ed9d640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a015ad40 0x7f24a006d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f2497fff640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24a00d07f0 0x7f24a006cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 -- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a015ad40 msgr2=0x7f24a006d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a015ad40 0x7f24a006d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 -- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24a00d07f0 msgr2=0x7f24a006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.059 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24a00d07f0 0x7f24a006cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 -- 172.21.15.152:0/1970248258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24a00afa00 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.056+0000 7f249e59c640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f24900098c0 tx=0x7f24900046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.057+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490032820 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.057+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f24900329e0 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.057+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2490032dd0 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.057+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f24a00afce0 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.057+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24a00b02a0 con 0x7f24a00b3400 2024-03-18T15:01:49.060 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.058+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24a0159b80 con 0x7f24a00b3400 2024-03-18T15:01:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.058+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f249004e440 con 0x7f24a00b3400 2024-03-18T15:01:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.059+0000 7f2496ffd640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 0x7f248006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.059+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f24900ac860 con 0x7f24a00b3400 2024-03-18T15:01:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.059+0000 7f2497fff640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 0x7f248006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.061 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.059+0000 7f2497fff640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 0x7f248006e090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b2cb0 tx=0x7f2488007b50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.063 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.063+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f24a0159b80 con 0x7f24a00b3400 2024-03-18T15:01:49.238 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.238+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f24a004f5b0 con 0x7f248006bbd0 2024-03-18T15:01:49.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.244+0000 7f2496ffd640 1 -- 172.21.15.152:0/1970248258 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247616 (secure 0 0 0) 0x7f24a004f5b0 con 0x7f248006bbd0 2024-03-18T15:01:49.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:49.248 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 msgr2=0x7f248006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 0x7f248006e090 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f24a00b2cb0 tx=0x7f2488007b50 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 msgr2=0x7f24a00ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f24900098c0 tx=0x7f24900046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 shutdown_connections 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f248006bbd0 0x7f248006e090 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f24a015ad40 0x7f24a006d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f24a00d07f0 0x7f24a006cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 --2- 172.21.15.152:0/1970248258 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f24a00b3400 0x7f24a00ceaf0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 >> 172.21.15.152:0/1970248258 conn(0x7f24a006b5e0 msgr2=0x7f24a015bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 shutdown_connections 2024-03-18T15:01:49.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.247+0000 7f24a4fc6640 1 -- 172.21.15.152:0/1970248258 wait complete. 2024-03-18T15:01:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":65,"stamp":"2024-03-18T15:01:47.815884+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":187,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":138,"ondisk_log_size":138,"up":176,"acting":176,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":14,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224348,"kb_used_data":3988,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750372,"statfs":{"total":773094113280,"available":772864380928,"internally_reserved":0,"allocated":4083712,"data_stored":2289735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.256676"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573049+0000","last_change":"2024-03-18T15:01:44.573049+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573049+0000","last_undegraded":"2024-03-18T15:01:44.573049+0000","last_fullsized":"2024-03-18T15:01:44.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597219+0000","last_change":"2024-03-18T15:01:45.592575+0000","last_active":"2024-03-18T15:01:45.597219+0000","last_peered":"2024-03-18T15:01:45.597219+0000","last_clean":"2024-03-18T15:01:45.597219+0000","last_became_active":"2024-03-18T15:01:45.586032+0000","last_became_peered":"2024-03-18T15:01:45.586032+0000","last_unstale":"2024-03-18T15:01:45.597219+0000","last_undegraded":"2024-03-18T15:01:45.597219+0000","last_fullsized":"2024-03-18T15:01:45.597219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568109+0000","last_change":"2024-03-18T15:01:44.568109+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568109+0000","last_undegraded":"2024-03-18T15:01:44.568109+0000","last_fullsized":"2024-03-18T15:01:44.568109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.593867+0000","last_change":"2024-03-18T15:01:45.587946+0000","last_active":"2024-03-18T15:01:45.593867+0000","last_peered":"2024-03-18T15:01:45.593867+0000","last_clean":"2024-03-18T15:01:45.593867+0000","last_became_active":"2024-03-18T15:01:45.587670+0000","last_became_peered":"2024-03-18T15:01:45.587670+0000","last_unstale":"2024-03-18T15:01:45.593867+0000","last_undegraded":"2024-03-18T15:01:45.593867+0000","last_fullsized":"2024-03-18T15:01:45.593867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:25.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596088+0000","last_change":"2024-03-18T15:01:45.595395+0000","last_active":"2024-03-18T15:01:45.596088+0000","last_peered":"2024-03-18T15:01:45.596088+0000","last_clean":"2024-03-18T15:01:45.596088+0000","last_became_active":"2024-03-18T15:01:45.595169+0000","last_became_peered":"2024-03-18T15:01:45.595169+0000","last_unstale":"2024-03-18T15:01:45.596088+0000","last_undegraded":"2024-03-18T15:01:45.596088+0000","last_fullsized":"2024-03-18T15:01:45.596088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:39.240483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596426+0000","last_change":"2024-03-18T15:01:45.578000+0000","last_active":"2024-03-18T15:01:45.596426+0000","last_peered":"2024-03-18T15:01:45.596426+0000","last_clean":"2024-03-18T15:01:45.596426+0000","last_became_active":"2024-03-18T15:01:45.577724+0000","last_became_peered":"2024-03-18T15:01:45.577724+0000","last_unstale":"2024-03-18T15:01:45.596426+0000","last_undegraded":"2024-03-18T15:01:45.596426+0000","last_fullsized":"2024-03-18T15:01:45.596426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:12.206972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573339+0000","last_change":"2024-03-18T15:01:44.573339+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573339+0000","last_undegraded":"2024-03-18T15:01:44.573339+0000","last_fullsized":"2024-03-18T15:01:44.573339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.577069+0000","last_change":"2024-03-18T15:01:44.577069+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.577069+0000","last_undegraded":"2024-03-18T15:01:44.577069+0000","last_fullsized":"2024-03-18T15:01:44.577069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569073+0000","last_change":"2024-03-18T15:01:44.569073+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569073+0000","last_undegraded":"2024-03-18T15:01:44.569073+0000","last_fullsized":"2024-03-18T15:01:44.569073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.605685+0000","last_change":"2024-03-18T15:01:45.598002+0000","last_active":"2024-03-18T15:01:45.605685+0000","last_peered":"2024-03-18T15:01:45.605685+0000","last_clean":"2024-03-18T15:01:45.605685+0000","last_became_active":"2024-03-18T15:01:45.597734+0000","last_became_peered":"2024-03-18T15:01:45.597734+0000","last_unstale":"2024-03-18T15:01:45.605685+0000","last_undegraded":"2024-03-18T15:01:45.605685+0000","last_fullsized":"2024-03-18T15:01:45.605685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:27.068270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.576702+0000","last_change":"2024-03-18T15:01:44.576702+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.576702+0000","last_undegraded":"2024-03-18T15:01:44.576702+0000","last_fullsized":"2024-03-18T15:01:44.576702+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572384+0000","last_change":"2024-03-18T15:01:44.572384+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572384+0000","last_undegraded":"2024-03-18T15:01:44.572384+0000","last_fullsized":"2024-03-18T15:01:44.572384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585461+0000","last_change":"2024-03-18T15:01:45.583364+0000","last_active":"2024-03-18T15:01:45.585461+0000","last_peered":"2024-03-18T15:01:45.585461+0000","last_clean":"2024-03-18T15:01:45.585461+0000","last_became_active":"2024-03-18T15:01:45.582846+0000","last_became_peered":"2024-03-18T15:01:45.582846+0000","last_unstale":"2024-03-18T15:01:45.585461+0000","last_undegraded":"2024-03-18T15:01:45.585461+0000","last_fullsized":"2024-03-18T15:01:45.585461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:54:18.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596569+0000","last_change":"2024-03-18T15:01:45.581704+0000","last_active":"2024-03-18T15:01:45.596569+0000","last_peered":"2024-03-18T15:01:45.596569+0000","last_clean":"2024-03-18T15:01:45.596569+0000","last_became_active":"2024-03-18T15:01:45.581288+0000","last_became_peered":"2024-03-18T15:01:45.581288+0000","last_unstale":"2024-03-18T15:01:45.596569+0000","last_undegraded":"2024-03-18T15:01:45.596569+0000","last_fullsized":"2024-03-18T15:01:45.596569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:31.840893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569048+0000","last_change":"2024-03-18T15:01:44.569048+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569048+0000","last_undegraded":"2024-03-18T15:01:44.569048+0000","last_fullsized":"2024-03-18T15:01:44.569048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574131+0000","last_change":"2024-03-18T15:01:44.574131+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574131+0000","last_undegraded":"2024-03-18T15:01:44.574131+0000","last_fullsized":"2024-03-18T15:01:44.574131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573363+0000","last_change":"2024-03-18T15:01:44.573363+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573363+0000","last_undegraded":"2024-03-18T15:01:44.573363+0000","last_fullsized":"2024-03-18T15:01:44.573363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597291+0000","last_change":"2024-03-18T15:01:45.593046+0000","last_active":"2024-03-18T15:01:45.597291+0000","last_peered":"2024-03-18T15:01:45.597291+0000","last_clean":"2024-03-18T15:01:45.597291+0000","last_became_active":"2024-03-18T15:01:45.592791+0000","last_became_peered":"2024-03-18T15:01:45.592791+0000","last_unstale":"2024-03-18T15:01:45.597291+0000","last_undegraded":"2024-03-18T15:01:45.597291+0000","last_fullsized":"2024-03-18T15:01:45.597291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597370+0000","last_change":"2024-03-18T15:01:45.586629+0000","last_active":"2024-03-18T15:01:45.597370+0000","last_peered":"2024-03-18T15:01:45.597370+0000","last_clean":"2024-03-18T15:01:45.597370+0000","last_became_active":"2024-03-18T15:01:45.586335+0000","last_became_peered":"2024-03-18T15:01:45.586335+0000","last_unstale":"2024-03-18T15:01:45.597370+0000","last_undegraded":"2024-03-18T15:01:45.597370+0000","last_fullsized":"2024-03-18T15:01:45.597370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585516+0000","last_change":"2024-03-18T15:01:45.584429+0000","last_active":"2024-03-18T15:01:45.585516+0000","last_peered":"2024-03-18T15:01:45.585516+0000","last_clean":"2024-03-18T15:01:45.585516+0000","last_became_active":"2024-03-18T15:01:45.584158+0000","last_became_peered":"2024-03-18T15:01:45.584158+0000","last_unstale":"2024-03-18T15:01:45.585516+0000","last_undegraded":"2024-03-18T15:01:45.585516+0000","last_fullsized":"2024-03-18T15:01:45.585516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:25.504474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571378+0000","last_change":"2024-03-18T15:01:44.571378+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571378+0000","last_undegraded":"2024-03-18T15:01:44.571378+0000","last_fullsized":"2024-03-18T15:01:44.571378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569942+0000","last_change":"2024-03-18T15:01:44.569942+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569942+0000","last_undegraded":"2024-03-18T15:01:44.569942+0000","last_fullsized":"2024-03-18T15:01:44.569942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.567982+0000","last_change":"2024-03-18T15:01:44.567982+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.567982+0000","last_undegraded":"2024-03-18T15:01:44.567982+0000","last_fullsized":"2024-03-18T15:01:44.567982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585519+0000","last_change":"2024-03-18T15:01:45.583520+0000","last_active":"2024-03-18T15:01:45.585519+0000","last_peered":"2024-03-18T15:01:45.585519+0000","last_clean":"2024-03-18T15:01:45.585519+0000","last_became_active":"2024-03-18T15:01:45.583058+0000","last_became_peered":"2024-03-18T15:01:45.583058+0000","last_unstale":"2024-03-18T15:01:45.585519+0000","last_undegraded":"2024-03-18T15:01:45.585519+0000","last_fullsized":"2024-03-18T15:01:45.585519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:31:11.337881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596707+0000","last_change":"2024-03-18T15:01:45.581296+0000","last_active":"2024-03-18T15:01:45.596707+0000","last_peered":"2024-03-18T15:01:45.596707+0000","last_clean":"2024-03-18T15:01:45.596707+0000","last_became_active":"2024-03-18T15:01:45.581030+0000","last_became_peered":"2024-03-18T15:01:45.581030+0000","last_unstale":"2024-03-18T15:01:45.596707+0000","last_undegraded":"2024-03-18T15:01:45.596707+0000","last_fullsized":"2024-03-18T15:01:45.596707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:38:24.924212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595701+0000","last_change":"2024-03-18T15:01:45.593019+0000","last_active":"2024-03-18T15:01:45.595701+0000","last_peered":"2024-03-18T15:01:45.595701+0000","last_clean":"2024-03-18T15:01:45.595701+0000","last_became_active":"2024-03-18T15:01:45.592763+0000","last_became_peered":"2024-03-18T15:01:45.592763+0000","last_unstale":"2024-03-18T15:01:45.595701+0000","last_undegraded":"2024-03-18T15:01:45.595701+0000","last_fullsized":"2024-03-18T15:01:45.595701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:49.252348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569511+0000","last_change":"2024-03-18T15:01:44.569511+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569511+0000","last_undegraded":"2024-03-18T15:01:44.569511+0000","last_fullsized":"2024-03-18T15:01:44.569511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570921+0000","last_change":"2024-03-18T15:01:44.570921+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570921+0000","last_undegraded":"2024-03-18T15:01:44.570921+0000","last_fullsized":"2024-03-18T15:01:44.570921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574928+0000","last_change":"2024-03-18T15:01:44.574928+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574928+0000","last_undegraded":"2024-03-18T15:01:44.574928+0000","last_fullsized":"2024-03-18T15:01:44.574928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572711+0000","last_change":"2024-03-18T15:01:44.572711+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572711+0000","last_undegraded":"2024-03-18T15:01:44.572711+0000","last_fullsized":"2024-03-18T15:01:44.572711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575900+0000","last_change":"2024-03-18T15:01:44.575900+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575900+0000","last_undegraded":"2024-03-18T15:01:44.575900+0000","last_fullsized":"2024-03-18T15:01:44.575900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581654+0000","last_change":"2024-03-18T15:01:44.579276+0000","last_active":"2024-03-18T15:01:44.581654+0000","last_peered":"2024-03-18T15:01:44.581654+0000","last_clean":"2024-03-18T15:01:44.581654+0000","last_became_active":"2024-03-18T15:01:44.578958+0000","last_became_peered":"2024-03-18T15:01:44.578958+0000","last_unstale":"2024-03-18T15:01:44.581654+0000","last_undegraded":"2024-03-18T15:01:44.581654+0000","last_fullsized":"2024-03-18T15:01:44.581654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:40.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571575+0000","last_change":"2024-03-18T15:01:44.571575+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571575+0000","last_undegraded":"2024-03-18T15:01:44.571575+0000","last_fullsized":"2024-03-18T15:01:44.571575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570211+0000","last_change":"2024-03-18T15:01:44.570211+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570211+0000","last_undegraded":"2024-03-18T15:01:44.570211+0000","last_fullsized":"2024-03-18T15:01:44.570211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596755+0000","last_change":"2024-03-18T15:01:44.590824+0000","last_active":"2024-03-18T15:01:45.596755+0000","last_peered":"2024-03-18T15:01:45.596755+0000","last_clean":"2024-03-18T15:01:45.596755+0000","last_became_active":"2024-03-18T15:01:44.590495+0000","last_became_peered":"2024-03-18T15:01:44.590495+0000","last_unstale":"2024-03-18T15:01:45.596755+0000","last_undegraded":"2024-03-18T15:01:45.596755+0000","last_fullsized":"2024-03-18T15:01:45.596755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:03.804170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595667+0000","last_change":"2024-03-18T15:01:45.592391+0000","last_active":"2024-03-18T15:01:45.595667+0000","last_peered":"2024-03-18T15:01:45.595667+0000","last_clean":"2024-03-18T15:01:45.595667+0000","last_became_active":"2024-03-18T15:01:45.592134+0000","last_became_peered":"2024-03-18T15:01:45.592134+0000","last_unstale":"2024-03-18T15:01:45.595667+0000","last_undegraded":"2024-03-18T15:01:45.595667+0000","last_fullsized":"2024-03-18T15:01:45.595667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:17.013483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.583480+0000","last_change":"2024-03-18T15:01:44.582771+0000","last_active":"2024-03-18T15:01:45.583480+0000","last_peered":"2024-03-18T15:01:45.583480+0000","last_clean":"2024-03-18T15:01:45.583480+0000","last_became_active":"2024-03-18T15:01:44.582504+0000","last_became_peered":"2024-03-18T15:01:44.582504+0000","last_unstale":"2024-03-18T15:01:45.583480+0000","last_undegraded":"2024-03-18T15:01:45.583480+0000","last_fullsized":"2024-03-18T15:01:45.583480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:57.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574390+0000","last_change":"2024-03-18T15:01:44.574390+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574390+0000","last_undegraded":"2024-03-18T15:01:44.574390+0000","last_fullsized":"2024-03-18T15:01:44.574390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590485+0000","last_change":"2024-03-18T15:01:44.585074+0000","last_active":"2024-03-18T15:01:44.590485+0000","last_peered":"2024-03-18T15:01:44.590485+0000","last_clean":"2024-03-18T15:01:44.590485+0000","last_became_active":"2024-03-18T15:01:44.584724+0000","last_became_peered":"2024-03-18T15:01:44.584724+0000","last_unstale":"2024-03-18T15:01:44.590485+0000","last_undegraded":"2024-03-18T15:01:44.590485+0000","last_fullsized":"2024-03-18T15:01:44.590485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:42.564122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569108+0000","last_change":"2024-03-18T15:01:44.569108+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569108+0000","last_undegraded":"2024-03-18T15:01:44.569108+0000","last_fullsized":"2024-03-18T15:01:44.569108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584819+0000","last_change":"2024-03-18T15:01:44.581419+0000","last_active":"2024-03-18T15:01:44.584819+0000","last_peered":"2024-03-18T15:01:44.584819+0000","last_clean":"2024-03-18T15:01:44.584819+0000","last_became_active":"2024-03-18T15:01:44.580982+0000","last_became_peered":"2024-03-18T15:01:44.580982+0000","last_unstale":"2024-03-18T15:01:44.584819+0000","last_undegraded":"2024-03-18T15:01:44.584819+0000","last_fullsized":"2024-03-18T15:01:44.584819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:56:27.790579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569439+0000","last_change":"2024-03-18T15:01:44.569439+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569439+0000","last_undegraded":"2024-03-18T15:01:44.569439+0000","last_fullsized":"2024-03-18T15:01:44.569439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.567995+0000","last_change":"2024-03-18T15:01:44.583187+0000","last_active":"2024-03-18T15:01:45.567995+0000","last_peered":"2024-03-18T15:01:45.567995+0000","last_clean":"2024-03-18T15:01:45.567995+0000","last_became_active":"2024-03-18T15:01:44.582915+0000","last_became_peered":"2024-03-18T15:01:44.582915+0000","last_unstale":"2024-03-18T15:01:45.567995+0000","last_undegraded":"2024-03-18T15:01:45.567995+0000","last_fullsized":"2024-03-18T15:01:45.567995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595035+0000","last_change":"2024-03-18T15:01:45.591499+0000","last_active":"2024-03-18T15:01:45.595035+0000","last_peered":"2024-03-18T15:01:45.595035+0000","last_clean":"2024-03-18T15:01:45.595035+0000","last_became_active":"2024-03-18T15:01:45.591017+0000","last_became_peered":"2024-03-18T15:01:45.591017+0000","last_unstale":"2024-03-18T15:01:45.595035+0000","last_undegraded":"2024-03-18T15:01:45.595035+0000","last_fullsized":"2024-03-18T15:01:45.595035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:25.128904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577572+0000","last_change":"2024-03-18T15:01:44.576918+0000","last_active":"2024-03-18T15:01:44.577572+0000","last_peered":"2024-03-18T15:01:44.577572+0000","last_clean":"2024-03-18T15:01:44.577572+0000","last_became_active":"2024-03-18T15:01:44.576614+0000","last_became_peered":"2024-03-18T15:01:44.576614+0000","last_unstale":"2024-03-18T15:01:44.577572+0000","last_undegraded":"2024-03-18T15:01:44.577572+0000","last_fullsized":"2024-03-18T15:01:44.577572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:52.851001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569291+0000","last_change":"2024-03-18T15:01:44.569291+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569291+0000","last_undegraded":"2024-03-18T15:01:44.569291+0000","last_fullsized":"2024-03-18T15:01:44.569291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569820+0000","last_change":"2024-03-18T15:01:44.582920+0000","last_active":"2024-03-18T15:01:45.569820+0000","last_peered":"2024-03-18T15:01:45.569820+0000","last_clean":"2024-03-18T15:01:45.569820+0000","last_became_active":"2024-03-18T15:01:44.582314+0000","last_became_peered":"2024-03-18T15:01:44.582314+0000","last_unstale":"2024-03-18T15:01:45.569820+0000","last_undegraded":"2024-03-18T15:01:45.569820+0000","last_fullsized":"2024-03-18T15:01:45.569820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:26.066141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597238+0000","last_change":"2024-03-18T15:01:45.592592+0000","last_active":"2024-03-18T15:01:45.597238+0000","last_peered":"2024-03-18T15:01:45.597238+0000","last_clean":"2024-03-18T15:01:45.597238+0000","last_became_active":"2024-03-18T15:01:45.592306+0000","last_became_peered":"2024-03-18T15:01:45.592306+0000","last_unstale":"2024-03-18T15:01:45.597238+0000","last_undegraded":"2024-03-18T15:01:45.597238+0000","last_fullsized":"2024-03-18T15:01:45.597238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597532+0000","last_change":"2024-03-18T15:01:45.583531+0000","last_active":"2024-03-18T15:01:45.597532+0000","last_peered":"2024-03-18T15:01:45.597532+0000","last_clean":"2024-03-18T15:01:45.597532+0000","last_became_active":"2024-03-18T15:01:45.583282+0000","last_became_peered":"2024-03-18T15:01:45.583282+0000","last_unstale":"2024-03-18T15:01:45.597532+0000","last_undegraded":"2024-03-18T15:01:45.597532+0000","last_fullsized":"2024-03-18T15:01:45.597532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:15:21.257890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584775+0000","last_change":"2024-03-18T15:01:44.581812+0000","last_active":"2024-03-18T15:01:44.584775+0000","last_peered":"2024-03-18T15:01:44.584775+0000","last_clean":"2024-03-18T15:01:44.584775+0000","last_became_active":"2024-03-18T15:01:44.581380+0000","last_became_peered":"2024-03-18T15:01:44.581380+0000","last_unstale":"2024-03-18T15:01:44.584775+0000","last_undegraded":"2024-03-18T15:01:44.584775+0000","last_fullsized":"2024-03-18T15:01:44.584775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568590+0000","last_change":"2024-03-18T15:01:44.568590+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568590+0000","last_undegraded":"2024-03-18T15:01:44.568590+0000","last_fullsized":"2024-03-18T15:01:44.568590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.607177+0000","last_change":"2024-03-18T15:01:44.590920+0000","last_active":"2024-03-18T15:01:45.607177+0000","last_peered":"2024-03-18T15:01:45.607177+0000","last_clean":"2024-03-18T15:01:45.607177+0000","last_became_active":"2024-03-18T15:01:44.590650+0000","last_became_peered":"2024-03-18T15:01:44.590650+0000","last_unstale":"2024-03-18T15:01:45.607177+0000","last_undegraded":"2024-03-18T15:01:45.607177+0000","last_fullsized":"2024-03-18T15:01:45.607177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:26.743158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595114+0000","last_change":"2024-03-18T15:01:45.591643+0000","last_active":"2024-03-18T15:01:45.595114+0000","last_peered":"2024-03-18T15:01:45.595114+0000","last_clean":"2024-03-18T15:01:45.595114+0000","last_became_active":"2024-03-18T15:01:45.591094+0000","last_became_peered":"2024-03-18T15:01:45.591094+0000","last_unstale":"2024-03-18T15:01:45.595114+0000","last_undegraded":"2024-03-18T15:01:45.595114+0000","last_fullsized":"2024-03-18T15:01:45.595114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:04.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576742+0000","last_change":"2024-03-18T15:01:44.575992+0000","last_active":"2024-03-18T15:01:44.576742+0000","last_peered":"2024-03-18T15:01:44.576742+0000","last_clean":"2024-03-18T15:01:44.576742+0000","last_became_active":"2024-03-18T15:01:44.575239+0000","last_became_peered":"2024-03-18T15:01:44.575239+0000","last_unstale":"2024-03-18T15:01:44.576742+0000","last_undegraded":"2024-03-18T15:01:44.576742+0000","last_fullsized":"2024-03-18T15:01:44.576742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:59:37.202070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597457+0000","last_change":"2024-03-18T15:01:45.586654+0000","last_active":"2024-03-18T15:01:45.597457+0000","last_peered":"2024-03-18T15:01:45.597457+0000","last_clean":"2024-03-18T15:01:45.597457+0000","last_became_active":"2024-03-18T15:01:45.586351+0000","last_became_peered":"2024-03-18T15:01:45.586351+0000","last_unstale":"2024-03-18T15:01:45.597457+0000","last_undegraded":"2024-03-18T15:01:45.597457+0000","last_fullsized":"2024-03-18T15:01:45.597457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.577947+0000","last_change":"2024-03-18T15:01:44.583555+0000","last_active":"2024-03-18T15:01:45.577947+0000","last_peered":"2024-03-18T15:01:45.577947+0000","last_clean":"2024-03-18T15:01:45.577947+0000","last_became_active":"2024-03-18T15:01:44.583318+0000","last_became_peered":"2024-03-18T15:01:44.583318+0000","last_unstale":"2024-03-18T15:01:45.577947+0000","last_undegraded":"2024-03-18T15:01:45.577947+0000","last_fullsized":"2024-03-18T15:01:45.577947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:05.767566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575481+0000","last_change":"2024-03-18T15:01:44.575481+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575481+0000","last_undegraded":"2024-03-18T15:01:44.575481+0000","last_fullsized":"2024-03-18T15:01:44.575481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.568017+0000","last_change":"2024-03-18T15:01:44.584486+0000","last_active":"2024-03-18T15:01:45.568017+0000","last_peered":"2024-03-18T15:01:45.568017+0000","last_clean":"2024-03-18T15:01:45.568017+0000","last_became_active":"2024-03-18T15:01:44.583996+0000","last_became_peered":"2024-03-18T15:01:44.583996+0000","last_unstale":"2024-03-18T15:01:45.568017+0000","last_undegraded":"2024-03-18T15:01:45.568017+0000","last_fullsized":"2024-03-18T15:01:45.568017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:24.126775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571710+0000","last_change":"2024-03-18T15:01:44.571710+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571710+0000","last_undegraded":"2024-03-18T15:01:44.571710+0000","last_fullsized":"2024-03-18T15:01:44.571710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597289+0000","last_change":"2024-03-18T15:01:44.591019+0000","last_active":"2024-03-18T15:01:45.597289+0000","last_peered":"2024-03-18T15:01:45.597289+0000","last_clean":"2024-03-18T15:01:45.597289+0000","last_became_active":"2024-03-18T15:01:44.590748+0000","last_became_peered":"2024-03-18T15:01:44.590748+0000","last_unstale":"2024-03-18T15:01:45.597289+0000","last_undegraded":"2024-03-18T15:01:45.597289+0000","last_fullsized":"2024-03-18T15:01:45.597289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:16.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570596+0000","last_change":"2024-03-18T15:01:44.570596+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570596+0000","last_undegraded":"2024-03-18T15:01:44.570596+0000","last_fullsized":"2024-03-18T15:01:44.570596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597685+0000","last_change":"2024-03-18T15:01:44.586226+0000","last_active":"2024-03-18T15:01:45.597685+0000","last_peered":"2024-03-18T15:01:45.597685+0000","last_clean":"2024-03-18T15:01:45.597685+0000","last_became_active":"2024-03-18T15:01:44.585825+0000","last_became_peered":"2024-03-18T15:01:44.585825+0000","last_unstale":"2024-03-18T15:01:45.597685+0000","last_undegraded":"2024-03-18T15:01:45.597685+0000","last_fullsized":"2024-03-18T15:01:45.597685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570804+0000","last_change":"2024-03-18T15:01:44.570804+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570804+0000","last_undegraded":"2024-03-18T15:01:44.570804+0000","last_fullsized":"2024-03-18T15:01:44.570804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.582127+0000","last_change":"2024-03-18T15:01:44.577960+0000","last_active":"2024-03-18T15:01:44.582127+0000","last_peered":"2024-03-18T15:01:44.582127+0000","last_clean":"2024-03-18T15:01:44.582127+0000","last_became_active":"2024-03-18T15:01:44.577693+0000","last_became_peered":"2024-03-18T15:01:44.577693+0000","last_unstale":"2024-03-18T15:01:44.582127+0000","last_undegraded":"2024-03-18T15:01:44.582127+0000","last_fullsized":"2024-03-18T15:01:44.582127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:53:24.880750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595916+0000","last_change":"2024-03-18T15:01:45.593734+0000","last_active":"2024-03-18T15:01:45.595916+0000","last_peered":"2024-03-18T15:01:45.595916+0000","last_clean":"2024-03-18T15:01:45.595916+0000","last_became_active":"2024-03-18T15:01:45.593152+0000","last_became_peered":"2024-03-18T15:01:45.593152+0000","last_unstale":"2024-03-18T15:01:45.595916+0000","last_undegraded":"2024-03-18T15:01:45.595916+0000","last_fullsized":"2024-03-18T15:01:45.595916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:27.745287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584851+0000","last_change":"2024-03-18T15:01:44.581685+0000","last_active":"2024-03-18T15:01:44.584851+0000","last_peered":"2024-03-18T15:01:44.584851+0000","last_clean":"2024-03-18T15:01:44.584851+0000","last_became_active":"2024-03-18T15:01:44.580454+0000","last_became_peered":"2024-03-18T15:01:44.580454+0000","last_unstale":"2024-03-18T15:01:44.584851+0000","last_undegraded":"2024-03-18T15:01:44.584851+0000","last_fullsized":"2024-03-18T15:01:44.584851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:30:26.393760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588258+0000","last_change":"2024-03-18T15:01:45.584816+0000","last_active":"2024-03-18T15:01:45.588258+0000","last_peered":"2024-03-18T15:01:45.588258+0000","last_clean":"2024-03-18T15:01:45.588258+0000","last_became_active":"2024-03-18T15:01:45.584207+0000","last_became_peered":"2024-03-18T15:01:45.584207+0000","last_unstale":"2024-03-18T15:01:45.588258+0000","last_undegraded":"2024-03-18T15:01:45.588258+0000","last_fullsized":"2024-03-18T15:01:45.588258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:34.107092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584869+0000","last_change":"2024-03-18T15:01:44.581724+0000","last_active":"2024-03-18T15:01:44.584869+0000","last_peered":"2024-03-18T15:01:44.584869+0000","last_clean":"2024-03-18T15:01:44.584869+0000","last_became_active":"2024-03-18T15:01:44.581433+0000","last_became_peered":"2024-03-18T15:01:44.581433+0000","last_unstale":"2024-03-18T15:01:44.584869+0000","last_undegraded":"2024-03-18T15:01:44.584869+0000","last_fullsized":"2024-03-18T15:01:44.584869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:32:35.465739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.591216+0000","last_change":"2024-03-18T15:01:45.588729+0000","last_active":"2024-03-18T15:01:45.591216+0000","last_peered":"2024-03-18T15:01:45.591216+0000","last_clean":"2024-03-18T15:01:45.591216+0000","last_became_active":"2024-03-18T15:01:45.588437+0000","last_became_peered":"2024-03-18T15:01:45.588437+0000","last_unstale":"2024-03-18T15:01:45.591216+0000","last_undegraded":"2024-03-18T15:01:45.591216+0000","last_fullsized":"2024-03-18T15:01:45.591216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:35.550334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585440+0000","last_change":"2024-03-18T15:01:45.583341+0000","last_active":"2024-03-18T15:01:45.585440+0000","last_peered":"2024-03-18T15:01:45.585440+0000","last_clean":"2024-03-18T15:01:45.585440+0000","last_became_active":"2024-03-18T15:01:45.581780+0000","last_became_peered":"2024-03-18T15:01:45.581780+0000","last_unstale":"2024-03-18T15:01:45.585440+0000","last_undegraded":"2024-03-18T15:01:45.585440+0000","last_fullsized":"2024-03-18T15:01:45.585440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:00:44.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590297+0000","last_change":"2024-03-18T15:01:44.586298+0000","last_active":"2024-03-18T15:01:44.590297+0000","last_peered":"2024-03-18T15:01:44.590297+0000","last_clean":"2024-03-18T15:01:44.590297+0000","last_became_active":"2024-03-18T15:01:44.586027+0000","last_became_peered":"2024-03-18T15:01:44.586027+0000","last_unstale":"2024-03-18T15:01:44.590297+0000","last_undegraded":"2024-03-18T15:01:44.590297+0000","last_fullsized":"2024-03-18T15:01:44.590297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:20:43.058800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588225+0000","last_change":"2024-03-18T15:01:45.582437+0000","last_active":"2024-03-18T15:01:45.588225+0000","last_peered":"2024-03-18T15:01:45.588225+0000","last_clean":"2024-03-18T15:01:45.588225+0000","last_became_active":"2024-03-18T15:01:45.582184+0000","last_became_peered":"2024-03-18T15:01:45.582184+0000","last_unstale":"2024-03-18T15:01:45.588225+0000","last_undegraded":"2024-03-18T15:01:45.588225+0000","last_fullsized":"2024-03-18T15:01:45.588225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:58.583093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584827+0000","last_change":"2024-03-18T15:01:44.579707+0000","last_active":"2024-03-18T15:01:44.584827+0000","last_peered":"2024-03-18T15:01:44.584827+0000","last_clean":"2024-03-18T15:01:44.584827+0000","last_became_active":"2024-03-18T15:01:44.579403+0000","last_became_peered":"2024-03-18T15:01:44.579403+0000","last_unstale":"2024-03-18T15:01:44.584827+0000","last_undegraded":"2024-03-18T15:01:44.584827+0000","last_fullsized":"2024-03-18T15:01:44.584827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:38:07.748919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574547+0000","last_change":"2024-03-18T15:01:44.574547+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574547+0000","last_undegraded":"2024-03-18T15:01:44.574547+0000","last_fullsized":"2024-03-18T15:01:44.574547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581953+0000","last_change":"2024-03-18T15:01:44.580696+0000","last_active":"2024-03-18T15:01:44.581953+0000","last_peered":"2024-03-18T15:01:44.581953+0000","last_clean":"2024-03-18T15:01:44.581953+0000","last_became_active":"2024-03-18T15:01:44.580427+0000","last_became_peered":"2024-03-18T15:01:44.580427+0000","last_unstale":"2024-03-18T15:01:44.581953+0000","last_undegraded":"2024-03-18T15:01:44.581953+0000","last_fullsized":"2024-03-18T15:01:44.581953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585403+0000","last_change":"2024-03-18T15:01:45.581595+0000","last_active":"2024-03-18T15:01:45.585403+0000","last_peered":"2024-03-18T15:01:45.585403+0000","last_clean":"2024-03-18T15:01:45.585403+0000","last_became_active":"2024-03-18T15:01:45.581349+0000","last_became_peered":"2024-03-18T15:01:45.581349+0000","last_unstale":"2024-03-18T15:01:45.585403+0000","last_undegraded":"2024-03-18T15:01:45.585403+0000","last_fullsized":"2024-03-18T15:01:45.585403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:30.207924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.599364+0000","last_change":"2024-03-18T15:01:44.586423+0000","last_active":"2024-03-18T15:01:45.599364+0000","last_peered":"2024-03-18T15:01:45.599364+0000","last_clean":"2024-03-18T15:01:45.599364+0000","last_became_active":"2024-03-18T15:01:44.586184+0000","last_became_peered":"2024-03-18T15:01:44.586184+0000","last_unstale":"2024-03-18T15:01:45.599364+0000","last_undegraded":"2024-03-18T15:01:45.599364+0000","last_fullsized":"2024-03-18T15:01:45.599364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568072+0000","last_change":"2024-03-18T15:01:44.568072+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568072+0000","last_undegraded":"2024-03-18T15:01:44.568072+0000","last_fullsized":"2024-03-18T15:01:44.568072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578345+0000","last_change":"2024-03-18T15:01:44.582617+0000","last_active":"2024-03-18T15:01:45.578345+0000","last_peered":"2024-03-18T15:01:45.578345+0000","last_clean":"2024-03-18T15:01:45.578345+0000","last_became_active":"2024-03-18T15:01:44.582360+0000","last_became_peered":"2024-03-18T15:01:44.582360+0000","last_unstale":"2024-03-18T15:01:45.578345+0000","last_undegraded":"2024-03-18T15:01:45.578345+0000","last_fullsized":"2024-03-18T15:01:45.578345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:21.996890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572458+0000","last_change":"2024-03-18T15:01:44.572458+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572458+0000","last_undegraded":"2024-03-18T15:01:44.572458+0000","last_fullsized":"2024-03-18T15:01:44.572458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:43.556461+0000","last_change":"2024-03-18T15:01:43.556461+0000","last_active":"2024-03-18T15:01:43.556461+0000","last_peered":"2024-03-18T15:01:43.556461+0000","last_clean":"2024-03-18T15:01:43.556461+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:43.556461+0000","last_undegraded":"2024-03-18T15:01:43.556461+0000","last_fullsized":"2024-03-18T15:01:43.556461+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-03-18T15:01:44.558589+0000","last_change":"2024-03-18T15:01:44.558589+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.558589+0000","last_undegraded":"2024-03-18T15:01:44.558589+0000","last_fullsized":"2024-03-18T15:01:44.558589+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578092+0000","last_change":"2024-03-18T15:01:44.581622+0000","last_active":"2024-03-18T15:01:45.578092+0000","last_peered":"2024-03-18T15:01:45.578092+0000","last_clean":"2024-03-18T15:01:45.578092+0000","last_became_active":"2024-03-18T15:01:44.581349+0000","last_became_peered":"2024-03-18T15:01:44.581349+0000","last_unstale":"2024-03-18T15:01:45.578092+0000","last_undegraded":"2024-03-18T15:01:45.578092+0000","last_fullsized":"2024-03-18T15:01:45.578092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:56.837150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597387+0000","last_change":"2024-03-18T15:01:45.594192+0000","last_active":"2024-03-18T15:01:45.597387+0000","last_peered":"2024-03-18T15:01:45.597387+0000","last_clean":"2024-03-18T15:01:45.597387+0000","last_became_active":"2024-03-18T15:01:45.586383+0000","last_became_peered":"2024-03-18T15:01:45.586383+0000","last_unstale":"2024-03-18T15:01:45.597387+0000","last_undegraded":"2024-03-18T15:01:45.597387+0000","last_fullsized":"2024-03-18T15:01:45.597387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576169+0000","last_change":"2024-03-18T15:01:44.575596+0000","last_active":"2024-03-18T15:01:44.576169+0000","last_peered":"2024-03-18T15:01:44.576169+0000","last_clean":"2024-03-18T15:01:44.576169+0000","last_became_active":"2024-03-18T15:01:44.575268+0000","last_became_peered":"2024-03-18T15:01:44.575268+0000","last_unstale":"2024-03-18T15:01:44.576169+0000","last_undegraded":"2024-03-18T15:01:44.576169+0000","last_fullsized":"2024-03-18T15:01:44.576169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:24:52.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569827+0000","last_change":"2024-03-18T15:01:44.569827+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569827+0000","last_undegraded":"2024-03-18T15:01:44.569827+0000","last_fullsized":"2024-03-18T15:01:44.569827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569177+0000","last_change":"2024-03-18T15:01:44.583590+0000","last_active":"2024-03-18T15:01:45.569177+0000","last_peered":"2024-03-18T15:01:45.569177+0000","last_clean":"2024-03-18T15:01:45.569177+0000","last_became_active":"2024-03-18T15:01:44.583339+0000","last_became_peered":"2024-03-18T15:01:44.583339+0000","last_unstale":"2024-03-18T15:01:45.569177+0000","last_undegraded":"2024-03-18T15:01:45.569177+0000","last_fullsized":"2024-03-18T15:01:45.569177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:48.250219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573669+0000","last_change":"2024-03-18T15:01:44.573669+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573669+0000","last_undegraded":"2024-03-18T15:01:44.573669+0000","last_fullsized":"2024-03-18T15:01:44.573669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.587387+0000","last_change":"2024-03-18T15:01:44.583257+0000","last_active":"2024-03-18T15:01:44.587387+0000","last_peered":"2024-03-18T15:01:44.587387+0000","last_clean":"2024-03-18T15:01:44.587387+0000","last_became_active":"2024-03-18T15:01:44.582921+0000","last_became_peered":"2024-03-18T15:01:44.582921+0000","last_unstale":"2024-03-18T15:01:44.587387+0000","last_undegraded":"2024-03-18T15:01:44.587387+0000","last_fullsized":"2024-03-18T15:01:44.587387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:22:13.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577275+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:01:44.577275+0000","last_peered":"2024-03-18T15:01:44.577275+0000","last_clean":"2024-03-18T15:01:44.577275+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:01:44.577275+0000","last_undegraded":"2024-03-18T15:01:44.577275+0000","last_fullsized":"2024-03-18T15:01:44.577275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":120,"acting":120,"num_store_stats":7},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":8,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":21,"ondisk_log_size":21,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":731019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32108,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339732,"statfs":{"total":96636764160,"available":96603885568,"internally_reserved":0,"allocated":933888,"data_stored":718935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:49.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2024-03-18T15:01:49.263 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.573049+0000', 'last_change': '2024-03-18T15:01:44.573049+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.573049+0000', 'last_undegraded': '2024-03-18T15:01:44.573049+0000', 'last_fullsized': '2024-03-18T15:01:44.573049+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-18T15:01:49.263 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.568109+0000', 'last_change': '2024-03-18T15:01:44.568109+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.568109+0000', 'last_undegraded': '2024-03-18T15:01:44.568109+0000', 'last_fullsized': '2024-03-18T15:01:44.568109+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.573339+0000', 'last_change': '2024-03-18T15:01:44.573339+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.573339+0000', 'last_undegraded': '2024-03-18T15:01:44.573339+0000', 'last_fullsized': '2024-03-18T15:01:44.573339+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.577069+0000', 'last_change': '2024-03-18T15:01:44.577069+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.577069+0000', 'last_undegraded': '2024-03-18T15:01:44.577069+0000', 'last_fullsized': '2024-03-18T15:01:44.577069+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569073+0000', 'last_change': '2024-03-18T15:01:44.569073+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569073+0000', 'last_undegraded': '2024-03-18T15:01:44.569073+0000', 'last_fullsized': '2024-03-18T15:01:44.569073+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.576702+0000', 'last_change': '2024-03-18T15:01:44.576702+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.576702+0000', 'last_undegraded': '2024-03-18T15:01:44.576702+0000', 'last_fullsized': '2024-03-18T15:01:44.576702+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2024-03-18T15:01:49.264 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.572384+0000', 'last_change': '2024-03-18T15:01:44.572384+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.572384+0000', 'last_undegraded': '2024-03-18T15:01:44.572384+0000', 'last_fullsized': '2024-03-18T15:01:44.572384+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569048+0000', 'last_change': '2024-03-18T15:01:44.569048+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569048+0000', 'last_undegraded': '2024-03-18T15:01:44.569048+0000', 'last_fullsized': '2024-03-18T15:01:44.569048+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.574131+0000', 'last_change': '2024-03-18T15:01:44.574131+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.574131+0000', 'last_undegraded': '2024-03-18T15:01:44.574131+0000', 'last_fullsized': '2024-03-18T15:01:44.574131+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.573363+0000', 'last_change': '2024-03-18T15:01:44.573363+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.573363+0000', 'last_undegraded': '2024-03-18T15:01:44.573363+0000', 'last_fullsized': '2024-03-18T15:01:44.573363+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.571378+0000', 'last_change': '2024-03-18T15:01:44.571378+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.571378+0000', 'last_undegraded': '2024-03-18T15:01:44.571378+0000', 'last_fullsized': '2024-03-18T15:01:44.571378+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569942+0000', 'last_change': '2024-03-18T15:01:44.569942+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569942+0000', 'last_undegraded': '2024-03-18T15:01:44.569942+0000', 'last_fullsized': '2024-03-18T15:01:44.569942+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.265 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:44.558589+0000', 'last_change': '2024-03-18T15:01:44.558589+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.558589+0000', 'last_undegraded': '2024-03-18T15:01:44.558589+0000', 'last_fullsized': '2024-03-18T15:01:44.558589+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.567982+0000', 'last_change': '2024-03-18T15:01:44.567982+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.567982+0000', 'last_undegraded': '2024-03-18T15:01:44.567982+0000', 'last_fullsized': '2024-03-18T15:01:44.567982+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569511+0000', 'last_change': '2024-03-18T15:01:44.569511+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569511+0000', 'last_undegraded': '2024-03-18T15:01:44.569511+0000', 'last_fullsized': '2024-03-18T15:01:44.569511+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.570921+0000', 'last_change': '2024-03-18T15:01:44.570921+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.570921+0000', 'last_undegraded': '2024-03-18T15:01:44.570921+0000', 'last_fullsized': '2024-03-18T15:01:44.570921+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.574928+0000', 'last_change': '2024-03-18T15:01:44.574928+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.574928+0000', 'last_undegraded': '2024-03-18T15:01:44.574928+0000', 'last_fullsized': '2024-03-18T15:01:44.574928+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.266 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.572711+0000', 'last_change': '2024-03-18T15:01:44.572711+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.572711+0000', 'last_undegraded': '2024-03-18T15:01:44.572711+0000', 'last_fullsized': '2024-03-18T15:01:44.572711+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.575900+0000', 'last_change': '2024-03-18T15:01:44.575900+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.575900+0000', 'last_undegraded': '2024-03-18T15:01:44.575900+0000', 'last_fullsized': '2024-03-18T15:01:44.575900+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:44.558589+0000', 'last_change': '2024-03-18T15:01:44.558589+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.558589+0000', 'last_undegraded': '2024-03-18T15:01:44.558589+0000', 'last_fullsized': '2024-03-18T15:01:44.558589+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.571575+0000', 'last_change': '2024-03-18T15:01:44.571575+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.571575+0000', 'last_undegraded': '2024-03-18T15:01:44.571575+0000', 'last_fullsized': '2024-03-18T15:01:44.571575+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:43.556461+0000', 'last_change': '2024-03-18T15:01:43.556461+0000', 'last_active': '2024-03-18T15:01:43.556461+0000', 'last_peered': '2024-03-18T15:01:43.556461+0000', 'last_clean': '2024-03-18T15:01:43.556461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:43.556461+0000', 'last_undegraded': '2024-03-18T15:01:43.556461+0000', 'last_fullsized': '2024-03-18T15:01:43.556461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2024-03-18T15:01:49.267 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.570211+0000', 'last_change': '2024-03-18T15:01:44.570211+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.570211+0000', 'last_undegraded': '2024-03-18T15:01:44.570211+0000', 'last_fullsized': '2024-03-18T15:01:44.570211+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.574390+0000', 'last_change': '2024-03-18T15:01:44.574390+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.574390+0000', 'last_undegraded': '2024-03-18T15:01:44.574390+0000', 'last_fullsized': '2024-03-18T15:01:44.574390+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569108+0000', 'last_change': '2024-03-18T15:01:44.569108+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569108+0000', 'last_undegraded': '2024-03-18T15:01:44.569108+0000', 'last_fullsized': '2024-03-18T15:01:44.569108+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569439+0000', 'last_change': '2024-03-18T15:01:44.569439+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569439+0000', 'last_undegraded': '2024-03-18T15:01:44.569439+0000', 'last_fullsized': '2024-03-18T15:01:44.569439+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569291+0000', 'last_change': '2024-03-18T15:01:44.569291+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569291+0000', 'last_undegraded': '2024-03-18T15:01:44.569291+0000', 'last_fullsized': '2024-03-18T15:01:44.569291+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2024-03-18T15:01:49.268 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:43.556461+0000', 'last_change': '2024-03-18T15:01:43.556461+0000', 'last_active': '2024-03-18T15:01:43.556461+0000', 'last_peered': '2024-03-18T15:01:43.556461+0000', 'last_clean': '2024-03-18T15:01:43.556461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:43.556461+0000', 'last_undegraded': '2024-03-18T15:01:43.556461+0000', 'last_fullsized': '2024-03-18T15:01:43.556461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.568590+0000', 'last_change': '2024-03-18T15:01:44.568590+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.568590+0000', 'last_undegraded': '2024-03-18T15:01:44.568590+0000', 'last_fullsized': '2024-03-18T15:01:44.568590+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.575481+0000', 'last_change': '2024-03-18T15:01:44.575481+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.575481+0000', 'last_undegraded': '2024-03-18T15:01:44.575481+0000', 'last_fullsized': '2024-03-18T15:01:44.575481+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.571710+0000', 'last_change': '2024-03-18T15:01:44.571710+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.571710+0000', 'last_undegraded': '2024-03-18T15:01:44.571710+0000', 'last_fullsized': '2024-03-18T15:01:44.571710+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.570596+0000', 'last_change': '2024-03-18T15:01:44.570596+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.570596+0000', 'last_undegraded': '2024-03-18T15:01:44.570596+0000', 'last_fullsized': '2024-03-18T15:01:44.570596+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.570804+0000', 'last_change': '2024-03-18T15:01:44.570804+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.570804+0000', 'last_undegraded': '2024-03-18T15:01:44.570804+0000', 'last_fullsized': '2024-03-18T15:01:44.570804+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.269 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:43.556461+0000', 'last_change': '2024-03-18T15:01:43.556461+0000', 'last_active': '2024-03-18T15:01:43.556461+0000', 'last_peered': '2024-03-18T15:01:43.556461+0000', 'last_clean': '2024-03-18T15:01:43.556461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:43.556461+0000', 'last_undegraded': '2024-03-18T15:01:43.556461+0000', 'last_fullsized': '2024-03-18T15:01:43.556461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.574547+0000', 'last_change': '2024-03-18T15:01:44.574547+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.574547+0000', 'last_undegraded': '2024-03-18T15:01:44.574547+0000', 'last_fullsized': '2024-03-18T15:01:44.574547+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.568072+0000', 'last_change': '2024-03-18T15:01:44.568072+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.568072+0000', 'last_undegraded': '2024-03-18T15:01:44.568072+0000', 'last_fullsized': '2024-03-18T15:01:44.568072+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:43.556461+0000', 'last_change': '2024-03-18T15:01:43.556461+0000', 'last_active': '2024-03-18T15:01:43.556461+0000', 'last_peered': '2024-03-18T15:01:43.556461+0000', 'last_clean': '2024-03-18T15:01:43.556461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:43.556461+0000', 'last_undegraded': '2024-03-18T15:01:43.556461+0000', 'last_fullsized': '2024-03-18T15:01:43.556461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:44.558589+0000', 'last_change': '2024-03-18T15:01:44.558589+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.558589+0000', 'last_undegraded': '2024-03-18T15:01:44.558589+0000', 'last_fullsized': '2024-03-18T15:01:44.558589+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2024-03-18T15:01:49.270 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.572458+0000', 'last_change': '2024-03-18T15:01:44.572458+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.572458+0000', 'last_undegraded': '2024-03-18T15:01:44.572458+0000', 'last_fullsized': '2024-03-18T15:01:44.572458+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:43.556461+0000', 'last_change': '2024-03-18T15:01:43.556461+0000', 'last_active': '2024-03-18T15:01:43.556461+0000', 'last_peered': '2024-03-18T15:01:43.556461+0000', 'last_clean': '2024-03-18T15:01:43.556461+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:43.556461+0000', 'last_undegraded': '2024-03-18T15:01:43.556461+0000', 'last_fullsized': '2024-03-18T15:01:43.556461+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:43.556461+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-03-18T15:01:44.558589+0000', 'last_change': '2024-03-18T15:01:44.558589+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.558589+0000', 'last_undegraded': '2024-03-18T15:01:44.558589+0000', 'last_fullsized': '2024-03-18T15:01:44.558589+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.569827+0000', 'last_change': '2024-03-18T15:01:44.569827+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.569827+0000', 'last_undegraded': '2024-03-18T15:01:44.569827+0000', 'last_fullsized': '2024-03-18T15:01:44.569827+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2024-03-18T15:01:49.271 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 33, 'state': 'creating+peering', 'last_fresh': '2024-03-18T15:01:44.573669+0000', 'last_change': '2024-03-18T15:01:44.573669+0000', 'last_active': '2024-03-18T15:01:44.558589+0000', 'last_peered': '2024-03-18T15:01:44.558589+0000', 'last_clean': '2024-03-18T15:01:44.558589+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-03-18T15:01:44.573669+0000', 'last_undegraded': '2024-03-18T15:01:44.573669+0000', 'last_fullsized': '2024-03-18T15:01:44.573669+0000', 'mapping_epoch': 33, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 33, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'last_clean_scrub_stamp': '2024-03-18T15:01:44.558589+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-03-18T15:01:49.272 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-03-18T15:01:49.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.399+0000 7f5ef04e8640 1 Processor -- start 2024-03-18T15:01:49.400 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 -- start start 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5ee815f7f0 0x7f5ee80d0920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5ee80d48b0 0x7f5ee80d0e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5ee815fbd0 con 0x7f5ee80d13a0 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee80d2ab0 con 0x7f5ee80d48b0 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.400+0000 7f5ef04e8640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5ee80d3070 con 0x7f5ee815f7f0 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeda83640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5ee80d48b0 0x7f5ee80d0e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeea85640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5ee80d13a0 0x7f5ee8162220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:52056/0 (socket says 172.21.15.152:52056) 2024-03-18T15:01:49.402 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeea85640 1 -- 172.21.15.152:0/4254391110 learned_addr learned my addr 172.21.15.152:0/4254391110 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eee284640 1 --2- 172.21.15.152:0/4254391110 >> v2:172.21.15.186:3300/0 conn(0x7f5ee815f7f0 0x7f5ee80d0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeda83640 1 -- 172.21.15.152:0/4254391110 >> v2:172.21.15.186:3300/0 conn(0x7f5ee815f7f0 msgr2=0x7f5ee80d0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeda83640 1 --2- 172.21.15.152:0/4254391110 >> v2:172.21.15.186:3300/0 conn(0x7f5ee815f7f0 0x7f5ee80d0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeda83640 1 -- 172.21.15.152:0/4254391110 >> v1:172.21.15.152:6789/0 conn(0x7f5ee80d13a0 legacy=0x7f5ee8162220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eeda83640 1 -- 172.21.15.152:0/4254391110 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee80d4f20 con 0x7f5ee80d48b0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.401+0000 7f5eed282640 1 -- 172.21.15.152:0/4254391110 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 517206902 0 0) 0x7f5ee815fbd0 con 0x7f5ee80d13a0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5eeda83640 1 --2- 172.21.15.152:0/4254391110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80d0e60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5ee808e730 tx=0x7f5ed802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f29cf4b672af689 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5eed282640 1 -- 172.21.15.152:0/4254391110 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed80315a0 con 0x7f5ee80d48b0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5eed282640 1 -- 172.21.15.152:0/4254391110 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ed8037070 con 0x7f5ee80d48b0 2024-03-18T15:01:49.403 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5eed282640 1 -- 172.21.15.152:0/4254391110 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ed8031960 con 0x7f5ee80d48b0 2024-03-18T15:01:49.404 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 -- 172.21.15.152:0/4254391110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee80d48b0 msgr2=0x7f5ee80d0e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/4254391110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80d0e60 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f5ee808e730 tx=0x7f5ed802b840 comp rx=0 tx=0).stop 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 -- 172.21.15.152:0/4254391110 shutdown_connections 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/4254391110 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80d0e60 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/4254391110 >> v2:172.21.15.186:3300/0 conn(0x7f5ee815f7f0 0x7f5ee80d0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 -- 172.21.15.152:0/4254391110 >> 172.21.15.152:0/4254391110 conn(0x7f5ee809d4d0 msgr2=0x7f5ee80d41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.402+0000 7f5ef04e8640 1 -- 172.21.15.152:0/4254391110 shutdown_connections 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.403+0000 7f5ef04e8640 1 -- 172.21.15.152:0/4254391110 wait complete. 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.404+0000 7f5ef04e8640 1 Processor -- start 2024-03-18T15:01:49.405 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.404+0000 7f5ef04e8640 1 -- start start 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.405+0000 7f5ef04e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ee80d13a0 0x7f5ee81f1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.405+0000 7f5ef04e8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80b9a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.405+0000 7f5ef04e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.405+0000 7f5ef04e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee80cffa0 con 0x7f5ee815f7f0 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.405+0000 7f5ef04e8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5ee80c7830 con 0x7f5ee80d48b0 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5ef04e8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5ee80d0120 con 0x7f5ee80d13a0 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46974/0 (socket says 172.21.15.152:46974) 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 -- 172.21.15.152:0/1471353847 learned_addr learned my addr 172.21.15.152:0/1471353847 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeda83640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80b9a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.408 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eee284640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ee80d13a0 0x7f5ee81f1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 -- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ee80d13a0 msgr2=0x7f5ee81f1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ee80d13a0 0x7f5ee81f1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 -- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ee80d48b0 msgr2=0x7f5ee80b9a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80b9a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 -- 172.21.15.152:0/1471353847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ee81f5170 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5eeea85640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c7d0 tx=0x7f5ee000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee0018070 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ee000a640 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ee81f4e90 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee000aa70 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.406+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ee80b9240 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.407+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ee8069050 con 0x7f5ee815f7f0 2024-03-18T15:01:49.409 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.408+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5ee001b070 con 0x7f5ee815f7f0 2024-03-18T15:01:49.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.408+0000 7f5edeffd640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 0x7f5ecc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.408+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f5ee0089fc0 con 0x7f5ee815f7f0 2024-03-18T15:01:49.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.408+0000 7f5eee284640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 0x7f5ecc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.410 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.409+0000 7f5eee284640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 0x7f5ecc06e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006fd0 tx=0x7f5ee4008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.413 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.413+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5ee0058460 con 0x7f5ee815f7f0 2024-03-18T15:01:49.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.657+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f5ee808e280 con 0x7f5ee815f7f0 2024-03-18T15:01:49.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.657+0000 7f5edeffd640 1 -- 172.21.15.152:0/1471353847 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1720 (secure 0 0 0) 0x7f5ee005c500 con 0x7f5ee815f7f0 2024-03-18T15:01:49.658 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:49.658 INFO:teuthology.orchestra.run.smithi152.stdout:{"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":8,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":86,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":35,"num_osds":8,"num_up_osds":8,"osd_up_since":1710774035,"num_in_osds":8,"osd_in_since":1710774026,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":54},{"state_name":"creating+peering","count":34},{"state_name":"unknown","count":9}],"num_pgs":97,"num_pools":3,"num_objects":14,"data_bytes":592002,"bytes_used":229732352,"bytes_avail":772864380928,"bytes_total":773094113280,"unknown_pgs_ratio":0.092783503234386444,"inactive_pgs_ratio":0.3505154550075531,"write_bytes_sec":962,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":13,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"c","status":"up:active","gid":5148}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2024-03-18T15:01:37.814278+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 msgr2=0x7f5ecc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 0x7f5ecc06e090 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4006fd0 tx=0x7f5ee4008040 comp rx=0 tx=0).stop 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 msgr2=0x7f5ee80cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f5ee000c7d0 tx=0x7f5ee000cc90 comp rx=0 tx=0).stop 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 shutdown_connections 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5ee815f7f0 0x7f5ee80cd440 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5ee80d48b0 0x7f5ee80b9a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5ecc06bbd0 0x7f5ecc06e090 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 --2- 172.21.15.152:0/1471353847 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5ee80d13a0 0x7f5ee81f1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 >> 172.21.15.152:0/1471353847 conn(0x7f5ee809d4d0 msgr2=0x7f5ee806c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 shutdown_connections 2024-03-18T15:01:49.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.659+0000 7f5ef04e8640 1 -- 172.21.15.152:0/1471353847 wait complete. 2024-03-18T15:01:49.671 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2024-03-18T15:01:49.671 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:49.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.772+0000 7fa952f59640 1 Processor -- start 2024-03-18T15:01:49.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.772+0000 7fa952f59640 1 -- start start 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 0x7fa94c0ad800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3400 0x7fa94c0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa94c0b3860 0x7fa94c0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa94c15ee60 con 0x7fa94c0b3860 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa94c15f140 con 0x7fa94c15ad40 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa952f59640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa94c15f420 con 0x7fa94c0b3400 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa9514f6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa94c0b3860 0x7fa94c0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa9514f6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa94c0b3860 0x7fa94c0d0620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46978/0 (socket says 172.21.15.152:46978) 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa9514f6640 1 -- 172.21.15.152:0/691738744 learned_addr learned my addr 172.21.15.152:0/691738744 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa94bfff640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3400 0x7fa94c0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.773+0000 7fa950cf5640 1 --2- 172.21.15.152:0/691738744 >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 0x7fa94c0ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 -- 172.21.15.152:0/691738744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3400 msgr2=0x7fa94c0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3400 0x7fa94c0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 -- 172.21.15.152:0/691738744 >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 msgr2=0x7fa94c0ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 --2- 172.21.15.152:0/691738744 >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 0x7fa94c0ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 -- 172.21.15.152:0/691738744 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c15f700 con 0x7fa94c0b3860 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa950cf5640 1 --2- 172.21.15.152:0/691738744 >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 0x7fa94c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.774+0000 7fa9514f6640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3860 0x7fa94c0d0620 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa94c071130 tx=0x7fa94402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfe937c070f64d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa94b7fe640 1 -- 172.21.15.152:0/691738744 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94402c9e0 con 0x7fa94c0b3860 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa94b7fe640 1 -- 172.21.15.152:0/691738744 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa94402cb80 con 0x7fa94c0b3860 2024-03-18T15:01:49.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa94b7fe640 1 -- 172.21.15.152:0/691738744 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9440343f0 con 0x7fa94c0b3860 2024-03-18T15:01:49.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 -- 172.21.15.152:0/691738744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3860 msgr2=0x7fa94c0d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3860 0x7fa94c0d0620 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa94c071130 tx=0x7fa94402be40 comp rx=0 tx=0).stop 2024-03-18T15:01:49.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 -- 172.21.15.152:0/691738744 shutdown_connections 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3860 0x7fa94c0d0620 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 --2- 172.21.15.152:0/691738744 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3400 0x7fa94c0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 --2- 172.21.15.152:0/691738744 >> v2:172.21.15.186:3300/0 conn(0x7fa94c15ad40 0x7fa94c0ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 -- 172.21.15.152:0/691738744 >> 172.21.15.152:0/691738744 conn(0x7fa94c06b5e0 msgr2=0x7fa94c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 -- 172.21.15.152:0/691738744 shutdown_connections 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.775+0000 7fa952f59640 1 -- 172.21.15.152:0/691738744 wait complete. 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.776+0000 7fa952f59640 1 Processor -- start 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.776+0000 7fa952f59640 1 -- start start 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3860 0x7fa94c151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa94c15ad40 0x7fa94c152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c15ea10 con 0x7fa94c0b3400 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa94c15b330 con 0x7fa94c15ad40 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa952f59640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa94c15eb90 con 0x7fa94c0b3860 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa950cf5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa950cf5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:46990/0 (socket says 172.21.15.152:46990) 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.777+0000 7fa950cf5640 1 -- 172.21.15.152:0/3772873214 learned_addr learned my addr 172.21.15.152:0/3772873214 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa9514f6640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa94c15ad40 0x7fa94c152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa94bfff640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3860 0x7fa94c151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 -- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3860 msgr2=0x7fa94c151860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3860 0x7fa94c151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 -- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa94c15ad40 msgr2=0x7fa94c152c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa94c15ad40 0x7fa94c152c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 -- 172.21.15.152:0/3772873214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94c151da0 con 0x7fa94c0b3400 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa950cf5640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa94000e730 tx=0x7fa94000ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94000f040 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa940004230 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94c15b4b0 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa94000ee40 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.778+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa94c15b750 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.779+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa94c04f5b0 con 0x7fa94c0b3400 2024-03-18T15:01:49.782 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.779+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa94000c6d0 con 0x7fa94c0b3400 2024-03-18T15:01:49.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.780+0000 7fa9497fa640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 0x7fa93006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:49.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.780+0000 7fa94bfff640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 0x7fa93006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:49.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.780+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa94008a770 con 0x7fa94c0b3400 2024-03-18T15:01:49.783 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.780+0000 7fa94bfff640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 0x7fa93006e090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa938006fd0 tx=0x7fa938008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:49.784 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.784+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa94c151da0 con 0x7fa94c0b3400 2024-03-18T15:01:49.960 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.960+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa94c071ad0 con 0x7fa93006bbd0 2024-03-18T15:01:49.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.968+0000 7fa9497fa640 1 -- 172.21.15.152:0/3772873214 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249117 (secure 0 0 0) 0x7fa94c071ad0 con 0x7fa93006bbd0 2024-03-18T15:01:49.971 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:49.972 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 msgr2=0x7fa93006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 0x7fa93006e090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa938006fd0 tx=0x7fa938008040 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 msgr2=0x7fa94c0b0f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa94000e730 tx=0x7fa94000ebf0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 shutdown_connections 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa94c15ad40 0x7fa94c152c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa93006bbd0 0x7fa93006e090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa94c0b3860 0x7fa94c151860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 --2- 172.21.15.152:0/3772873214 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa94c0b3400 0x7fa94c0b0f40 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 >> 172.21.15.152:0/3772873214 conn(0x7fa94c06b5e0 msgr2=0x7fa94c159ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 shutdown_connections 2024-03-18T15:01:49.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:49.971+0000 7fa952f59640 1 -- 172.21.15.152:0/3772873214 wait complete. 2024-03-18T15:01:49.983 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":66,"stamp":"2024-03-18T15:01:49.816163+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592002,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":189,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":142,"ondisk_log_size":142,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":31,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224380,"kb_used_data":4036,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750340,"statfs":{"total":773094113280,"available":772864348160,"internally_reserved":0,"allocated":4132864,"data_stored":2314894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000920"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573049+0000","last_change":"2024-03-18T15:01:44.573049+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573049+0000","last_undegraded":"2024-03-18T15:01:44.573049+0000","last_fullsized":"2024-03-18T15:01:44.573049+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597219+0000","last_change":"2024-03-18T15:01:45.592575+0000","last_active":"2024-03-18T15:01:45.597219+0000","last_peered":"2024-03-18T15:01:45.597219+0000","last_clean":"2024-03-18T15:01:45.597219+0000","last_became_active":"2024-03-18T15:01:45.586032+0000","last_became_peered":"2024-03-18T15:01:45.586032+0000","last_unstale":"2024-03-18T15:01:45.597219+0000","last_undegraded":"2024-03-18T15:01:45.597219+0000","last_fullsized":"2024-03-18T15:01:45.597219+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568109+0000","last_change":"2024-03-18T15:01:44.568109+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568109+0000","last_undegraded":"2024-03-18T15:01:44.568109+0000","last_fullsized":"2024-03-18T15:01:44.568109+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.593867+0000","last_change":"2024-03-18T15:01:45.587946+0000","last_active":"2024-03-18T15:01:45.593867+0000","last_peered":"2024-03-18T15:01:45.593867+0000","last_clean":"2024-03-18T15:01:45.593867+0000","last_became_active":"2024-03-18T15:01:45.587670+0000","last_became_peered":"2024-03-18T15:01:45.587670+0000","last_unstale":"2024-03-18T15:01:45.593867+0000","last_undegraded":"2024-03-18T15:01:45.593867+0000","last_fullsized":"2024-03-18T15:01:45.593867+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:25.730934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596088+0000","last_change":"2024-03-18T15:01:45.595395+0000","last_active":"2024-03-18T15:01:45.596088+0000","last_peered":"2024-03-18T15:01:45.596088+0000","last_clean":"2024-03-18T15:01:45.596088+0000","last_became_active":"2024-03-18T15:01:45.595169+0000","last_became_peered":"2024-03-18T15:01:45.595169+0000","last_unstale":"2024-03-18T15:01:45.596088+0000","last_undegraded":"2024-03-18T15:01:45.596088+0000","last_fullsized":"2024-03-18T15:01:45.596088+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:27:39.240483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596426+0000","last_change":"2024-03-18T15:01:45.578000+0000","last_active":"2024-03-18T15:01:45.596426+0000","last_peered":"2024-03-18T15:01:45.596426+0000","last_clean":"2024-03-18T15:01:45.596426+0000","last_became_active":"2024-03-18T15:01:45.577724+0000","last_became_peered":"2024-03-18T15:01:45.577724+0000","last_unstale":"2024-03-18T15:01:45.596426+0000","last_undegraded":"2024-03-18T15:01:45.596426+0000","last_fullsized":"2024-03-18T15:01:45.596426+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:04:12.206972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573339+0000","last_change":"2024-03-18T15:01:44.573339+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573339+0000","last_undegraded":"2024-03-18T15:01:44.573339+0000","last_fullsized":"2024-03-18T15:01:44.573339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.577069+0000","last_change":"2024-03-18T15:01:44.577069+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.577069+0000","last_undegraded":"2024-03-18T15:01:44.577069+0000","last_fullsized":"2024-03-18T15:01:44.577069+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569073+0000","last_change":"2024-03-18T15:01:44.569073+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569073+0000","last_undegraded":"2024-03-18T15:01:44.569073+0000","last_fullsized":"2024-03-18T15:01:44.569073+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.605685+0000","last_change":"2024-03-18T15:01:45.598002+0000","last_active":"2024-03-18T15:01:45.605685+0000","last_peered":"2024-03-18T15:01:45.605685+0000","last_clean":"2024-03-18T15:01:45.605685+0000","last_became_active":"2024-03-18T15:01:45.597734+0000","last_became_peered":"2024-03-18T15:01:45.597734+0000","last_unstale":"2024-03-18T15:01:45.605685+0000","last_undegraded":"2024-03-18T15:01:45.605685+0000","last_fullsized":"2024-03-18T15:01:45.605685+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:27.068270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.576702+0000","last_change":"2024-03-18T15:01:44.576702+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.576702+0000","last_undegraded":"2024-03-18T15:01:44.576702+0000","last_fullsized":"2024-03-18T15:01:44.576702+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572384+0000","last_change":"2024-03-18T15:01:44.572384+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572384+0000","last_undegraded":"2024-03-18T15:01:44.572384+0000","last_fullsized":"2024-03-18T15:01:44.572384+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585461+0000","last_change":"2024-03-18T15:01:45.583364+0000","last_active":"2024-03-18T15:01:45.585461+0000","last_peered":"2024-03-18T15:01:45.585461+0000","last_clean":"2024-03-18T15:01:45.585461+0000","last_became_active":"2024-03-18T15:01:45.582846+0000","last_became_peered":"2024-03-18T15:01:45.582846+0000","last_unstale":"2024-03-18T15:01:45.585461+0000","last_undegraded":"2024-03-18T15:01:45.585461+0000","last_fullsized":"2024-03-18T15:01:45.585461+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:54:18.681555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596569+0000","last_change":"2024-03-18T15:01:45.581704+0000","last_active":"2024-03-18T15:01:45.596569+0000","last_peered":"2024-03-18T15:01:45.596569+0000","last_clean":"2024-03-18T15:01:45.596569+0000","last_became_active":"2024-03-18T15:01:45.581288+0000","last_became_peered":"2024-03-18T15:01:45.581288+0000","last_unstale":"2024-03-18T15:01:45.596569+0000","last_undegraded":"2024-03-18T15:01:45.596569+0000","last_fullsized":"2024-03-18T15:01:45.596569+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:31.840893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569048+0000","last_change":"2024-03-18T15:01:44.569048+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569048+0000","last_undegraded":"2024-03-18T15:01:44.569048+0000","last_fullsized":"2024-03-18T15:01:44.569048+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574131+0000","last_change":"2024-03-18T15:01:44.574131+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574131+0000","last_undegraded":"2024-03-18T15:01:44.574131+0000","last_fullsized":"2024-03-18T15:01:44.574131+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573363+0000","last_change":"2024-03-18T15:01:44.573363+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573363+0000","last_undegraded":"2024-03-18T15:01:44.573363+0000","last_fullsized":"2024-03-18T15:01:44.573363+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597291+0000","last_change":"2024-03-18T15:01:45.593046+0000","last_active":"2024-03-18T15:01:45.597291+0000","last_peered":"2024-03-18T15:01:45.597291+0000","last_clean":"2024-03-18T15:01:45.597291+0000","last_became_active":"2024-03-18T15:01:45.592791+0000","last_became_peered":"2024-03-18T15:01:45.592791+0000","last_unstale":"2024-03-18T15:01:45.597291+0000","last_undegraded":"2024-03-18T15:01:45.597291+0000","last_fullsized":"2024-03-18T15:01:45.597291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597370+0000","last_change":"2024-03-18T15:01:45.586629+0000","last_active":"2024-03-18T15:01:45.597370+0000","last_peered":"2024-03-18T15:01:45.597370+0000","last_clean":"2024-03-18T15:01:45.597370+0000","last_became_active":"2024-03-18T15:01:45.586335+0000","last_became_peered":"2024-03-18T15:01:45.586335+0000","last_unstale":"2024-03-18T15:01:45.597370+0000","last_undegraded":"2024-03-18T15:01:45.597370+0000","last_fullsized":"2024-03-18T15:01:45.597370+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585516+0000","last_change":"2024-03-18T15:01:45.584429+0000","last_active":"2024-03-18T15:01:45.585516+0000","last_peered":"2024-03-18T15:01:45.585516+0000","last_clean":"2024-03-18T15:01:45.585516+0000","last_became_active":"2024-03-18T15:01:45.584158+0000","last_became_peered":"2024-03-18T15:01:45.584158+0000","last_unstale":"2024-03-18T15:01:45.585516+0000","last_undegraded":"2024-03-18T15:01:45.585516+0000","last_fullsized":"2024-03-18T15:01:45.585516+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:29:25.504474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571378+0000","last_change":"2024-03-18T15:01:44.571378+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571378+0000","last_undegraded":"2024-03-18T15:01:44.571378+0000","last_fullsized":"2024-03-18T15:01:44.571378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569942+0000","last_change":"2024-03-18T15:01:44.569942+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569942+0000","last_undegraded":"2024-03-18T15:01:44.569942+0000","last_fullsized":"2024-03-18T15:01:44.569942+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272005+0000","last_change":"2024-03-18T15:01:45.589740+0000","last_active":"2024-03-18T15:01:47.272005+0000","last_peered":"2024-03-18T15:01:47.272005+0000","last_clean":"2024-03-18T15:01:47.272005+0000","last_became_active":"2024-03-18T15:01:45.589437+0000","last_became_peered":"2024-03-18T15:01:45.589437+0000","last_unstale":"2024-03-18T15:01:47.272005+0000","last_undegraded":"2024-03-18T15:01:47.272005+0000","last_fullsized":"2024-03-18T15:01:47.272005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:21:52.157719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.567982+0000","last_change":"2024-03-18T15:01:44.567982+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.567982+0000","last_undegraded":"2024-03-18T15:01:44.567982+0000","last_fullsized":"2024-03-18T15:01:44.567982+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585519+0000","last_change":"2024-03-18T15:01:45.583520+0000","last_active":"2024-03-18T15:01:45.585519+0000","last_peered":"2024-03-18T15:01:45.585519+0000","last_clean":"2024-03-18T15:01:45.585519+0000","last_became_active":"2024-03-18T15:01:45.583058+0000","last_became_peered":"2024-03-18T15:01:45.583058+0000","last_unstale":"2024-03-18T15:01:45.585519+0000","last_undegraded":"2024-03-18T15:01:45.585519+0000","last_fullsized":"2024-03-18T15:01:45.585519+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:31:11.337881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596707+0000","last_change":"2024-03-18T15:01:45.581296+0000","last_active":"2024-03-18T15:01:45.596707+0000","last_peered":"2024-03-18T15:01:45.596707+0000","last_clean":"2024-03-18T15:01:45.596707+0000","last_became_active":"2024-03-18T15:01:45.581030+0000","last_became_peered":"2024-03-18T15:01:45.581030+0000","last_unstale":"2024-03-18T15:01:45.596707+0000","last_undegraded":"2024-03-18T15:01:45.596707+0000","last_fullsized":"2024-03-18T15:01:45.596707+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:38:24.924212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595701+0000","last_change":"2024-03-18T15:01:45.593019+0000","last_active":"2024-03-18T15:01:45.595701+0000","last_peered":"2024-03-18T15:01:45.595701+0000","last_clean":"2024-03-18T15:01:45.595701+0000","last_became_active":"2024-03-18T15:01:45.592763+0000","last_became_peered":"2024-03-18T15:01:45.592763+0000","last_unstale":"2024-03-18T15:01:45.595701+0000","last_undegraded":"2024-03-18T15:01:45.595701+0000","last_fullsized":"2024-03-18T15:01:45.595701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:49.252348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569511+0000","last_change":"2024-03-18T15:01:44.569511+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569511+0000","last_undegraded":"2024-03-18T15:01:44.569511+0000","last_fullsized":"2024-03-18T15:01:44.569511+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570921+0000","last_change":"2024-03-18T15:01:44.570921+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570921+0000","last_undegraded":"2024-03-18T15:01:44.570921+0000","last_fullsized":"2024-03-18T15:01:44.570921+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574928+0000","last_change":"2024-03-18T15:01:44.574928+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574928+0000","last_undegraded":"2024-03-18T15:01:44.574928+0000","last_fullsized":"2024-03-18T15:01:44.574928+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572711+0000","last_change":"2024-03-18T15:01:44.572711+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572711+0000","last_undegraded":"2024-03-18T15:01:44.572711+0000","last_fullsized":"2024-03-18T15:01:44.572711+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575900+0000","last_change":"2024-03-18T15:01:44.575900+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575900+0000","last_undegraded":"2024-03-18T15:01:44.575900+0000","last_fullsized":"2024-03-18T15:01:44.575900+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272128+0000","last_change":"2024-03-18T15:01:45.589625+0000","last_active":"2024-03-18T15:01:47.272128+0000","last_peered":"2024-03-18T15:01:47.272128+0000","last_clean":"2024-03-18T15:01:47.272128+0000","last_became_active":"2024-03-18T15:01:45.589349+0000","last_became_peered":"2024-03-18T15:01:45.589349+0000","last_unstale":"2024-03-18T15:01:47.272128+0000","last_undegraded":"2024-03-18T15:01:47.272128+0000","last_fullsized":"2024-03-18T15:01:47.272128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:01:34.183868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581654+0000","last_change":"2024-03-18T15:01:44.579276+0000","last_active":"2024-03-18T15:01:44.581654+0000","last_peered":"2024-03-18T15:01:44.581654+0000","last_clean":"2024-03-18T15:01:44.581654+0000","last_became_active":"2024-03-18T15:01:44.578958+0000","last_became_peered":"2024-03-18T15:01:44.578958+0000","last_unstale":"2024-03-18T15:01:44.581654+0000","last_undegraded":"2024-03-18T15:01:44.581654+0000","last_fullsized":"2024-03-18T15:01:44.581654+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:40.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571575+0000","last_change":"2024-03-18T15:01:44.571575+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571575+0000","last_undegraded":"2024-03-18T15:01:44.571575+0000","last_fullsized":"2024-03-18T15:01:44.571575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272082+0000","last_change":"2024-03-18T15:01:44.580089+0000","last_active":"2024-03-18T15:01:47.272082+0000","last_peered":"2024-03-18T15:01:47.272082+0000","last_clean":"2024-03-18T15:01:47.272082+0000","last_became_active":"2024-03-18T15:01:44.579803+0000","last_became_peered":"2024-03-18T15:01:44.579803+0000","last_unstale":"2024-03-18T15:01:47.272082+0000","last_undegraded":"2024-03-18T15:01:47.272082+0000","last_fullsized":"2024-03-18T15:01:47.272082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:37.128966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570211+0000","last_change":"2024-03-18T15:01:44.570211+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570211+0000","last_undegraded":"2024-03-18T15:01:44.570211+0000","last_fullsized":"2024-03-18T15:01:44.570211+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.596755+0000","last_change":"2024-03-18T15:01:44.590824+0000","last_active":"2024-03-18T15:01:45.596755+0000","last_peered":"2024-03-18T15:01:45.596755+0000","last_clean":"2024-03-18T15:01:45.596755+0000","last_became_active":"2024-03-18T15:01:44.590495+0000","last_became_peered":"2024-03-18T15:01:44.590495+0000","last_unstale":"2024-03-18T15:01:45.596755+0000","last_undegraded":"2024-03-18T15:01:45.596755+0000","last_fullsized":"2024-03-18T15:01:45.596755+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:03.804170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595667+0000","last_change":"2024-03-18T15:01:45.592391+0000","last_active":"2024-03-18T15:01:45.595667+0000","last_peered":"2024-03-18T15:01:45.595667+0000","last_clean":"2024-03-18T15:01:45.595667+0000","last_became_active":"2024-03-18T15:01:45.592134+0000","last_became_peered":"2024-03-18T15:01:45.592134+0000","last_unstale":"2024-03-18T15:01:45.595667+0000","last_undegraded":"2024-03-18T15:01:45.595667+0000","last_fullsized":"2024-03-18T15:01:45.595667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:17.013483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.583480+0000","last_change":"2024-03-18T15:01:44.582771+0000","last_active":"2024-03-18T15:01:45.583480+0000","last_peered":"2024-03-18T15:01:45.583480+0000","last_clean":"2024-03-18T15:01:45.583480+0000","last_became_active":"2024-03-18T15:01:44.582504+0000","last_became_peered":"2024-03-18T15:01:44.582504+0000","last_unstale":"2024-03-18T15:01:45.583480+0000","last_undegraded":"2024-03-18T15:01:45.583480+0000","last_fullsized":"2024-03-18T15:01:45.583480+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:57.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574390+0000","last_change":"2024-03-18T15:01:44.574390+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574390+0000","last_undegraded":"2024-03-18T15:01:44.574390+0000","last_fullsized":"2024-03-18T15:01:44.574390+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590485+0000","last_change":"2024-03-18T15:01:44.585074+0000","last_active":"2024-03-18T15:01:44.590485+0000","last_peered":"2024-03-18T15:01:44.590485+0000","last_clean":"2024-03-18T15:01:44.590485+0000","last_became_active":"2024-03-18T15:01:44.584724+0000","last_became_peered":"2024-03-18T15:01:44.584724+0000","last_unstale":"2024-03-18T15:01:44.590485+0000","last_undegraded":"2024-03-18T15:01:44.590485+0000","last_fullsized":"2024-03-18T15:01:44.590485+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:42.564122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569108+0000","last_change":"2024-03-18T15:01:44.569108+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569108+0000","last_undegraded":"2024-03-18T15:01:44.569108+0000","last_fullsized":"2024-03-18T15:01:44.569108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584819+0000","last_change":"2024-03-18T15:01:44.581419+0000","last_active":"2024-03-18T15:01:44.584819+0000","last_peered":"2024-03-18T15:01:44.584819+0000","last_clean":"2024-03-18T15:01:44.584819+0000","last_became_active":"2024-03-18T15:01:44.580982+0000","last_became_peered":"2024-03-18T15:01:44.580982+0000","last_unstale":"2024-03-18T15:01:44.584819+0000","last_undegraded":"2024-03-18T15:01:44.584819+0000","last_fullsized":"2024-03-18T15:01:44.584819+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:56:27.790579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569439+0000","last_change":"2024-03-18T15:01:44.569439+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569439+0000","last_undegraded":"2024-03-18T15:01:44.569439+0000","last_fullsized":"2024-03-18T15:01:44.569439+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.567995+0000","last_change":"2024-03-18T15:01:44.583187+0000","last_active":"2024-03-18T15:01:45.567995+0000","last_peered":"2024-03-18T15:01:45.567995+0000","last_clean":"2024-03-18T15:01:45.567995+0000","last_became_active":"2024-03-18T15:01:44.582915+0000","last_became_peered":"2024-03-18T15:01:44.582915+0000","last_unstale":"2024-03-18T15:01:45.567995+0000","last_undegraded":"2024-03-18T15:01:45.567995+0000","last_fullsized":"2024-03-18T15:01:45.567995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595035+0000","last_change":"2024-03-18T15:01:45.591499+0000","last_active":"2024-03-18T15:01:45.595035+0000","last_peered":"2024-03-18T15:01:45.595035+0000","last_clean":"2024-03-18T15:01:45.595035+0000","last_became_active":"2024-03-18T15:01:45.591017+0000","last_became_peered":"2024-03-18T15:01:45.591017+0000","last_unstale":"2024-03-18T15:01:45.595035+0000","last_undegraded":"2024-03-18T15:01:45.595035+0000","last_fullsized":"2024-03-18T15:01:45.595035+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:25.128904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577572+0000","last_change":"2024-03-18T15:01:44.576918+0000","last_active":"2024-03-18T15:01:44.577572+0000","last_peered":"2024-03-18T15:01:44.577572+0000","last_clean":"2024-03-18T15:01:44.577572+0000","last_became_active":"2024-03-18T15:01:44.576614+0000","last_became_peered":"2024-03-18T15:01:44.576614+0000","last_unstale":"2024-03-18T15:01:44.577572+0000","last_undegraded":"2024-03-18T15:01:44.577572+0000","last_fullsized":"2024-03-18T15:01:44.577572+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:25:52.851001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569291+0000","last_change":"2024-03-18T15:01:44.569291+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569291+0000","last_undegraded":"2024-03-18T15:01:44.569291+0000","last_fullsized":"2024-03-18T15:01:44.569291+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569820+0000","last_change":"2024-03-18T15:01:44.582920+0000","last_active":"2024-03-18T15:01:45.569820+0000","last_peered":"2024-03-18T15:01:45.569820+0000","last_clean":"2024-03-18T15:01:45.569820+0000","last_became_active":"2024-03-18T15:01:44.582314+0000","last_became_peered":"2024-03-18T15:01:44.582314+0000","last_unstale":"2024-03-18T15:01:45.569820+0000","last_undegraded":"2024-03-18T15:01:45.569820+0000","last_fullsized":"2024-03-18T15:01:45.569820+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:26.066141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597238+0000","last_change":"2024-03-18T15:01:45.592592+0000","last_active":"2024-03-18T15:01:45.597238+0000","last_peered":"2024-03-18T15:01:45.597238+0000","last_clean":"2024-03-18T15:01:45.597238+0000","last_became_active":"2024-03-18T15:01:45.592306+0000","last_became_peered":"2024-03-18T15:01:45.592306+0000","last_unstale":"2024-03-18T15:01:45.597238+0000","last_undegraded":"2024-03-18T15:01:45.597238+0000","last_fullsized":"2024-03-18T15:01:45.597238+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272138+0000","last_change":"2024-03-18T15:01:44.580757+0000","last_active":"2024-03-18T15:01:47.272138+0000","last_peered":"2024-03-18T15:01:47.272138+0000","last_clean":"2024-03-18T15:01:47.272138+0000","last_became_active":"2024-03-18T15:01:44.580494+0000","last_became_peered":"2024-03-18T15:01:44.580494+0000","last_unstale":"2024-03-18T15:01:47.272138+0000","last_undegraded":"2024-03-18T15:01:47.272138+0000","last_fullsized":"2024-03-18T15:01:47.272138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:30:17.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597532+0000","last_change":"2024-03-18T15:01:45.583531+0000","last_active":"2024-03-18T15:01:45.597532+0000","last_peered":"2024-03-18T15:01:45.597532+0000","last_clean":"2024-03-18T15:01:45.597532+0000","last_became_active":"2024-03-18T15:01:45.583282+0000","last_became_peered":"2024-03-18T15:01:45.583282+0000","last_unstale":"2024-03-18T15:01:45.597532+0000","last_undegraded":"2024-03-18T15:01:45.597532+0000","last_fullsized":"2024-03-18T15:01:45.597532+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:15:21.257890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584775+0000","last_change":"2024-03-18T15:01:44.581812+0000","last_active":"2024-03-18T15:01:44.584775+0000","last_peered":"2024-03-18T15:01:44.584775+0000","last_clean":"2024-03-18T15:01:44.584775+0000","last_became_active":"2024-03-18T15:01:44.581380+0000","last_became_peered":"2024-03-18T15:01:44.581380+0000","last_unstale":"2024-03-18T15:01:44.584775+0000","last_undegraded":"2024-03-18T15:01:44.584775+0000","last_fullsized":"2024-03-18T15:01:44.584775+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568590+0000","last_change":"2024-03-18T15:01:44.568590+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568590+0000","last_undegraded":"2024-03-18T15:01:44.568590+0000","last_fullsized":"2024-03-18T15:01:44.568590+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.607177+0000","last_change":"2024-03-18T15:01:44.590920+0000","last_active":"2024-03-18T15:01:45.607177+0000","last_peered":"2024-03-18T15:01:45.607177+0000","last_clean":"2024-03-18T15:01:45.607177+0000","last_became_active":"2024-03-18T15:01:44.590650+0000","last_became_peered":"2024-03-18T15:01:44.590650+0000","last_unstale":"2024-03-18T15:01:45.607177+0000","last_undegraded":"2024-03-18T15:01:45.607177+0000","last_fullsized":"2024-03-18T15:01:45.607177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:26.743158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595114+0000","last_change":"2024-03-18T15:01:45.591643+0000","last_active":"2024-03-18T15:01:45.595114+0000","last_peered":"2024-03-18T15:01:45.595114+0000","last_clean":"2024-03-18T15:01:45.595114+0000","last_became_active":"2024-03-18T15:01:45.591094+0000","last_became_peered":"2024-03-18T15:01:45.591094+0000","last_unstale":"2024-03-18T15:01:45.595114+0000","last_undegraded":"2024-03-18T15:01:45.595114+0000","last_fullsized":"2024-03-18T15:01:45.595114+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:04.806298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576742+0000","last_change":"2024-03-18T15:01:44.575992+0000","last_active":"2024-03-18T15:01:44.576742+0000","last_peered":"2024-03-18T15:01:44.576742+0000","last_clean":"2024-03-18T15:01:44.576742+0000","last_became_active":"2024-03-18T15:01:44.575239+0000","last_became_peered":"2024-03-18T15:01:44.575239+0000","last_unstale":"2024-03-18T15:01:44.576742+0000","last_undegraded":"2024-03-18T15:01:44.576742+0000","last_fullsized":"2024-03-18T15:01:44.576742+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:59:37.202070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597457+0000","last_change":"2024-03-18T15:01:45.586654+0000","last_active":"2024-03-18T15:01:45.597457+0000","last_peered":"2024-03-18T15:01:45.597457+0000","last_clean":"2024-03-18T15:01:45.597457+0000","last_became_active":"2024-03-18T15:01:45.586351+0000","last_became_peered":"2024-03-18T15:01:45.586351+0000","last_unstale":"2024-03-18T15:01:45.597457+0000","last_undegraded":"2024-03-18T15:01:45.597457+0000","last_fullsized":"2024-03-18T15:01:45.597457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.577947+0000","last_change":"2024-03-18T15:01:44.583555+0000","last_active":"2024-03-18T15:01:45.577947+0000","last_peered":"2024-03-18T15:01:45.577947+0000","last_clean":"2024-03-18T15:01:45.577947+0000","last_became_active":"2024-03-18T15:01:44.583318+0000","last_became_peered":"2024-03-18T15:01:44.583318+0000","last_unstale":"2024-03-18T15:01:45.577947+0000","last_undegraded":"2024-03-18T15:01:45.577947+0000","last_fullsized":"2024-03-18T15:01:45.577947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:05.767566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.575481+0000","last_change":"2024-03-18T15:01:44.575481+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.575481+0000","last_undegraded":"2024-03-18T15:01:44.575481+0000","last_fullsized":"2024-03-18T15:01:44.575481+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.568017+0000","last_change":"2024-03-18T15:01:44.584486+0000","last_active":"2024-03-18T15:01:45.568017+0000","last_peered":"2024-03-18T15:01:45.568017+0000","last_clean":"2024-03-18T15:01:45.568017+0000","last_became_active":"2024-03-18T15:01:44.583996+0000","last_became_peered":"2024-03-18T15:01:44.583996+0000","last_unstale":"2024-03-18T15:01:45.568017+0000","last_undegraded":"2024-03-18T15:01:45.568017+0000","last_fullsized":"2024-03-18T15:01:45.568017+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:24.126775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.571710+0000","last_change":"2024-03-18T15:01:44.571710+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.571710+0000","last_undegraded":"2024-03-18T15:01:44.571710+0000","last_fullsized":"2024-03-18T15:01:44.571710+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":20,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597289+0000","last_change":"2024-03-18T15:01:44.591019+0000","last_active":"2024-03-18T15:01:45.597289+0000","last_peered":"2024-03-18T15:01:45.597289+0000","last_clean":"2024-03-18T15:01:45.597289+0000","last_became_active":"2024-03-18T15:01:44.590748+0000","last_became_peered":"2024-03-18T15:01:44.590748+0000","last_unstale":"2024-03-18T15:01:45.597289+0000","last_undegraded":"2024-03-18T15:01:45.597289+0000","last_fullsized":"2024-03-18T15:01:45.597289+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:16.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570596+0000","last_change":"2024-03-18T15:01:44.570596+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570596+0000","last_undegraded":"2024-03-18T15:01:44.570596+0000","last_fullsized":"2024-03-18T15:01:44.570596+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597685+0000","last_change":"2024-03-18T15:01:44.586226+0000","last_active":"2024-03-18T15:01:45.597685+0000","last_peered":"2024-03-18T15:01:45.597685+0000","last_clean":"2024-03-18T15:01:45.597685+0000","last_became_active":"2024-03-18T15:01:44.585825+0000","last_became_peered":"2024-03-18T15:01:44.585825+0000","last_unstale":"2024-03-18T15:01:45.597685+0000","last_undegraded":"2024-03-18T15:01:45.597685+0000","last_fullsized":"2024-03-18T15:01:45.597685+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.570804+0000","last_change":"2024-03-18T15:01:44.570804+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.570804+0000","last_undegraded":"2024-03-18T15:01:44.570804+0000","last_fullsized":"2024-03-18T15:01:44.570804+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.582127+0000","last_change":"2024-03-18T15:01:44.577960+0000","last_active":"2024-03-18T15:01:44.582127+0000","last_peered":"2024-03-18T15:01:44.582127+0000","last_clean":"2024-03-18T15:01:44.582127+0000","last_became_active":"2024-03-18T15:01:44.577693+0000","last_became_peered":"2024-03-18T15:01:44.577693+0000","last_unstale":"2024-03-18T15:01:44.582127+0000","last_undegraded":"2024-03-18T15:01:44.582127+0000","last_fullsized":"2024-03-18T15:01:44.582127+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:53:24.880750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.595916+0000","last_change":"2024-03-18T15:01:45.593734+0000","last_active":"2024-03-18T15:01:45.595916+0000","last_peered":"2024-03-18T15:01:45.595916+0000","last_clean":"2024-03-18T15:01:45.595916+0000","last_became_active":"2024-03-18T15:01:45.593152+0000","last_became_peered":"2024-03-18T15:01:45.593152+0000","last_unstale":"2024-03-18T15:01:45.595916+0000","last_undegraded":"2024-03-18T15:01:45.595916+0000","last_fullsized":"2024-03-18T15:01:45.595916+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:27.745287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584851+0000","last_change":"2024-03-18T15:01:44.581685+0000","last_active":"2024-03-18T15:01:44.584851+0000","last_peered":"2024-03-18T15:01:44.584851+0000","last_clean":"2024-03-18T15:01:44.584851+0000","last_became_active":"2024-03-18T15:01:44.580454+0000","last_became_peered":"2024-03-18T15:01:44.580454+0000","last_unstale":"2024-03-18T15:01:44.584851+0000","last_undegraded":"2024-03-18T15:01:44.584851+0000","last_fullsized":"2024-03-18T15:01:44.584851+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:30:26.393760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588258+0000","last_change":"2024-03-18T15:01:45.584816+0000","last_active":"2024-03-18T15:01:45.588258+0000","last_peered":"2024-03-18T15:01:45.588258+0000","last_clean":"2024-03-18T15:01:45.588258+0000","last_became_active":"2024-03-18T15:01:45.584207+0000","last_became_peered":"2024-03-18T15:01:45.584207+0000","last_unstale":"2024-03-18T15:01:45.588258+0000","last_undegraded":"2024-03-18T15:01:45.588258+0000","last_fullsized":"2024-03-18T15:01:45.588258+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:07:34.107092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584869+0000","last_change":"2024-03-18T15:01:44.581724+0000","last_active":"2024-03-18T15:01:44.584869+0000","last_peered":"2024-03-18T15:01:44.584869+0000","last_clean":"2024-03-18T15:01:44.584869+0000","last_became_active":"2024-03-18T15:01:44.581433+0000","last_became_peered":"2024-03-18T15:01:44.581433+0000","last_unstale":"2024-03-18T15:01:44.584869+0000","last_undegraded":"2024-03-18T15:01:44.584869+0000","last_fullsized":"2024-03-18T15:01:44.584869+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:32:35.465739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.591216+0000","last_change":"2024-03-18T15:01:45.588729+0000","last_active":"2024-03-18T15:01:45.591216+0000","last_peered":"2024-03-18T15:01:45.591216+0000","last_clean":"2024-03-18T15:01:45.591216+0000","last_became_active":"2024-03-18T15:01:45.588437+0000","last_became_peered":"2024-03-18T15:01:45.588437+0000","last_unstale":"2024-03-18T15:01:45.591216+0000","last_undegraded":"2024-03-18T15:01:45.591216+0000","last_fullsized":"2024-03-18T15:01:45.591216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:04:35.550334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272096+0000","last_change":"2024-03-18T15:01:44.578094+0000","last_active":"2024-03-18T15:01:47.272096+0000","last_peered":"2024-03-18T15:01:47.272096+0000","last_clean":"2024-03-18T15:01:47.272096+0000","last_became_active":"2024-03-18T15:01:44.577795+0000","last_became_peered":"2024-03-18T15:01:44.577795+0000","last_unstale":"2024-03-18T15:01:47.272096+0000","last_undegraded":"2024-03-18T15:01:47.272096+0000","last_fullsized":"2024-03-18T15:01:47.272096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:09.592082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585440+0000","last_change":"2024-03-18T15:01:45.583341+0000","last_active":"2024-03-18T15:01:45.585440+0000","last_peered":"2024-03-18T15:01:45.585440+0000","last_clean":"2024-03-18T15:01:45.585440+0000","last_became_active":"2024-03-18T15:01:45.581780+0000","last_became_peered":"2024-03-18T15:01:45.581780+0000","last_unstale":"2024-03-18T15:01:45.585440+0000","last_undegraded":"2024-03-18T15:01:45.585440+0000","last_fullsized":"2024-03-18T15:01:45.585440+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T03:00:44.092834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.590297+0000","last_change":"2024-03-18T15:01:44.586298+0000","last_active":"2024-03-18T15:01:44.590297+0000","last_peered":"2024-03-18T15:01:44.590297+0000","last_clean":"2024-03-18T15:01:44.590297+0000","last_became_active":"2024-03-18T15:01:44.586027+0000","last_became_peered":"2024-03-18T15:01:44.586027+0000","last_unstale":"2024-03-18T15:01:44.590297+0000","last_undegraded":"2024-03-18T15:01:44.590297+0000","last_fullsized":"2024-03-18T15:01:44.590297+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:20:43.058800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.588225+0000","last_change":"2024-03-18T15:01:45.582437+0000","last_active":"2024-03-18T15:01:45.588225+0000","last_peered":"2024-03-18T15:01:45.588225+0000","last_clean":"2024-03-18T15:01:45.588225+0000","last_became_active":"2024-03-18T15:01:45.582184+0000","last_became_peered":"2024-03-18T15:01:45.582184+0000","last_unstale":"2024-03-18T15:01:45.588225+0000","last_undegraded":"2024-03-18T15:01:45.588225+0000","last_fullsized":"2024-03-18T15:01:45.588225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:39:58.583093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.584827+0000","last_change":"2024-03-18T15:01:44.579707+0000","last_active":"2024-03-18T15:01:44.584827+0000","last_peered":"2024-03-18T15:01:44.584827+0000","last_clean":"2024-03-18T15:01:44.584827+0000","last_became_active":"2024-03-18T15:01:44.579403+0000","last_became_peered":"2024-03-18T15:01:44.579403+0000","last_unstale":"2024-03-18T15:01:44.584827+0000","last_undegraded":"2024-03-18T15:01:44.584827+0000","last_fullsized":"2024-03-18T15:01:44.584827+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:38:07.748919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.574547+0000","last_change":"2024-03-18T15:01:44.574547+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.574547+0000","last_undegraded":"2024-03-18T15:01:44.574547+0000","last_fullsized":"2024-03-18T15:01:44.574547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.581953+0000","last_change":"2024-03-18T15:01:44.580696+0000","last_active":"2024-03-18T15:01:44.581953+0000","last_peered":"2024-03-18T15:01:44.581953+0000","last_clean":"2024-03-18T15:01:44.581953+0000","last_became_active":"2024-03-18T15:01:44.580427+0000","last_became_peered":"2024-03-18T15:01:44.580427+0000","last_unstale":"2024-03-18T15:01:44.581953+0000","last_undegraded":"2024-03-18T15:01:44.581953+0000","last_fullsized":"2024-03-18T15:01:44.581953+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.585403+0000","last_change":"2024-03-18T15:01:45.581595+0000","last_active":"2024-03-18T15:01:45.585403+0000","last_peered":"2024-03-18T15:01:45.585403+0000","last_clean":"2024-03-18T15:01:45.585403+0000","last_became_active":"2024-03-18T15:01:45.581349+0000","last_became_peered":"2024-03-18T15:01:45.581349+0000","last_unstale":"2024-03-18T15:01:45.585403+0000","last_undegraded":"2024-03-18T15:01:45.585403+0000","last_fullsized":"2024-03-18T15:01:45.585403+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:27:30.207924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":14,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.599364+0000","last_change":"2024-03-18T15:01:44.586423+0000","last_active":"2024-03-18T15:01:45.599364+0000","last_peered":"2024-03-18T15:01:45.599364+0000","last_clean":"2024-03-18T15:01:45.599364+0000","last_became_active":"2024-03-18T15:01:44.586184+0000","last_became_peered":"2024-03-18T15:01:44.586184+0000","last_unstale":"2024-03-18T15:01:45.599364+0000","last_undegraded":"2024-03-18T15:01:45.599364+0000","last_fullsized":"2024-03-18T15:01:45.599364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.568072+0000","last_change":"2024-03-18T15:01:44.568072+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.568072+0000","last_undegraded":"2024-03-18T15:01:44.568072+0000","last_fullsized":"2024-03-18T15:01:44.568072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.570652+0000","last_change":"2024-03-18T15:01:44.577390+0000","last_active":"2024-03-18T15:01:47.570652+0000","last_peered":"2024-03-18T15:01:47.570652+0000","last_clean":"2024-03-18T15:01:47.570652+0000","last_became_active":"2024-03-18T15:01:44.577063+0000","last_became_peered":"2024-03-18T15:01:44.577063+0000","last_unstale":"2024-03-18T15:01:47.570652+0000","last_undegraded":"2024-03-18T15:01:47.570652+0000","last_fullsized":"2024-03-18T15:01:47.570652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:36:53.370038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272026+0000","last_change":"2024-03-18T15:01:45.586835+0000","last_active":"2024-03-18T15:01:47.272026+0000","last_peered":"2024-03-18T15:01:47.272026+0000","last_clean":"2024-03-18T15:01:47.272026+0000","last_became_active":"2024-03-18T15:01:45.586551+0000","last_became_peered":"2024-03-18T15:01:45.586551+0000","last_unstale":"2024-03-18T15:01:47.272026+0000","last_undegraded":"2024-03-18T15:01:47.272026+0000","last_fullsized":"2024-03-18T15:01:47.272026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:36.347293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578345+0000","last_change":"2024-03-18T15:01:44.582617+0000","last_active":"2024-03-18T15:01:45.578345+0000","last_peered":"2024-03-18T15:01:45.578345+0000","last_clean":"2024-03-18T15:01:45.578345+0000","last_became_active":"2024-03-18T15:01:44.582360+0000","last_became_peered":"2024-03-18T15:01:44.582360+0000","last_unstale":"2024-03-18T15:01:45.578345+0000","last_undegraded":"2024-03-18T15:01:45.578345+0000","last_fullsized":"2024-03-18T15:01:45.578345+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:21.996890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.572458+0000","last_change":"2024-03-18T15:01:44.572458+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.572458+0000","last_undegraded":"2024-03-18T15:01:44.572458+0000","last_fullsized":"2024-03-18T15:01:44.572458+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272205+0000","last_change":"2024-03-18T15:01:44.576244+0000","last_active":"2024-03-18T15:01:47.272205+0000","last_peered":"2024-03-18T15:01:47.272205+0000","last_clean":"2024-03-18T15:01:47.272205+0000","last_became_active":"2024-03-18T15:01:44.575962+0000","last_became_peered":"2024-03-18T15:01:44.575962+0000","last_unstale":"2024-03-18T15:01:47.272205+0000","last_undegraded":"2024-03-18T15:01:47.272205+0000","last_fullsized":"2024-03-18T15:01:47.272205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:35.539249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272095+0000","last_change":"2024-03-18T15:01:45.585416+0000","last_active":"2024-03-18T15:01:47.272095+0000","last_peered":"2024-03-18T15:01:47.272095+0000","last_clean":"2024-03-18T15:01:47.272095+0000","last_became_active":"2024-03-18T15:01:45.585131+0000","last_became_peered":"2024-03-18T15:01:45.585131+0000","last_unstale":"2024-03-18T15:01:47.272095+0000","last_undegraded":"2024-03-18T15:01:47.272095+0000","last_fullsized":"2024-03-18T15:01:47.272095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:05.806548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.578092+0000","last_change":"2024-03-18T15:01:44.581622+0000","last_active":"2024-03-18T15:01:45.578092+0000","last_peered":"2024-03-18T15:01:45.578092+0000","last_clean":"2024-03-18T15:01:45.578092+0000","last_became_active":"2024-03-18T15:01:44.581349+0000","last_became_peered":"2024-03-18T15:01:44.581349+0000","last_unstale":"2024-03-18T15:01:45.578092+0000","last_undegraded":"2024-03-18T15:01:45.578092+0000","last_fullsized":"2024-03-18T15:01:45.578092+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:56.837150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.597387+0000","last_change":"2024-03-18T15:01:45.594192+0000","last_active":"2024-03-18T15:01:45.597387+0000","last_peered":"2024-03-18T15:01:45.597387+0000","last_clean":"2024-03-18T15:01:45.597387+0000","last_became_active":"2024-03-18T15:01:45.586383+0000","last_became_peered":"2024-03-18T15:01:45.586383+0000","last_unstale":"2024-03-18T15:01:45.597387+0000","last_undegraded":"2024-03-18T15:01:45.597387+0000","last_fullsized":"2024-03-18T15:01:45.597387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.576169+0000","last_change":"2024-03-18T15:01:44.575596+0000","last_active":"2024-03-18T15:01:44.576169+0000","last_peered":"2024-03-18T15:01:44.576169+0000","last_clean":"2024-03-18T15:01:44.576169+0000","last_became_active":"2024-03-18T15:01:44.575268+0000","last_became_peered":"2024-03-18T15:01:44.575268+0000","last_unstale":"2024-03-18T15:01:44.576169+0000","last_undegraded":"2024-03-18T15:01:44.576169+0000","last_fullsized":"2024-03-18T15:01:44.576169+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:24:52.305415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.569827+0000","last_change":"2024-03-18T15:01:44.569827+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.569827+0000","last_undegraded":"2024-03-18T15:01:44.569827+0000","last_fullsized":"2024-03-18T15:01:44.569827+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-03-18T15:01:45.569177+0000","last_change":"2024-03-18T15:01:44.583590+0000","last_active":"2024-03-18T15:01:45.569177+0000","last_peered":"2024-03-18T15:01:45.569177+0000","last_clean":"2024-03-18T15:01:45.569177+0000","last_became_active":"2024-03-18T15:01:44.583339+0000","last_became_peered":"2024-03-18T15:01:44.583339+0000","last_unstale":"2024-03-18T15:01:45.569177+0000","last_undegraded":"2024-03-18T15:01:45.569177+0000","last_fullsized":"2024-03-18T15:01:45.569177+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:48.250219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":1,"reported_epoch":33,"state":"creating+peering","last_fresh":"2024-03-18T15:01:44.573669+0000","last_change":"2024-03-18T15:01:44.573669+0000","last_active":"2024-03-18T15:01:44.558589+0000","last_peered":"2024-03-18T15:01:44.558589+0000","last_clean":"2024-03-18T15:01:44.558589+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-03-18T15:01:44.573669+0000","last_undegraded":"2024-03-18T15:01:44.573669+0000","last_fullsized":"2024-03-18T15:01:44.573669+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.587387+0000","last_change":"2024-03-18T15:01:44.583257+0000","last_active":"2024-03-18T15:01:44.587387+0000","last_peered":"2024-03-18T15:01:44.587387+0000","last_clean":"2024-03-18T15:01:44.587387+0000","last_became_active":"2024-03-18T15:01:44.582921+0000","last_became_peered":"2024-03-18T15:01:44.582921+0000","last_unstale":"2024-03-18T15:01:44.587387+0000","last_undegraded":"2024-03-18T15:01:44.587387+0000","last_fullsized":"2024-03-18T15:01:44.587387+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:22:13.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":189,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-03-18T15:01:44.577275+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:01:44.577275+0000","last_peered":"2024-03-18T15:01:44.577275+0000","last_clean":"2024-03-18T15:01:44.577275+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:01:44.577275+0000","last_undegraded":"2024-03-18T15:01:44.577275+0000","last_fullsized":"2024-03-18T15:01:44.577275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1634,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":10,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":3338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25,"ondisk_log_size":25,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509459,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509458,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":149060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343880,"statfs":{"total":96636764160,"available":96608133120,"internally_reserved":0,"allocated":958464,"data_stored":731019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542160,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":344,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":352256,"data_stored":134384,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542161,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":356,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":364544,"data_stored":140651,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":744094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:52.987 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T15:01:53.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 Processor -- start 2024-03-18T15:01:53.090 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 -- start start 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f97cc0cf310 0x7f97cc0ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97cc0cc4b0 con 0x7f97cc06d870 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f97cc0ccda0 con 0x7f97cc0cf310 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.090+0000 7f97d2362640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc0ce240 con 0x7f97cc15e550 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97d08ff640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f97cc06d870 0x7f97cc0cfd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:37714/0 (socket says 172.21.15.152:37714) 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97d08ff640 1 -- 172.21.15.152:0/2537263865 learned_addr learned my addr 172.21.15.152:0/2537263865 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 441088106 0 0) 0x7f97cc0cc4b0 con 0x7f97cc06d870 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f97b4003520 con 0x7f97cc06d870 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97cb7fe640 1 --2- 172.21.15.152:0/2537263865 >> v2:172.21.15.186:3300/0 conn(0x7f97cc0cf310 0x7f97cc0ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97cbfff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.094 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3700344591 0 0) 0x7f97b4003520 con 0x7f97cc06d870 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 msgr2=0x7f97cc06d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97cc06d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 >> v2:172.21.15.186:3300/0 conn(0x7f97cc0cf310 msgr2=0x7f97cc0ce6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 --2- 172.21.15.152:0/2537263865 >> v2:172.21.15.186:3300/0 conn(0x7f97cc0cf310 0x7f97cc0ce6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc06dcf0 con 0x7f97cc06d870 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f97c40019f0 con 0x7f97cc06d870 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 >> v1:172.21.15.152:6789/0 conn(0x7f97cc06d870 legacy=0x7f97cc0cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97b4003a20 0x7f97b4003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97b4004800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97b4004d40 0x7f97b40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0ccda0 con 0x7f97b4004d40 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0ce240 con 0x7f97b4003a20 2024-03-18T15:01:53.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.091+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f97b400ba40 con 0x7f97cc15e550 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97b4004d40 0x7f97b40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97cbfff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97b4003a20 0x7f97b4003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97cb7fe640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97b4004800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 -- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 msgr2=0x7f97b4004800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97cc15e550 0x7f97b4004800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 -- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97b4003a20 msgr2=0x7f97b4003e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97b4003a20 0x7f97b4003e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.092+0000 7f97d08ff640 1 -- 172.21.15.152:0/2537263865 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b4003520 con 0x7f97b4004d40 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d08ff640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97b4004d40 0x7f97b40051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f97c400a8a0 tx=0x7f97b4005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fdc3242c3612f7a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c400a4c0 con 0x7f97b4004d40 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c4034650 con 0x7f97b4004d40 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97caffd640 1 -- 172.21.15.152:0/2537263865 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c4034a40 con 0x7f97b4004d40 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 -- 172.21.15.152:0/2537263865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97b4004d40 msgr2=0x7f97b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 --2- 172.21.15.152:0/2537263865 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97b4004d40 0x7f97b40051c0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f97c400a8a0 tx=0x7f97b4005830 comp rx=0 tx=0).stop 2024-03-18T15:01:53.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d08ff640 1 -- 172.21.15.152:0/2537263865 reap_dead start 2024-03-18T15:01:53.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 -- 172.21.15.152:0/2537263865 shutdown_connections 2024-03-18T15:01:53.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 -- 172.21.15.152:0/2537263865 >> 172.21.15.152:0/2537263865 conn(0x7f97cc0d1e60 msgr2=0x7f97cc0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:53.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 -- 172.21.15.152:0/2537263865 shutdown_connections 2024-03-18T15:01:53.097 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.093+0000 7f97d2362640 1 -- 172.21.15.152:0/2537263865 wait complete. 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.094+0000 7f97d2362640 1 Processor -- start 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 -- start start 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97b4004d40 0x7f97cc15b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 0x7f97cc15f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0aebb0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.100 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f97cc0cca30 con 0x7f97cc15ecf0 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97d2362640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f97cc15e930 con 0x7f97b4004d40 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97cb7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48854/0 (socket says 172.21.15.152:48854) 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.095+0000 7f97cb7fe640 1 -- 172.21.15.152:0/3545682489 learned_addr learned my addr 172.21.15.152:0/3545682489 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cbfff640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97b4004d40 0x7f97cc15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97d08ff640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 0x7f97cc15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 -- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97b4004d40 msgr2=0x7f97cc15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97b4004d40 0x7f97cc15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 -- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 msgr2=0x7f97cc15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 0x7f97cc15f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 -- 172.21.15.152:0/3545682489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97cc1f7c10 con 0x7f97cc1f77b0 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97d08ff640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 0x7f97cc15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:53.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97cb7fe640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f97c0011a70 tx=0x7f97c0011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c000fb50 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97c000fcf0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97cc1f7ee0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97c000fea0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.096+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97cc1f84a0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.097+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97cc04f5b0 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.098+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f97c0012040 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.098+0000 7f97c8ff9640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 0x7f97b806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.098+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f97c008b140 con 0x7f97cc1f77b0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.098+0000 7f97cbfff640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 0x7f97b806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.099+0000 7f97cbfff640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 0x7f97b806e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009a80 tx=0x7f97bc008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.103 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.102+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f97c0019030 con 0x7f97cc1f77b0 2024-03-18T15:01:53.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.278+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f97cc1f86a0 con 0x7f97b806bbd0 2024-03-18T15:01:53.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.284+0000 7f97c8ff9640 1 -- 172.21.15.152:0/3545682489 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251939 (secure 0 0 0) 0x7f97cc1f86a0 con 0x7f97b806bbd0 2024-03-18T15:01:53.287 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:53.288 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 msgr2=0x7f97b806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 0x7f97b806e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f97bc009a80 tx=0x7f97bc008040 comp rx=0 tx=0).stop 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 msgr2=0x7f97cc09f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f97c0011a70 tx=0x7f97c0011f30 comp rx=0 tx=0).stop 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 shutdown_connections 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f97cc15ecf0 0x7f97cc15f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f97cc1f77b0 0x7f97cc09f530 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f97b806bbd0 0x7f97b806e090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 --2- 172.21.15.152:0/3545682489 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f97b4004d40 0x7f97cc15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 >> 172.21.15.152:0/3545682489 conn(0x7f97cc0d1e60 msgr2=0x7f97cc0aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 shutdown_connections 2024-03-18T15:01:53.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.287+0000 7f97d2362640 1 -- 172.21.15.152:0/3545682489 wait complete. 2024-03-18T15:01:53.298 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":67,"stamp":"2024-03-18T15:01:51.816480+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224584,"kb_used_data":4264,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750136,"statfs":{"total":773094113280,"available":772864139264,"internally_reserved":0,"allocated":4366336,"data_stored":2415364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.252024"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672677+0000","last_change":"2024-03-18T15:01:45.587332+0000","last_active":"2024-03-18T15:01:48.672677+0000","last_peered":"2024-03-18T15:01:48.672677+0000","last_clean":"2024-03-18T15:01:48.672677+0000","last_became_active":"2024-03-18T15:01:45.586531+0000","last_became_peered":"2024-03-18T15:01:45.586531+0000","last_unstale":"2024-03-18T15:01:48.672677+0000","last_undegraded":"2024-03-18T15:01:48.672677+0000","last_fullsized":"2024-03-18T15:01:48.672677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:30:16.912016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661344+0000","last_change":"2024-03-18T15:01:45.592575+0000","last_active":"2024-03-18T15:01:48.661344+0000","last_peered":"2024-03-18T15:01:48.661344+0000","last_clean":"2024-03-18T15:01:48.661344+0000","last_became_active":"2024-03-18T15:01:45.586032+0000","last_became_peered":"2024-03-18T15:01:45.586032+0000","last_unstale":"2024-03-18T15:01:48.661344+0000","last_undegraded":"2024-03-18T15:01:48.661344+0000","last_fullsized":"2024-03-18T15:01:48.661344+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:19:11.987878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587311+0000","last_change":"2024-03-18T15:01:45.583576+0000","last_active":"2024-03-18T15:01:46.587311+0000","last_peered":"2024-03-18T15:01:46.587311+0000","last_clean":"2024-03-18T15:01:46.587311+0000","last_became_active":"2024-03-18T15:01:45.583267+0000","last_became_peered":"2024-03-18T15:01:45.583267+0000","last_unstale":"2024-03-18T15:01:46.587311+0000","last_undegraded":"2024-03-18T15:01:46.587311+0000","last_fullsized":"2024-03-18T15:01:46.587311+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:54:27.683929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583228+0000","last_change":"2024-03-18T15:01:45.587946+0000","last_active":"2024-03-18T15:01:46.583228+0000","last_peered":"2024-03-18T15:01:46.583228+0000","last_clean":"2024-03-18T15:01:46.583228+0000","last_became_active":"2024-03-18T15:01:45.587670+0000","last_became_peered":"2024-03-18T15:01:45.587670+0000","last_unstale":"2024-03-18T15:01:46.583228+0000","last_undegraded":"2024-03-18T15:01:46.583228+0000","last_fullsized":"2024-03-18T15:01:46.583228+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720078+0000","last_change":"2024-03-18T15:01:45.595395+0000","last_active":"2024-03-18T15:01:48.720078+0000","last_peered":"2024-03-18T15:01:48.720078+0000","last_clean":"2024-03-18T15:01:48.720078+0000","last_became_active":"2024-03-18T15:01:45.595169+0000","last_became_peered":"2024-03-18T15:01:45.595169+0000","last_unstale":"2024-03-18T15:01:48.720078+0000","last_undegraded":"2024-03-18T15:01:48.720078+0000","last_fullsized":"2024-03-18T15:01:48.720078+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:16:46.348471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661080+0000","last_change":"2024-03-18T15:01:45.578000+0000","last_active":"2024-03-18T15:01:48.661080+0000","last_peered":"2024-03-18T15:01:48.661080+0000","last_clean":"2024-03-18T15:01:48.661080+0000","last_became_active":"2024-03-18T15:01:45.577724+0000","last_became_peered":"2024-03-18T15:01:45.577724+0000","last_unstale":"2024-03-18T15:01:48.661080+0000","last_undegraded":"2024-03-18T15:01:48.661080+0000","last_fullsized":"2024-03-18T15:01:48.661080+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:51:22.863364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585635+0000","last_change":"2024-03-18T15:01:45.588501+0000","last_active":"2024-03-18T15:01:46.585635+0000","last_peered":"2024-03-18T15:01:46.585635+0000","last_clean":"2024-03-18T15:01:46.585635+0000","last_became_active":"2024-03-18T15:01:45.586738+0000","last_became_peered":"2024-03-18T15:01:45.586738+0000","last_unstale":"2024-03-18T15:01:46.585635+0000","last_undegraded":"2024-03-18T15:01:46.585635+0000","last_fullsized":"2024-03-18T15:01:46.585635+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:51:22.863364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585007+0000","last_change":"2024-03-18T15:01:45.577942+0000","last_active":"2024-03-18T15:01:46.585007+0000","last_peered":"2024-03-18T15:01:46.585007+0000","last_clean":"2024-03-18T15:01:46.585007+0000","last_became_active":"2024-03-18T15:01:45.577679+0000","last_became_peered":"2024-03-18T15:01:45.577679+0000","last_unstale":"2024-03-18T15:01:46.585007+0000","last_undegraded":"2024-03-18T15:01:46.585007+0000","last_fullsized":"2024-03-18T15:01:46.585007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334537+0000","last_change":"2024-03-18T15:01:45.586418+0000","last_active":"2024-03-18T15:01:48.334537+0000","last_peered":"2024-03-18T15:01:48.334537+0000","last_clean":"2024-03-18T15:01:48.334537+0000","last_became_active":"2024-03-18T15:01:45.586043+0000","last_became_peered":"2024-03-18T15:01:45.586043+0000","last_unstale":"2024-03-18T15:01:48.334537+0000","last_undegraded":"2024-03-18T15:01:48.334537+0000","last_fullsized":"2024-03-18T15:01:48.334537+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:35:52.021936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583193+0000","last_change":"2024-03-18T15:01:45.598002+0000","last_active":"2024-03-18T15:01:46.583193+0000","last_peered":"2024-03-18T15:01:46.583193+0000","last_clean":"2024-03-18T15:01:46.583193+0000","last_became_active":"2024-03-18T15:01:45.597734+0000","last_became_peered":"2024-03-18T15:01:45.597734+0000","last_unstale":"2024-03-18T15:01:46.583193+0000","last_undegraded":"2024-03-18T15:01:46.583193+0000","last_fullsized":"2024-03-18T15:01:46.583193+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:15:21.257890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585295+0000","last_change":"2024-03-18T15:01:45.584579+0000","last_active":"2024-03-18T15:01:46.585295+0000","last_peered":"2024-03-18T15:01:46.585295+0000","last_clean":"2024-03-18T15:01:46.585295+0000","last_became_active":"2024-03-18T15:01:45.584239+0000","last_became_peered":"2024-03-18T15:01:45.584239+0000","last_unstale":"2024-03-18T15:01:46.585295+0000","last_undegraded":"2024-03-18T15:01:46.585295+0000","last_fullsized":"2024-03-18T15:01:46.585295+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587182+0000","last_change":"2024-03-18T15:01:45.581960+0000","last_active":"2024-03-18T15:01:46.587182+0000","last_peered":"2024-03-18T15:01:46.587182+0000","last_clean":"2024-03-18T15:01:46.587182+0000","last_became_active":"2024-03-18T15:01:45.581646+0000","last_became_peered":"2024-03-18T15:01:45.581646+0000","last_unstale":"2024-03-18T15:01:46.587182+0000","last_undegraded":"2024-03-18T15:01:46.587182+0000","last_fullsized":"2024-03-18T15:01:46.587182+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720124+0000","last_change":"2024-03-18T15:01:45.583364+0000","last_active":"2024-03-18T15:01:48.720124+0000","last_peered":"2024-03-18T15:01:48.720124+0000","last_clean":"2024-03-18T15:01:48.720124+0000","last_became_active":"2024-03-18T15:01:45.582846+0000","last_became_peered":"2024-03-18T15:01:45.582846+0000","last_unstale":"2024-03-18T15:01:48.720124+0000","last_undegraded":"2024-03-18T15:01:48.720124+0000","last_fullsized":"2024-03-18T15:01:48.720124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:50:32.559957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661077+0000","last_change":"2024-03-18T15:01:45.581704+0000","last_active":"2024-03-18T15:01:48.661077+0000","last_peered":"2024-03-18T15:01:48.661077+0000","last_clean":"2024-03-18T15:01:48.661077+0000","last_became_active":"2024-03-18T15:01:45.581288+0000","last_became_peered":"2024-03-18T15:01:45.581288+0000","last_unstale":"2024-03-18T15:01:48.661077+0000","last_undegraded":"2024-03-18T15:01:48.661077+0000","last_fullsized":"2024-03-18T15:01:48.661077+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:47:10.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.586886+0000","last_change":"2024-03-18T15:01:45.585845+0000","last_active":"2024-03-18T15:01:46.586886+0000","last_peered":"2024-03-18T15:01:46.586886+0000","last_clean":"2024-03-18T15:01:46.586886+0000","last_became_active":"2024-03-18T15:01:45.585574+0000","last_became_peered":"2024-03-18T15:01:45.585574+0000","last_unstale":"2024-03-18T15:01:46.586886+0000","last_undegraded":"2024-03-18T15:01:46.586886+0000","last_fullsized":"2024-03-18T15:01:46.586886+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585667+0000","last_change":"2024-03-18T15:01:45.579845+0000","last_active":"2024-03-18T15:01:46.585667+0000","last_peered":"2024-03-18T15:01:46.585667+0000","last_clean":"2024-03-18T15:01:46.585667+0000","last_became_active":"2024-03-18T15:01:45.579591+0000","last_became_peered":"2024-03-18T15:01:45.579591+0000","last_unstale":"2024-03-18T15:01:46.585667+0000","last_undegraded":"2024-03-18T15:01:46.585667+0000","last_fullsized":"2024-03-18T15:01:46.585667+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:18:53.231076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585457+0000","last_change":"2024-03-18T15:01:45.588797+0000","last_active":"2024-03-18T15:01:46.585457+0000","last_peered":"2024-03-18T15:01:46.585457+0000","last_clean":"2024-03-18T15:01:46.585457+0000","last_became_active":"2024-03-18T15:01:45.588475+0000","last_became_peered":"2024-03-18T15:01:45.588475+0000","last_unstale":"2024-03-18T15:01:46.585457+0000","last_undegraded":"2024-03-18T15:01:46.585457+0000","last_fullsized":"2024-03-18T15:01:46.585457+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:21:16.228259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661429+0000","last_change":"2024-03-18T15:01:45.593046+0000","last_active":"2024-03-18T15:01:48.661429+0000","last_peered":"2024-03-18T15:01:48.661429+0000","last_clean":"2024-03-18T15:01:48.661429+0000","last_became_active":"2024-03-18T15:01:45.592791+0000","last_became_peered":"2024-03-18T15:01:45.592791+0000","last_unstale":"2024-03-18T15:01:48.661429+0000","last_undegraded":"2024-03-18T15:01:48.661429+0000","last_fullsized":"2024-03-18T15:01:48.661429+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:42:24.145442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661248+0000","last_change":"2024-03-18T15:01:45.586629+0000","last_active":"2024-03-18T15:01:48.661248+0000","last_peered":"2024-03-18T15:01:48.661248+0000","last_clean":"2024-03-18T15:01:48.661248+0000","last_became_active":"2024-03-18T15:01:45.586335+0000","last_became_peered":"2024-03-18T15:01:45.586335+0000","last_unstale":"2024-03-18T15:01:48.661248+0000","last_undegraded":"2024-03-18T15:01:48.661248+0000","last_fullsized":"2024-03-18T15:01:48.661248+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:12.699994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720378+0000","last_change":"2024-03-18T15:01:45.584429+0000","last_active":"2024-03-18T15:01:48.720378+0000","last_peered":"2024-03-18T15:01:48.720378+0000","last_clean":"2024-03-18T15:01:48.720378+0000","last_became_active":"2024-03-18T15:01:45.584158+0000","last_became_peered":"2024-03-18T15:01:45.584158+0000","last_unstale":"2024-03-18T15:01:48.720378+0000","last_undegraded":"2024-03-18T15:01:48.720378+0000","last_fullsized":"2024-03-18T15:01:48.720378+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:22.999019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334101+0000","last_change":"2024-03-18T15:01:45.587841+0000","last_active":"2024-03-18T15:01:48.334101+0000","last_peered":"2024-03-18T15:01:48.334101+0000","last_clean":"2024-03-18T15:01:48.334101+0000","last_became_active":"2024-03-18T15:01:45.587556+0000","last_became_peered":"2024-03-18T15:01:45.587556+0000","last_unstale":"2024-03-18T15:01:48.334101+0000","last_undegraded":"2024-03-18T15:01:48.334101+0000","last_fullsized":"2024-03-18T15:01:48.334101+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:42:14.555502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334165+0000","last_change":"2024-03-18T15:01:45.598165+0000","last_active":"2024-03-18T15:01:48.334165+0000","last_peered":"2024-03-18T15:01:48.334165+0000","last_clean":"2024-03-18T15:01:48.334165+0000","last_became_active":"2024-03-18T15:01:45.597872+0000","last_became_peered":"2024-03-18T15:01:45.597872+0000","last_unstale":"2024-03-18T15:01:48.334165+0000","last_undegraded":"2024-03-18T15:01:48.334165+0000","last_fullsized":"2024-03-18T15:01:48.334165+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:59:27.829478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272005+0000","last_change":"2024-03-18T15:01:45.589740+0000","last_active":"2024-03-18T15:01:47.272005+0000","last_peered":"2024-03-18T15:01:47.272005+0000","last_clean":"2024-03-18T15:01:47.272005+0000","last_became_active":"2024-03-18T15:01:45.589437+0000","last_became_peered":"2024-03-18T15:01:45.589437+0000","last_unstale":"2024-03-18T15:01:47.272005+0000","last_undegraded":"2024-03-18T15:01:47.272005+0000","last_fullsized":"2024-03-18T15:01:47.272005+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:21:52.157719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.586798+0000","last_change":"2024-03-18T15:01:45.575453+0000","last_active":"2024-03-18T15:01:46.586798+0000","last_peered":"2024-03-18T15:01:46.586798+0000","last_clean":"2024-03-18T15:01:46.586798+0000","last_became_active":"2024-03-18T15:01:45.575218+0000","last_became_peered":"2024-03-18T15:01:45.575218+0000","last_unstale":"2024-03-18T15:01:46.586798+0000","last_undegraded":"2024-03-18T15:01:46.586798+0000","last_fullsized":"2024-03-18T15:01:46.586798+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583418+0000","last_change":"2024-03-18T15:01:45.583520+0000","last_active":"2024-03-18T15:01:46.583418+0000","last_peered":"2024-03-18T15:01:46.583418+0000","last_clean":"2024-03-18T15:01:46.583418+0000","last_became_active":"2024-03-18T15:01:45.583058+0000","last_became_peered":"2024-03-18T15:01:45.583058+0000","last_unstale":"2024-03-18T15:01:46.583418+0000","last_undegraded":"2024-03-18T15:01:46.583418+0000","last_fullsized":"2024-03-18T15:01:46.583418+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661467+0000","last_change":"2024-03-18T15:01:45.581296+0000","last_active":"2024-03-18T15:01:48.661467+0000","last_peered":"2024-03-18T15:01:48.661467+0000","last_clean":"2024-03-18T15:01:48.661467+0000","last_became_active":"2024-03-18T15:01:45.581030+0000","last_became_peered":"2024-03-18T15:01:45.581030+0000","last_unstale":"2024-03-18T15:01:48.661467+0000","last_undegraded":"2024-03-18T15:01:48.661467+0000","last_fullsized":"2024-03-18T15:01:48.661467+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:40:50.428328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583556+0000","last_change":"2024-03-18T15:01:45.593019+0000","last_active":"2024-03-18T15:01:46.583556+0000","last_peered":"2024-03-18T15:01:46.583556+0000","last_clean":"2024-03-18T15:01:46.583556+0000","last_became_active":"2024-03-18T15:01:45.592763+0000","last_became_peered":"2024-03-18T15:01:45.592763+0000","last_unstale":"2024-03-18T15:01:46.583556+0000","last_undegraded":"2024-03-18T15:01:46.583556+0000","last_fullsized":"2024-03-18T15:01:46.583556+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587315+0000","last_change":"2024-03-18T15:01:45.585963+0000","last_active":"2024-03-18T15:01:46.587315+0000","last_peered":"2024-03-18T15:01:46.587315+0000","last_clean":"2024-03-18T15:01:46.587315+0000","last_became_active":"2024-03-18T15:01:45.585660+0000","last_became_peered":"2024-03-18T15:01:45.585660+0000","last_unstale":"2024-03-18T15:01:46.587315+0000","last_undegraded":"2024-03-18T15:01:46.587315+0000","last_fullsized":"2024-03-18T15:01:46.587315+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:58:42.604939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334072+0000","last_change":"2024-03-18T15:01:45.598193+0000","last_active":"2024-03-18T15:01:48.334072+0000","last_peered":"2024-03-18T15:01:48.334072+0000","last_clean":"2024-03-18T15:01:48.334072+0000","last_became_active":"2024-03-18T15:01:45.597874+0000","last_became_peered":"2024-03-18T15:01:45.597874+0000","last_unstale":"2024-03-18T15:01:48.334072+0000","last_undegraded":"2024-03-18T15:01:48.334072+0000","last_fullsized":"2024-03-18T15:01:48.334072+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:42:27.904801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585374+0000","last_change":"2024-03-18T15:01:45.588227+0000","last_active":"2024-03-18T15:01:46.585374+0000","last_peered":"2024-03-18T15:01:46.585374+0000","last_clean":"2024-03-18T15:01:46.585374+0000","last_became_active":"2024-03-18T15:01:45.586941+0000","last_became_peered":"2024-03-18T15:01:45.586941+0000","last_unstale":"2024-03-18T15:01:46.585374+0000","last_undegraded":"2024-03-18T15:01:46.585374+0000","last_fullsized":"2024-03-18T15:01:46.585374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672597+0000","last_change":"2024-03-18T15:01:45.586353+0000","last_active":"2024-03-18T15:01:48.672597+0000","last_peered":"2024-03-18T15:01:48.672597+0000","last_clean":"2024-03-18T15:01:48.672597+0000","last_became_active":"2024-03-18T15:01:45.586051+0000","last_became_peered":"2024-03-18T15:01:45.586051+0000","last_unstale":"2024-03-18T15:01:48.672597+0000","last_undegraded":"2024-03-18T15:01:48.672597+0000","last_fullsized":"2024-03-18T15:01:48.672597+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:37:40.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585091+0000","last_change":"2024-03-18T15:01:45.592709+0000","last_active":"2024-03-18T15:01:46.585091+0000","last_peered":"2024-03-18T15:01:46.585091+0000","last_clean":"2024-03-18T15:01:46.585091+0000","last_became_active":"2024-03-18T15:01:45.592450+0000","last_became_peered":"2024-03-18T15:01:45.592450+0000","last_unstale":"2024-03-18T15:01:46.585091+0000","last_undegraded":"2024-03-18T15:01:46.585091+0000","last_fullsized":"2024-03-18T15:01:46.585091+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:49:38.601221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272128+0000","last_change":"2024-03-18T15:01:45.589625+0000","last_active":"2024-03-18T15:01:47.272128+0000","last_peered":"2024-03-18T15:01:47.272128+0000","last_clean":"2024-03-18T15:01:47.272128+0000","last_became_active":"2024-03-18T15:01:45.589349+0000","last_became_peered":"2024-03-18T15:01:45.589349+0000","last_unstale":"2024-03-18T15:01:47.272128+0000","last_undegraded":"2024-03-18T15:01:47.272128+0000","last_fullsized":"2024-03-18T15:01:47.272128+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:01:34.183868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"34'4","reported_seq":18,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672761+0000","last_change":"2024-03-18T15:01:44.579276+0000","last_active":"2024-03-18T15:01:48.672761+0000","last_peered":"2024-03-18T15:01:48.672761+0000","last_clean":"2024-03-18T15:01:48.672761+0000","last_became_active":"2024-03-18T15:01:44.578958+0000","last_became_peered":"2024-03-18T15:01:44.578958+0000","last_unstale":"2024-03-18T15:01:48.672761+0000","last_undegraded":"2024-03-18T15:01:48.672761+0000","last_fullsized":"2024-03-18T15:01:48.672761+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:37.128966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672706+0000","last_change":"2024-03-18T15:01:45.592918+0000","last_active":"2024-03-18T15:01:48.672706+0000","last_peered":"2024-03-18T15:01:48.672706+0000","last_clean":"2024-03-18T15:01:48.672706+0000","last_became_active":"2024-03-18T15:01:45.592579+0000","last_became_peered":"2024-03-18T15:01:45.592579+0000","last_unstale":"2024-03-18T15:01:48.672706+0000","last_undegraded":"2024-03-18T15:01:48.672706+0000","last_fullsized":"2024-03-18T15:01:48.672706+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:21:52.157719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272082+0000","last_change":"2024-03-18T15:01:44.580089+0000","last_active":"2024-03-18T15:01:47.272082+0000","last_peered":"2024-03-18T15:01:47.272082+0000","last_clean":"2024-03-18T15:01:47.272082+0000","last_became_active":"2024-03-18T15:01:44.579803+0000","last_became_peered":"2024-03-18T15:01:44.579803+0000","last_unstale":"2024-03-18T15:01:47.272082+0000","last_undegraded":"2024-03-18T15:01:47.272082+0000","last_fullsized":"2024-03-18T15:01:47.272082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:37.128966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334312+0000","last_change":"2024-03-18T15:01:45.598478+0000","last_active":"2024-03-18T15:01:48.334312+0000","last_peered":"2024-03-18T15:01:48.334312+0000","last_clean":"2024-03-18T15:01:48.334312+0000","last_became_active":"2024-03-18T15:01:45.598286+0000","last_became_peered":"2024-03-18T15:01:45.598286+0000","last_unstale":"2024-03-18T15:01:48.334312+0000","last_undegraded":"2024-03-18T15:01:48.334312+0000","last_fullsized":"2024-03-18T15:01:48.334312+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:06:37.199321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661245+0000","last_change":"2024-03-18T15:01:44.590824+0000","last_active":"2024-03-18T15:01:48.661245+0000","last_peered":"2024-03-18T15:01:48.661245+0000","last_clean":"2024-03-18T15:01:48.661245+0000","last_became_active":"2024-03-18T15:01:44.590495+0000","last_became_peered":"2024-03-18T15:01:44.590495+0000","last_unstale":"2024-03-18T15:01:48.661245+0000","last_undegraded":"2024-03-18T15:01:48.661245+0000","last_fullsized":"2024-03-18T15:01:48.661245+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:45:03.804170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583689+0000","last_change":"2024-03-18T15:01:45.592391+0000","last_active":"2024-03-18T15:01:46.583689+0000","last_peered":"2024-03-18T15:01:46.583689+0000","last_clean":"2024-03-18T15:01:46.583689+0000","last_became_active":"2024-03-18T15:01:45.592134+0000","last_became_peered":"2024-03-18T15:01:45.592134+0000","last_unstale":"2024-03-18T15:01:46.583689+0000","last_undegraded":"2024-03-18T15:01:46.583689+0000","last_fullsized":"2024-03-18T15:01:46.583689+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720376+0000","last_change":"2024-03-18T15:01:44.582771+0000","last_active":"2024-03-18T15:01:48.720376+0000","last_peered":"2024-03-18T15:01:48.720376+0000","last_clean":"2024-03-18T15:01:48.720376+0000","last_became_active":"2024-03-18T15:01:44.582504+0000","last_became_peered":"2024-03-18T15:01:44.582504+0000","last_unstale":"2024-03-18T15:01:48.720376+0000","last_undegraded":"2024-03-18T15:01:48.720376+0000","last_fullsized":"2024-03-18T15:01:48.720376+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:12:57.233470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585464+0000","last_change":"2024-03-18T15:01:45.593427+0000","last_active":"2024-03-18T15:01:46.585464+0000","last_peered":"2024-03-18T15:01:46.585464+0000","last_clean":"2024-03-18T15:01:46.585464+0000","last_became_active":"2024-03-18T15:01:45.593178+0000","last_became_peered":"2024-03-18T15:01:45.593178+0000","last_unstale":"2024-03-18T15:01:46.585464+0000","last_undegraded":"2024-03-18T15:01:46.585464+0000","last_fullsized":"2024-03-18T15:01:46.585464+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:54:27.683929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334292+0000","last_change":"2024-03-18T15:01:44.585074+0000","last_active":"2024-03-18T15:01:48.334292+0000","last_peered":"2024-03-18T15:01:48.334292+0000","last_clean":"2024-03-18T15:01:48.334292+0000","last_became_active":"2024-03-18T15:01:44.584724+0000","last_became_peered":"2024-03-18T15:01:44.584724+0000","last_unstale":"2024-03-18T15:01:48.334292+0000","last_undegraded":"2024-03-18T15:01:48.334292+0000","last_fullsized":"2024-03-18T15:01:48.334292+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:36:53.370038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587030+0000","last_change":"2024-03-18T15:01:45.585316+0000","last_active":"2024-03-18T15:01:46.587030+0000","last_peered":"2024-03-18T15:01:46.587030+0000","last_clean":"2024-03-18T15:01:46.587030+0000","last_became_active":"2024-03-18T15:01:45.584919+0000","last_became_peered":"2024-03-18T15:01:45.584919+0000","last_unstale":"2024-03-18T15:01:46.587030+0000","last_undegraded":"2024-03-18T15:01:46.587030+0000","last_fullsized":"2024-03-18T15:01:46.587030+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:48:38.135445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334054+0000","last_change":"2024-03-18T15:01:44.581419+0000","last_active":"2024-03-18T15:01:48.334054+0000","last_peered":"2024-03-18T15:01:48.334054+0000","last_clean":"2024-03-18T15:01:48.334054+0000","last_became_active":"2024-03-18T15:01:44.580982+0000","last_became_peered":"2024-03-18T15:01:44.580982+0000","last_unstale":"2024-03-18T15:01:48.334054+0000","last_undegraded":"2024-03-18T15:01:48.334054+0000","last_fullsized":"2024-03-18T15:01:48.334054+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:09.592082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.333925+0000","last_change":"2024-03-18T15:01:45.587535+0000","last_active":"2024-03-18T15:01:48.333925+0000","last_peered":"2024-03-18T15:01:48.333925+0000","last_clean":"2024-03-18T15:01:48.333925+0000","last_became_active":"2024-03-18T15:01:45.587216+0000","last_became_peered":"2024-03-18T15:01:45.587216+0000","last_unstale":"2024-03-18T15:01:48.333925+0000","last_undegraded":"2024-03-18T15:01:48.333925+0000","last_fullsized":"2024-03-18T15:01:48.333925+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:05.806548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.660750+0000","last_change":"2024-03-18T15:01:44.583187+0000","last_active":"2024-03-18T15:01:48.660750+0000","last_peered":"2024-03-18T15:01:48.660750+0000","last_clean":"2024-03-18T15:01:48.660750+0000","last_became_active":"2024-03-18T15:01:44.582915+0000","last_became_peered":"2024-03-18T15:01:44.582915+0000","last_unstale":"2024-03-18T15:01:48.660750+0000","last_undegraded":"2024-03-18T15:01:48.660750+0000","last_fullsized":"2024-03-18T15:01:48.660750+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.582924+0000","last_change":"2024-03-18T15:01:45.591499+0000","last_active":"2024-03-18T15:01:46.582924+0000","last_peered":"2024-03-18T15:01:46.582924+0000","last_clean":"2024-03-18T15:01:46.582924+0000","last_became_active":"2024-03-18T15:01:45.591017+0000","last_became_peered":"2024-03-18T15:01:45.591017+0000","last_unstale":"2024-03-18T15:01:46.582924+0000","last_undegraded":"2024-03-18T15:01:46.582924+0000","last_fullsized":"2024-03-18T15:01:46.582924+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:38:24.924212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.333853+0000","last_change":"2024-03-18T15:01:44.576918+0000","last_active":"2024-03-18T15:01:48.333853+0000","last_peered":"2024-03-18T15:01:48.333853+0000","last_clean":"2024-03-18T15:01:48.333853+0000","last_became_active":"2024-03-18T15:01:44.576614+0000","last_became_peered":"2024-03-18T15:01:44.576614+0000","last_unstale":"2024-03-18T15:01:48.333853+0000","last_undegraded":"2024-03-18T15:01:48.333853+0000","last_fullsized":"2024-03-18T15:01:48.333853+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:32:37.128966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587505+0000","last_change":"2024-03-18T15:01:45.576018+0000","last_active":"2024-03-18T15:01:46.587505+0000","last_peered":"2024-03-18T15:01:46.587505+0000","last_clean":"2024-03-18T15:01:46.587505+0000","last_became_active":"2024-03-18T15:01:45.575678+0000","last_became_peered":"2024-03-18T15:01:45.575678+0000","last_unstale":"2024-03-18T15:01:46.587505+0000","last_undegraded":"2024-03-18T15:01:46.587505+0000","last_fullsized":"2024-03-18T15:01:46.587505+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:47:10.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661364+0000","last_change":"2024-03-18T15:01:44.582920+0000","last_active":"2024-03-18T15:01:48.661364+0000","last_peered":"2024-03-18T15:01:48.661364+0000","last_clean":"2024-03-18T15:01:48.661364+0000","last_became_active":"2024-03-18T15:01:44.582314+0000","last_became_peered":"2024-03-18T15:01:44.582314+0000","last_unstale":"2024-03-18T15:01:48.661364+0000","last_undegraded":"2024-03-18T15:01:48.661364+0000","last_fullsized":"2024-03-18T15:01:48.661364+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:18:26.066141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661409+0000","last_change":"2024-03-18T15:01:45.592592+0000","last_active":"2024-03-18T15:01:48.661409+0000","last_peered":"2024-03-18T15:01:48.661409+0000","last_clean":"2024-03-18T15:01:48.661409+0000","last_became_active":"2024-03-18T15:01:45.592306+0000","last_became_peered":"2024-03-18T15:01:45.592306+0000","last_unstale":"2024-03-18T15:01:48.661409+0000","last_undegraded":"2024-03-18T15:01:48.661409+0000","last_fullsized":"2024-03-18T15:01:48.661409+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:16:34.911100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272138+0000","last_change":"2024-03-18T15:01:44.580757+0000","last_active":"2024-03-18T15:01:47.272138+0000","last_peered":"2024-03-18T15:01:47.272138+0000","last_clean":"2024-03-18T15:01:47.272138+0000","last_became_active":"2024-03-18T15:01:44.580494+0000","last_became_peered":"2024-03-18T15:01:44.580494+0000","last_unstale":"2024-03-18T15:01:47.272138+0000","last_undegraded":"2024-03-18T15:01:47.272138+0000","last_fullsized":"2024-03-18T15:01:47.272138+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:30:17.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661278+0000","last_change":"2024-03-18T15:01:45.583531+0000","last_active":"2024-03-18T15:01:48.661278+0000","last_peered":"2024-03-18T15:01:48.661278+0000","last_clean":"2024-03-18T15:01:48.661278+0000","last_became_active":"2024-03-18T15:01:45.583282+0000","last_became_peered":"2024-03-18T15:01:45.583282+0000","last_unstale":"2024-03-18T15:01:48.661278+0000","last_undegraded":"2024-03-18T15:01:48.661278+0000","last_fullsized":"2024-03-18T15:01:48.661278+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:40:10.864752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"34'3","reported_seq":17,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587211+0000","last_change":"2024-03-18T15:01:44.581812+0000","last_active":"2024-03-18T15:01:46.587211+0000","last_peered":"2024-03-18T15:01:46.587211+0000","last_clean":"2024-03-18T15:01:46.587211+0000","last_became_active":"2024-03-18T15:01:44.581380+0000","last_became_peered":"2024-03-18T15:01:44.581380+0000","last_unstale":"2024-03-18T15:01:46.587211+0000","last_undegraded":"2024-03-18T15:01:46.587211+0000","last_fullsized":"2024-03-18T15:01:46.587211+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:08:24.728805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587095+0000","last_change":"2024-03-18T15:01:45.584355+0000","last_active":"2024-03-18T15:01:46.587095+0000","last_peered":"2024-03-18T15:01:46.587095+0000","last_clean":"2024-03-18T15:01:46.587095+0000","last_became_active":"2024-03-18T15:01:45.584058+0000","last_became_peered":"2024-03-18T15:01:45.584058+0000","last_unstale":"2024-03-18T15:01:46.587095+0000","last_undegraded":"2024-03-18T15:01:46.587095+0000","last_fullsized":"2024-03-18T15:01:46.587095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:55:51.613194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"34'6","reported_seq":20,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661228+0000","last_change":"2024-03-18T15:01:44.590920+0000","last_active":"2024-03-18T15:01:48.661228+0000","last_peered":"2024-03-18T15:01:48.661228+0000","last_clean":"2024-03-18T15:01:48.661228+0000","last_became_active":"2024-03-18T15:01:44.590650+0000","last_became_peered":"2024-03-18T15:01:44.590650+0000","last_unstale":"2024-03-18T15:01:48.661228+0000","last_undegraded":"2024-03-18T15:01:48.661228+0000","last_fullsized":"2024-03-18T15:01:48.661228+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:06:26.743158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.582971+0000","last_change":"2024-03-18T15:01:45.591643+0000","last_active":"2024-03-18T15:01:46.582971+0000","last_peered":"2024-03-18T15:01:46.582971+0000","last_clean":"2024-03-18T15:01:46.582971+0000","last_became_active":"2024-03-18T15:01:45.591094+0000","last_became_peered":"2024-03-18T15:01:45.591094+0000","last_unstale":"2024-03-18T15:01:46.582971+0000","last_undegraded":"2024-03-18T15:01:46.582971+0000","last_fullsized":"2024-03-18T15:01:46.582971+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:37:31.840893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334299+0000","last_change":"2024-03-18T15:01:44.575992+0000","last_active":"2024-03-18T15:01:48.334299+0000","last_peered":"2024-03-18T15:01:48.334299+0000","last_clean":"2024-03-18T15:01:48.334299+0000","last_became_active":"2024-03-18T15:01:44.575239+0000","last_became_peered":"2024-03-18T15:01:44.575239+0000","last_unstale":"2024-03-18T15:01:48.334299+0000","last_undegraded":"2024-03-18T15:01:48.334299+0000","last_fullsized":"2024-03-18T15:01:48.334299+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:30:17.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.661236+0000","last_change":"2024-03-18T15:01:45.586654+0000","last_active":"2024-03-18T15:01:48.661236+0000","last_peered":"2024-03-18T15:01:48.661236+0000","last_clean":"2024-03-18T15:01:48.661236+0000","last_became_active":"2024-03-18T15:01:45.586351+0000","last_became_peered":"2024-03-18T15:01:45.586351+0000","last_unstale":"2024-03-18T15:01:48.661236+0000","last_undegraded":"2024-03-18T15:01:48.661236+0000","last_fullsized":"2024-03-18T15:01:48.661236+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:18:53.231076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.582999+0000","last_change":"2024-03-18T15:01:44.583555+0000","last_active":"2024-03-18T15:01:46.582999+0000","last_peered":"2024-03-18T15:01:46.582999+0000","last_clean":"2024-03-18T15:01:46.582999+0000","last_became_active":"2024-03-18T15:01:44.583318+0000","last_became_peered":"2024-03-18T15:01:44.583318+0000","last_unstale":"2024-03-18T15:01:46.582999+0000","last_undegraded":"2024-03-18T15:01:46.582999+0000","last_fullsized":"2024-03-18T15:01:46.582999+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:05.767566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585559+0000","last_change":"2024-03-18T15:01:45.592719+0000","last_active":"2024-03-18T15:01:46.585559+0000","last_peered":"2024-03-18T15:01:46.585559+0000","last_clean":"2024-03-18T15:01:46.585559+0000","last_became_active":"2024-03-18T15:01:45.592499+0000","last_became_peered":"2024-03-18T15:01:45.592499+0000","last_unstale":"2024-03-18T15:01:46.585559+0000","last_undegraded":"2024-03-18T15:01:46.585559+0000","last_fullsized":"2024-03-18T15:01:46.585559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:47:10.910132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.660909+0000","last_change":"2024-03-18T15:01:44.584486+0000","last_active":"2024-03-18T15:01:48.660909+0000","last_peered":"2024-03-18T15:01:48.660909+0000","last_clean":"2024-03-18T15:01:48.660909+0000","last_became_active":"2024-03-18T15:01:44.583996+0000","last_became_peered":"2024-03-18T15:01:44.583996+0000","last_unstale":"2024-03-18T15:01:48.660909+0000","last_undegraded":"2024-03-18T15:01:48.660909+0000","last_fullsized":"2024-03-18T15:01:48.660909+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:26:24.126775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672639+0000","last_change":"2024-03-18T15:01:45.592901+0000","last_active":"2024-03-18T15:01:48.672639+0000","last_peered":"2024-03-18T15:01:48.672639+0000","last_clean":"2024-03-18T15:01:48.672639+0000","last_became_active":"2024-03-18T15:01:45.592625+0000","last_became_peered":"2024-03-18T15:01:45.592625+0000","last_unstale":"2024-03-18T15:01:48.672639+0000","last_undegraded":"2024-03-18T15:01:48.672639+0000","last_fullsized":"2024-03-18T15:01:48.672639+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:33:32.368716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"34'8","reported_seq":22,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.660794+0000","last_change":"2024-03-18T15:01:44.591019+0000","last_active":"2024-03-18T15:01:48.660794+0000","last_peered":"2024-03-18T15:01:48.660794+0000","last_clean":"2024-03-18T15:01:48.660794+0000","last_became_active":"2024-03-18T15:01:44.590748+0000","last_became_peered":"2024-03-18T15:01:44.590748+0000","last_unstale":"2024-03-18T15:01:48.660794+0000","last_undegraded":"2024-03-18T15:01:48.660794+0000","last_fullsized":"2024-03-18T15:01:48.660794+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:06:16.011355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334530+0000","last_change":"2024-03-18T15:01:45.591575+0000","last_active":"2024-03-18T15:01:48.334530+0000","last_peered":"2024-03-18T15:01:48.334530+0000","last_clean":"2024-03-18T15:01:48.334530+0000","last_became_active":"2024-03-18T15:01:45.591204+0000","last_became_peered":"2024-03-18T15:01:45.591204+0000","last_unstale":"2024-03-18T15:01:48.334530+0000","last_undegraded":"2024-03-18T15:01:48.334530+0000","last_fullsized":"2024-03-18T15:01:48.334530+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:33:55.879771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583429+0000","last_change":"2024-03-18T15:01:44.586226+0000","last_active":"2024-03-18T15:01:46.583429+0000","last_peered":"2024-03-18T15:01:46.583429+0000","last_clean":"2024-03-18T15:01:46.583429+0000","last_became_active":"2024-03-18T15:01:44.585825+0000","last_became_peered":"2024-03-18T15:01:44.585825+0000","last_unstale":"2024-03-18T15:01:46.583429+0000","last_undegraded":"2024-03-18T15:01:46.583429+0000","last_fullsized":"2024-03-18T15:01:46.583429+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:02:34.112107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587574+0000","last_change":"2024-03-18T15:01:45.588963+0000","last_active":"2024-03-18T15:01:46.587574+0000","last_peered":"2024-03-18T15:01:46.587574+0000","last_clean":"2024-03-18T15:01:46.587574+0000","last_became_active":"2024-03-18T15:01:45.588426+0000","last_became_peered":"2024-03-18T15:01:45.588426+0000","last_unstale":"2024-03-18T15:01:46.587574+0000","last_undegraded":"2024-03-18T15:01:46.587574+0000","last_fullsized":"2024-03-18T15:01:46.587574+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:51:22.863364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334360+0000","last_change":"2024-03-18T15:01:44.577960+0000","last_active":"2024-03-18T15:01:48.334360+0000","last_peered":"2024-03-18T15:01:48.334360+0000","last_clean":"2024-03-18T15:01:48.334360+0000","last_became_active":"2024-03-18T15:01:44.577693+0000","last_became_peered":"2024-03-18T15:01:44.577693+0000","last_unstale":"2024-03-18T15:01:48.334360+0000","last_undegraded":"2024-03-18T15:01:48.334360+0000","last_fullsized":"2024-03-18T15:01:48.334360+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:20:43.058800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583235+0000","last_change":"2024-03-18T15:01:45.593734+0000","last_active":"2024-03-18T15:01:46.583235+0000","last_peered":"2024-03-18T15:01:46.583235+0000","last_clean":"2024-03-18T15:01:46.583235+0000","last_became_active":"2024-03-18T15:01:45.593152+0000","last_became_peered":"2024-03-18T15:01:45.593152+0000","last_unstale":"2024-03-18T15:01:46.583235+0000","last_undegraded":"2024-03-18T15:01:46.583235+0000","last_fullsized":"2024-03-18T15:01:46.583235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:03:17.490208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"34'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334436+0000","last_change":"2024-03-18T15:01:44.581685+0000","last_active":"2024-03-18T15:01:48.334436+0000","last_peered":"2024-03-18T15:01:48.334436+0000","last_clean":"2024-03-18T15:01:48.334436+0000","last_became_active":"2024-03-18T15:01:44.580454+0000","last_became_peered":"2024-03-18T15:01:44.580454+0000","last_unstale":"2024-03-18T15:01:48.334436+0000","last_undegraded":"2024-03-18T15:01:48.334436+0000","last_fullsized":"2024-03-18T15:01:48.334436+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T18:07:08.546596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720272+0000","last_change":"2024-03-18T15:01:45.584816+0000","last_active":"2024-03-18T15:01:48.720272+0000","last_peered":"2024-03-18T15:01:48.720272+0000","last_clean":"2024-03-18T15:01:48.720272+0000","last_became_active":"2024-03-18T15:01:45.584207+0000","last_became_peered":"2024-03-18T15:01:45.584207+0000","last_unstale":"2024-03-18T15:01:48.720272+0000","last_undegraded":"2024-03-18T15:01:48.720272+0000","last_fullsized":"2024-03-18T15:01:48.720272+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:16:06.769694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334375+0000","last_change":"2024-03-18T15:01:44.581724+0000","last_active":"2024-03-18T15:01:48.334375+0000","last_peered":"2024-03-18T15:01:48.334375+0000","last_clean":"2024-03-18T15:01:48.334375+0000","last_became_active":"2024-03-18T15:01:44.581433+0000","last_became_peered":"2024-03-18T15:01:44.581433+0000","last_unstale":"2024-03-18T15:01:48.334375+0000","last_undegraded":"2024-03-18T15:01:48.334375+0000","last_fullsized":"2024-03-18T15:01:48.334375+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:22:59.898247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720038+0000","last_change":"2024-03-18T15:01:45.588729+0000","last_active":"2024-03-18T15:01:48.720038+0000","last_peered":"2024-03-18T15:01:48.720038+0000","last_clean":"2024-03-18T15:01:48.720038+0000","last_became_active":"2024-03-18T15:01:45.588437+0000","last_became_peered":"2024-03-18T15:01:45.588437+0000","last_unstale":"2024-03-18T15:01:48.720038+0000","last_undegraded":"2024-03-18T15:01:48.720038+0000","last_fullsized":"2024-03-18T15:01:48.720038+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:21:55.184746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272096+0000","last_change":"2024-03-18T15:01:44.578094+0000","last_active":"2024-03-18T15:01:47.272096+0000","last_peered":"2024-03-18T15:01:47.272096+0000","last_clean":"2024-03-18T15:01:47.272096+0000","last_became_active":"2024-03-18T15:01:44.577795+0000","last_became_peered":"2024-03-18T15:01:44.577795+0000","last_unstale":"2024-03-18T15:01:47.272096+0000","last_undegraded":"2024-03-18T15:01:47.272096+0000","last_fullsized":"2024-03-18T15:01:47.272096+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:35:09.592082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720225+0000","last_change":"2024-03-18T15:01:45.583341+0000","last_active":"2024-03-18T15:01:48.720225+0000","last_peered":"2024-03-18T15:01:48.720225+0000","last_clean":"2024-03-18T15:01:48.720225+0000","last_became_active":"2024-03-18T15:01:45.581780+0000","last_became_peered":"2024-03-18T15:01:45.581780+0000","last_unstale":"2024-03-18T15:01:48.720225+0000","last_undegraded":"2024-03-18T15:01:48.720225+0000","last_fullsized":"2024-03-18T15:01:48.720225+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:57.839279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672464+0000","last_change":"2024-03-18T15:01:44.586298+0000","last_active":"2024-03-18T15:01:48.672464+0000","last_peered":"2024-03-18T15:01:48.672464+0000","last_clean":"2024-03-18T15:01:48.672464+0000","last_became_active":"2024-03-18T15:01:44.586027+0000","last_became_peered":"2024-03-18T15:01:44.586027+0000","last_unstale":"2024-03-18T15:01:48.672464+0000","last_undegraded":"2024-03-18T15:01:48.672464+0000","last_fullsized":"2024-03-18T15:01:48.672464+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:30:17.640485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.719909+0000","last_change":"2024-03-18T15:01:45.582437+0000","last_active":"2024-03-18T15:01:48.719909+0000","last_peered":"2024-03-18T15:01:48.719909+0000","last_clean":"2024-03-18T15:01:48.719909+0000","last_became_active":"2024-03-18T15:01:45.582184+0000","last_became_peered":"2024-03-18T15:01:45.582184+0000","last_unstale":"2024-03-18T15:01:48.719909+0000","last_undegraded":"2024-03-18T15:01:48.719909+0000","last_fullsized":"2024-03-18T15:01:48.719909+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:58:39.738025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.333963+0000","last_change":"2024-03-18T15:01:44.579707+0000","last_active":"2024-03-18T15:01:48.333963+0000","last_peered":"2024-03-18T15:01:48.333963+0000","last_clean":"2024-03-18T15:01:48.333963+0000","last_became_active":"2024-03-18T15:01:44.579403+0000","last_became_peered":"2024-03-18T15:01:44.579403+0000","last_unstale":"2024-03-18T15:01:48.333963+0000","last_undegraded":"2024-03-18T15:01:48.333963+0000","last_fullsized":"2024-03-18T15:01:48.333963+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:40.322909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585333+0000","last_change":"2024-03-18T15:01:45.588940+0000","last_active":"2024-03-18T15:01:46.585333+0000","last_peered":"2024-03-18T15:01:46.585333+0000","last_clean":"2024-03-18T15:01:46.585333+0000","last_became_active":"2024-03-18T15:01:45.588544+0000","last_became_peered":"2024-03-18T15:01:45.588544+0000","last_unstale":"2024-03-18T15:01:46.585333+0000","last_undegraded":"2024-03-18T15:01:46.585333+0000","last_fullsized":"2024-03-18T15:01:46.585333+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:53:35.282374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.586717+0000","last_change":"2024-03-18T15:01:44.580696+0000","last_active":"2024-03-18T15:01:46.586717+0000","last_peered":"2024-03-18T15:01:46.586717+0000","last_clean":"2024-03-18T15:01:46.586717+0000","last_became_active":"2024-03-18T15:01:44.580427+0000","last_became_peered":"2024-03-18T15:01:44.580427+0000","last_unstale":"2024-03-18T15:01:46.586717+0000","last_undegraded":"2024-03-18T15:01:46.586717+0000","last_fullsized":"2024-03-18T15:01:46.586717+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T22:31:10.335752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.720176+0000","last_change":"2024-03-18T15:01:45.581595+0000","last_active":"2024-03-18T15:01:48.720176+0000","last_peered":"2024-03-18T15:01:48.720176+0000","last_clean":"2024-03-18T15:01:48.720176+0000","last_became_active":"2024-03-18T15:01:45.581349+0000","last_became_peered":"2024-03-18T15:01:45.581349+0000","last_unstale":"2024-03-18T15:01:48.720176+0000","last_undegraded":"2024-03-18T15:01:48.720176+0000","last_fullsized":"2024-03-18T15:01:48.720176+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:02:03.315391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"34'2","reported_seq":16,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583482+0000","last_change":"2024-03-18T15:01:44.586423+0000","last_active":"2024-03-18T15:01:46.583482+0000","last_peered":"2024-03-18T15:01:46.583482+0000","last_clean":"2024-03-18T15:01:46.583482+0000","last_became_active":"2024-03-18T15:01:44.586184+0000","last_became_peered":"2024-03-18T15:01:44.586184+0000","last_unstale":"2024-03-18T15:01:46.583482+0000","last_undegraded":"2024-03-18T15:01:46.583482+0000","last_fullsized":"2024-03-18T15:01:46.583482+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:24:34.691744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.587608+0000","last_change":"2024-03-18T15:01:45.586961+0000","last_active":"2024-03-18T15:01:46.587608+0000","last_peered":"2024-03-18T15:01:46.587608+0000","last_clean":"2024-03-18T15:01:46.587608+0000","last_became_active":"2024-03-18T15:01:45.586466+0000","last_became_peered":"2024-03-18T15:01:45.586466+0000","last_unstale":"2024-03-18T15:01:46.587608+0000","last_undegraded":"2024-03-18T15:01:46.587608+0000","last_fullsized":"2024-03-18T15:01:46.587608+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:18:53.231076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"35'1","reported_seq":15,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.570652+0000","last_change":"2024-03-18T15:01:44.577390+0000","last_active":"2024-03-18T15:01:47.570652+0000","last_peered":"2024-03-18T15:01:47.570652+0000","last_clean":"2024-03-18T15:01:47.570652+0000","last_became_active":"2024-03-18T15:01:44.577063+0000","last_became_peered":"2024-03-18T15:01:44.577063+0000","last_unstale":"2024-03-18T15:01:47.570652+0000","last_undegraded":"2024-03-18T15:01:47.570652+0000","last_fullsized":"2024-03-18T15:01:47.570652+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:36:53.370038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272026+0000","last_change":"2024-03-18T15:01:45.586835+0000","last_active":"2024-03-18T15:01:47.272026+0000","last_peered":"2024-03-18T15:01:47.272026+0000","last_clean":"2024-03-18T15:01:47.272026+0000","last_became_active":"2024-03-18T15:01:45.586551+0000","last_became_peered":"2024-03-18T15:01:45.586551+0000","last_unstale":"2024-03-18T15:01:47.272026+0000","last_undegraded":"2024-03-18T15:01:47.272026+0000","last_fullsized":"2024-03-18T15:01:47.272026+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:09:36.347293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583328+0000","last_change":"2024-03-18T15:01:44.582617+0000","last_active":"2024-03-18T15:01:46.583328+0000","last_peered":"2024-03-18T15:01:46.583328+0000","last_clean":"2024-03-18T15:01:46.583328+0000","last_became_active":"2024-03-18T15:01:44.582360+0000","last_became_peered":"2024-03-18T15:01:44.582360+0000","last_unstale":"2024-03-18T15:01:46.583328+0000","last_undegraded":"2024-03-18T15:01:46.583328+0000","last_fullsized":"2024-03-18T15:01:46.583328+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:23:21.996890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672582+0000","last_change":"2024-03-18T15:01:45.585544+0000","last_active":"2024-03-18T15:01:48.672582+0000","last_peered":"2024-03-18T15:01:48.672582+0000","last_clean":"2024-03-18T15:01:48.672582+0000","last_became_active":"2024-03-18T15:01:45.585226+0000","last_became_peered":"2024-03-18T15:01:45.585226+0000","last_unstale":"2024-03-18T15:01:48.672582+0000","last_undegraded":"2024-03-18T15:01:48.672582+0000","last_fullsized":"2024-03-18T15:01:48.672582+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T20:56:54.922773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272205+0000","last_change":"2024-03-18T15:01:44.576244+0000","last_active":"2024-03-18T15:01:47.272205+0000","last_peered":"2024-03-18T15:01:47.272205+0000","last_clean":"2024-03-18T15:01:47.272205+0000","last_became_active":"2024-03-18T15:01:44.575962+0000","last_became_peered":"2024-03-18T15:01:44.575962+0000","last_unstale":"2024-03-18T15:01:47.272205+0000","last_undegraded":"2024-03-18T15:01:47.272205+0000","last_fullsized":"2024-03-18T15:01:47.272205+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T21:42:35.539249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:47.272095+0000","last_change":"2024-03-18T15:01:45.585416+0000","last_active":"2024-03-18T15:01:47.272095+0000","last_peered":"2024-03-18T15:01:47.272095+0000","last_clean":"2024-03-18T15:01:47.272095+0000","last_became_active":"2024-03-18T15:01:45.585131+0000","last_became_peered":"2024-03-18T15:01:45.585131+0000","last_unstale":"2024-03-18T15:01:47.272095+0000","last_undegraded":"2024-03-18T15:01:47.272095+0000","last_fullsized":"2024-03-18T15:01:47.272095+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T00:19:05.806548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.583063+0000","last_change":"2024-03-18T15:01:44.581622+0000","last_active":"2024-03-18T15:01:46.583063+0000","last_peered":"2024-03-18T15:01:46.583063+0000","last_clean":"2024-03-18T15:01:46.583063+0000","last_became_active":"2024-03-18T15:01:44.581349+0000","last_became_peered":"2024-03-18T15:01:44.581349+0000","last_unstale":"2024-03-18T15:01:46.583063+0000","last_undegraded":"2024-03-18T15:01:46.583063+0000","last_fullsized":"2024-03-18T15:01:46.583063+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T15:03:56.837150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.660769+0000","last_change":"2024-03-18T15:01:45.594192+0000","last_active":"2024-03-18T15:01:48.660769+0000","last_peered":"2024-03-18T15:01:48.660769+0000","last_clean":"2024-03-18T15:01:48.660769+0000","last_became_active":"2024-03-18T15:01:45.586383+0000","last_became_peered":"2024-03-18T15:01:45.586383+0000","last_unstale":"2024-03-18T15:01:48.660769+0000","last_undegraded":"2024-03-18T15:01:48.660769+0000","last_fullsized":"2024-03-18T15:01:48.660769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:58:42.604939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.334081+0000","last_change":"2024-03-18T15:01:44.575596+0000","last_active":"2024-03-18T15:01:48.334081+0000","last_peered":"2024-03-18T15:01:48.334081+0000","last_clean":"2024-03-18T15:01:48.334081+0000","last_became_active":"2024-03-18T15:01:44.575268+0000","last_became_peered":"2024-03-18T15:01:44.575268+0000","last_unstale":"2024-03-18T15:01:48.334081+0000","last_undegraded":"2024-03-18T15:01:48.334081+0000","last_fullsized":"2024-03-18T15:01:48.334081+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T19:22:13.744934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.333945+0000","last_change":"2024-03-18T15:01:45.598067+0000","last_active":"2024-03-18T15:01:48.333945+0000","last_peered":"2024-03-18T15:01:48.333945+0000","last_clean":"2024-03-18T15:01:48.333945+0000","last_became_active":"2024-03-18T15:01:45.597764+0000","last_became_peered":"2024-03-18T15:01:45.597764+0000","last_unstale":"2024-03-18T15:01:48.333945+0000","last_undegraded":"2024-03-18T15:01:48.333945+0000","last_fullsized":"2024-03-18T15:01:48.333945+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T17:01:34.183868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.660867+0000","last_change":"2024-03-18T15:01:44.583590+0000","last_active":"2024-03-18T15:01:48.660867+0000","last_peered":"2024-03-18T15:01:48.660867+0000","last_clean":"2024-03-18T15:01:48.660867+0000","last_became_active":"2024-03-18T15:01:44.583339+0000","last_became_peered":"2024-03-18T15:01:44.583339+0000","last_unstale":"2024-03-18T15:01:48.660867+0000","last_undegraded":"2024-03-18T15:01:48.660867+0000","last_fullsized":"2024-03-18T15:01:48.660867+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T01:53:48.250219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":12,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585475+0000","last_change":"2024-03-18T15:01:45.578582+0000","last_active":"2024-03-18T15:01:46.585475+0000","last_peered":"2024-03-18T15:01:46.585475+0000","last_clean":"2024-03-18T15:01:46.585475+0000","last_became_active":"2024-03-18T15:01:45.578327+0000","last_became_peered":"2024-03-18T15:01:45.578327+0000","last_unstale":"2024-03-18T15:01:46.585475+0000","last_undegraded":"2024-03-18T15:01:46.585475+0000","last_fullsized":"2024-03-18T15:01:46.585475+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:44.558589+0000","last_clean_scrub_stamp":"2024-03-18T15:01:44.558589+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T02:58:42.604939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:48.672512+0000","last_change":"2024-03-18T15:01:44.583257+0000","last_active":"2024-03-18T15:01:48.672512+0000","last_peered":"2024-03-18T15:01:48.672512+0000","last_clean":"2024-03-18T15:01:48.672512+0000","last_became_active":"2024-03-18T15:01:44.582921+0000","last_became_peered":"2024-03-18T15:01:44.582921+0000","last_unstale":"2024-03-18T15:01:48.672512+0000","last_undegraded":"2024-03-18T15:01:48.672512+0000","last_fullsized":"2024-03-18T15:01:48.672512+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:01:43.556461+0000","last_clean_scrub_stamp":"2024-03-18T15:01:43.556461+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T23:22:59.898247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":193,"reported_epoch":35,"state":"active+clean","last_fresh":"2024-03-18T15:01:46.585651+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T15:01:46.585651+0000","last_peered":"2024-03-18T15:01:46.585651+0000","last_clean":"2024-03-18T15:01:46.585651+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T15:01:46.585651+0000","last_undegraded":"2024-03-18T15:01:46.585651+0000","last_fullsized":"2024-03-18T15:01:46.585651+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424509459,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509460,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":393216,"data_stored":153796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509459,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":405504,"data_stored":155360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129542163,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27984,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343856,"statfs":{"total":96636764160,"available":96608108544,"internally_reserved":0,"allocated":987136,"data_stored":744184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129542162,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":154342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542161,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":154398,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129542162,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":153830,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574866,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32140,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339700,"statfs":{"total":96636764160,"available":96603852800,"internally_reserved":0,"allocated":983040,"data_stored":744094,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T15:01:53.302 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-03-18T15:01:53.303 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-03-18T15:01:53.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.448+0000 7f9e3cc85640 1 Processor -- start 2024-03-18T15:01:53.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.449+0000 7f9e3cc85640 1 -- start start 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3cc85640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9e3815c140 0x7f9e380d08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3cc85640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9e380ce840 0x7f9e380ceca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3cc85640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e380cce20 con 0x7f9e380b7110 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3cc85640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f9e380cf1e0 con 0x7f9e3815c140 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3cc85640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f9e380cd100 con 0x7f9e380ce840 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9e3815c140 0x7f9e380d08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f9e3815c140 0x7f9e380d08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48870/0 (socket says 172.21.15.152:48870) 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 -- 172.21.15.152:0/3615323896 learned_addr learned my addr 172.21.15.152:0/3615323896 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e35d9b640 1 --2- 172.21.15.152:0/3615323896 >> v2:172.21.15.186:3300/0 conn(0x7f9e380ce840 0x7f9e380ceca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 -- 172.21.15.152:0/3615323896 >> v2:172.21.15.186:3300/0 conn(0x7f9e380ce840 msgr2=0x7f9e380ceca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 --2- 172.21.15.152:0/3615323896 >> v2:172.21.15.186:3300/0 conn(0x7f9e380ce840 0x7f9e380ceca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.450+0000 7f9e3659c640 1 -- 172.21.15.152:0/3615323896 >> v1:172.21.15.186:6789/0 conn(0x7f9e380b7110 legacy=0x7f9e380b75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.451+0000 7f9e3659c640 1 -- 172.21.15.152:0/3615323896 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e380cd3e0 con 0x7f9e3815c140 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.451+0000 7f9e3659c640 1 --2- 172.21.15.152:0/3615323896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e3815c140 0x7f9e380d08c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e38074ef0 tx=0x7f9e2802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7fb432d62051146 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.451+0000 7f9e3559a640 1 -- 172.21.15.152:0/3615323896 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28034070 con 0x7f9e3815c140 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.451+0000 7f9e3559a640 1 -- 172.21.15.152:0/3615323896 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e28030860 con 0x7f9e3815c140 2024-03-18T15:01:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.451+0000 7f9e3559a640 1 -- 172.21.15.152:0/3615323896 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28030c30 con 0x7f9e3815c140 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 -- 172.21.15.152:0/3615323896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e3815c140 msgr2=0x7f9e380d08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/3615323896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e3815c140 0x7f9e380d08c0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f9e38074ef0 tx=0x7f9e2802b9a0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 -- 172.21.15.152:0/3615323896 shutdown_connections 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/3615323896 >> v2:172.21.15.186:3300/0 conn(0x7f9e380ce840 0x7f9e380ceca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/3615323896 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e3815c140 0x7f9e380d08c0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 -- 172.21.15.152:0/3615323896 >> 172.21.15.152:0/3615323896 conn(0x7f9e3809b160 msgr2=0x7f9e380d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 -- 172.21.15.152:0/3615323896 shutdown_connections 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.452+0000 7f9e3cc85640 1 -- 172.21.15.152:0/3615323896 wait complete. 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.454+0000 7f9e3cc85640 1 Processor -- start 2024-03-18T15:01:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.454+0000 7f9e3cc85640 1 -- start start 2024-03-18T15:01:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.455+0000 7f9e3cc85640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.455+0000 7f9e3cc85640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e380ce840 0x7f9e3815a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 0x7f9e380ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9e380b7cb0 con 0x7f9e380b7110 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9e380cd9a0 con 0x7f9e3815c140 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9e380d0e00 con 0x7f9e380ce840 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48878/0 (socket says 172.21.15.152:48878) 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 -- 172.21.15.152:0/1547110745 learned_addr learned my addr 172.21.15.152:0/1547110745 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e36d9d640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 0x7f9e380ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 -- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e380ce840 msgr2=0x7f9e3815a190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e380ce840 0x7f9e3815a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 -- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 msgr2=0x7f9e380ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 0x7f9e380ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 -- 172.21.15.152:0/1547110745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e380caf00 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e36d9d640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 0x7f9e380ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3659c640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9e2802b9e0 tx=0x7f9e280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28034040 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e28039d90 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e380cb1e0 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e28043630 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.456+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e3806c800 con 0x7f9e380b7110 2024-03-18T15:01:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.457+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e3804f540 con 0x7f9e380b7110 2024-03-18T15:01:53.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.458+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9e2804a060 con 0x7f9e380b7110 2024-03-18T15:01:53.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.458+0000 7f9e26ffd640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 0x7f9e1806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.458+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f9e280acb60 con 0x7f9e380b7110 2024-03-18T15:01:53.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.459+0000 7f9e35d9b640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 0x7f9e1806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.459+0000 7f9e35d9b640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 0x7f9e1806e0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e3806d400 tx=0x7f9e2c008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.463 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.463+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9e2803e070 con 0x7f9e380b7110 2024-03-18T15:01:53.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.716+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f9e380ce620 con 0x7f9e380b7110 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.718+0000 7f9e26ffd640 1 -- 172.21.15.152:0/1547110745 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v11) ==== 190+0+147 (secure 0 0 0) 0x7f9e28037360 con 0x7f9e380b7110 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stdout:[client.0] 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDhVvhl0cU9ERAACsAQRXNU45kokSZDXpm31Q== 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: caps mds = "allow" 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: caps mon = "allow r" 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-03-18T15:01:53.719 INFO:teuthology.orchestra.run.smithi152.stderr:updated caps for client.0 2024-03-18T15:01:53.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 msgr2=0x7f9e1806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 0x7f9e1806e0c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f9e3806d400 tx=0x7f9e2c008040 comp rx=0 tx=0).stop 2024-03-18T15:01:53.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 msgr2=0x7f9e3806cd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f9e2802b9e0 tx=0x7f9e280046c0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 shutdown_connections 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9e3815c140 0x7f9e380ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9e1806bc00 0x7f9e1806e0c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9e380ce840 0x7f9e3815a190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 --2- 172.21.15.152:0/1547110745 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9e380b7110 0x7f9e3806cd20 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 >> 172.21.15.152:0/1547110745 conn(0x7f9e3809b160 msgr2=0x7f9e38070680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 shutdown_connections 2024-03-18T15:01:53.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.721+0000 7f9e3cc85640 1 -- 172.21.15.152:0/1547110745 wait complete. 2024-03-18T15:01:53.734 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T15:01:53.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.835+0000 7f1cf83d4640 1 Processor -- start 2024-03-18T15:01:53.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.835+0000 7f1cf83d4640 1 -- start start 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf83d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e550 0x7f1cf006d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf83d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1cf00cf310 0x7f1cf00ce6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf83d4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1cf00cc4b0 con 0x7f1cf006d870 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf83d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1cf00ccda0 con 0x7f1cf00cf310 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf83d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf00ce240 con 0x7f1cf015e550 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf596f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1cf00cf310 0x7f1cf00ce6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.836+0000 7f1cf596f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1cf00cf310 0x7f1cf00ce6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48892/0 (socket says 172.21.15.152:48892) 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 -- 172.21.15.152:0/2684285671 learned_addr learned my addr 172.21.15.152:0/2684285671 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf6170640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e550 0x7f1cf006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 -- 172.21.15.152:0/2684285671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e550 msgr2=0x7f1cf006d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e550 0x7f1cf006d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 -- 172.21.15.152:0/2684285671 >> v1:172.21.15.186:6789/0 conn(0x7f1cf006d870 legacy=0x7f1cf00cfd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 -- 172.21.15.152:0/2684285671 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf006dcf0 con 0x7f1cf00cf310 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.837+0000 7f1cf596f640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00ce6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cd403bd533579b0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf516e640 1 -- 172.21.15.152:0/2684285671 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0034070 con 0x7f1cf00cf310 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf516e640 1 -- 172.21.15.152:0/2684285671 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0030840 con 0x7f1cf00cf310 2024-03-18T15:01:53.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf516e640 1 -- 172.21.15.152:0/2684285671 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0030c10 con 0x7f1cf00cf310 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 -- 172.21.15.152:0/2684285671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 msgr2=0x7f1cf00ce6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00ce6e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce002b980 comp rx=0 tx=0).stop 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 -- 172.21.15.152:0/2684285671 shutdown_connections 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00ce6e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/2684285671 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf015e550 0x7f1cf006d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 -- 172.21.15.152:0/2684285671 >> 172.21.15.152:0/2684285671 conn(0x7f1cf00d1e60 msgr2=0x7f1cf00d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:53.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 -- 172.21.15.152:0/2684285671 shutdown_connections 2024-03-18T15:01:53.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.838+0000 7f1cf83d4640 1 -- 172.21.15.152:0/2684285671 wait complete. 2024-03-18T15:01:53.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.839+0000 7f1cf83d4640 1 Processor -- start 2024-03-18T15:01:53.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.840+0000 7f1cf83d4640 1 -- start start 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf006d870 0x7f1cf009f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 0x7f1cf00700d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00aebb0 con 0x7f1cf00cf310 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1cf00cca30 con 0x7f1cf015e550 2024-03-18T15:01:53.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1cf015e930 con 0x7f1cf006d870 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48904/0 (socket says 172.21.15.152:48904) 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 -- 172.21.15.152:0/3695800995 learned_addr learned my addr 172.21.15.152:0/3695800995 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf6170640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf006d870 0x7f1cf009f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf6971640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 0x7f1cf00700d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 -- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf006d870 msgr2=0x7f1cf009f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf006d870 0x7f1cf009f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 -- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 msgr2=0x7f1cf00700d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 0x7f1cf00700d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 -- 172.21.15.152:0/3695800995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cf009fb60 con 0x7f1cf00cf310 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf6971640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 0x7f1cf00700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf596f640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0048070 con 0x7f1cf00cf310 2024-03-18T15:01:53.844 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ce0030640 con 0x7f1cf00cf310 2024-03-18T15:01:53.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.841+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cf015fb70 con 0x7f1cf00cf310 2024-03-18T15:01:53.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.842+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ce0034040 con 0x7f1cf00cf310 2024-03-18T15:01:53.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.842+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cf0160130 con 0x7f1cf00cf310 2024-03-18T15:01:53.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.843+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cf004f5b0 con 0x7f1cf00cf310 2024-03-18T15:01:53.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.843+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1ce004b070 con 0x7f1cf00cf310 2024-03-18T15:01:53.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.844+0000 7f1ce6ffd640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 0x7f1cd406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:53.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.844+0000 7f1cf6170640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 0x7f1cd406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:53.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.844+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f1ce00ac9c0 con 0x7f1cf00cf310 2024-03-18T15:01:53.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.844+0000 7f1cf6170640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 0x7f1cd406e090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:53.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:53.848+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1ce00aee20 con 0x7f1cf00cf310 2024-03-18T15:01:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.065+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1cf006ceb0 con 0x7f1cf00cf310 2024-03-18T15:01:54.066 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.066+0000 7f1ce6ffd640 1 -- 172.21.15.152:0/3695800995 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7f1ce007fe20 con 0x7f1cf00cf310 2024-03-18T15:01:54.066 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:54.067 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T15:01:54.067 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T15:01:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 msgr2=0x7f1cd406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 0x7f1cd406e090 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1cec006fd0 tx=0x7f1cec008040 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 msgr2=0x7f1cf00caba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f1ce0009870 tx=0x7f1ce0004730 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 shutdown_connections 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1cf015e550 0x7f1cf00700d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1cf00cf310 0x7f1cf00caba0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1cd406bbd0 0x7f1cd406e090 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 --2- 172.21.15.152:0/3695800995 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1cf006d870 0x7f1cf009f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 >> 172.21.15.152:0/3695800995 conn(0x7f1cf00d1e60 msgr2=0x7f1cf006f210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 shutdown_connections 2024-03-18T15:01:54.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.068+0000 7f1cf83d4640 1 -- 172.21.15.152:0/3695800995 wait complete. 2024-03-18T15:01:54.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-03-18T15:01:44.919837+0000', 'modified': '2024-03-18T15:01:46.931862+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5148}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5148': {'gid': 5148, 'name': 'c', 'rank': 0, 'incarnation': 11, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.152:6837/556153091', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.152:6835', 'nonce': 556153091}, {'type': 'v1', 'addr': '172.21.15.152:6837', 'nonce': 556153091}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5148, 'qdb_cluster': [5148]} 2024-03-18T15:01:54.481 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-03-18T15:01:54.481 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-03-18T15:01:54.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 Processor -- start 2024-03-18T15:01:54.617 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 -- start start 2024-03-18T15:01:54.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 0x7f26740d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.618 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26740d1200 con 0x7f26740d1e40 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f26740cff90 con 0x7f267415e5a0 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.617+0000 7f26797f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f26740b34d0 con 0x7f26740d2d50 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f2672ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 0x7f26740d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f26737fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f266bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f26740d1e40 0x7f26740d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59746/0 (socket says 172.21.15.152:59746) 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f266bfff640 1 -- 172.21.15.152:0/2868646903 learned_addr learned my addr 172.21.15.152:0/2868646903 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f26737fe640 1 -- 172.21.15.152:0/2868646903 >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 msgr2=0x7f26740d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f26737fe640 1 --2- 172.21.15.152:0/2868646903 >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 0x7f26740d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f26737fe640 1 -- 172.21.15.152:0/2868646903 >> v1:172.21.15.186:6789/0 conn(0x7f26740d1e40 legacy=0x7f26740d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f26737fe640 1 -- 172.21.15.152:0/2868646903 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26740d14e0 con 0x7f26740d2d50 2024-03-18T15:01:54.619 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.618+0000 7f2672ffd640 1 --2- 172.21.15.152:0/2868646903 >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 0x7f26740d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.619+0000 7f26737fe640 1 --2- 172.21.15.152:0/2868646903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740b3c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f266c009d90 tx=0x7f266c02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a533fb245a8cbb0d server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.619+0000 7f26727fc640 1 -- 172.21.15.152:0/2868646903 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c039070 con 0x7f26740d2d50 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.619+0000 7f26727fc640 1 -- 172.21.15.152:0/2868646903 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266c02cbc0 con 0x7f26740d2d50 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.619+0000 7f26727fc640 1 -- 172.21.15.152:0/2868646903 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266c034440 con 0x7f26740d2d50 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 -- 172.21.15.152:0/2868646903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 msgr2=0x7f26740b3c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 --2- 172.21.15.152:0/2868646903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740b3c40 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f266c009d90 tx=0x7f266c02be10 comp rx=0 tx=0).stop 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 -- 172.21.15.152:0/2868646903 shutdown_connections 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 --2- 172.21.15.152:0/2868646903 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740b3c40 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 --2- 172.21.15.152:0/2868646903 >> v2:172.21.15.186:3300/0 conn(0x7f267415e5a0 0x7f26740d4b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.621 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 -- 172.21.15.152:0/2868646903 >> 172.21.15.152:0/2868646903 conn(0x7f26740d4060 msgr2=0x7f26740d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 -- 172.21.15.152:0/2868646903 shutdown_connections 2024-03-18T15:01:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.620+0000 7f26797f4640 1 -- 172.21.15.152:0/2868646903 wait complete. 2024-03-18T15:01:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.622+0000 7f26797f4640 1 Processor -- start 2024-03-18T15:01:54.622 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.622+0000 7f26797f4640 1 -- start start 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740ca840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f267415e5a0 0x7f26740cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26740b4300 con 0x7f26740d1e40 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26740b4180 con 0x7f267415e5a0 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26797f4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f26740b4480 con 0x7f26740d2d50 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48916/0 (socket says 172.21.15.152:48916) 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f2672ffd640 1 -- 172.21.15.152:0/2498690966 learned_addr learned my addr 172.21.15.152:0/2498690966 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f266bfff640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f26737fe640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f267415e5a0 0x7f26740cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.623+0000 7f2672ffd640 1 -- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 msgr2=0x7f26740ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f2672ffd640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f2672ffd640 1 -- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f267415e5a0 msgr2=0x7f26740cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f2672ffd640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f267415e5a0 0x7f26740cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f2672ffd640 1 -- 172.21.15.152:0/2498690966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26741f42a0 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f2672ffd640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f266400e960 tx=0x7f266400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f266b7fe640 1 -- 172.21.15.152:0/2498690966 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664017070 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f266b7fe640 1 -- 172.21.15.152:0/2498690966 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f266400ca00 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26740cad80 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f266b7fe640 1 -- 172.21.15.152:0/2498690966 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f266400cdd0 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.624+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26741f4840 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.626+0000 7f266b7fe640 1 -- 172.21.15.152:0/2498690966 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f266401a070 con 0x7f26740d1e40 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.626+0000 7f266b7fe640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 0x7f265406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.626+0000 7f266b7fe640 1 -- 172.21.15.152:0/2498690966 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f266408a9d0 con 0x7f26740d1e40 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.626+0000 7f266bfff640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 0x7f265406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.627+0000 7f266bfff640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 0x7f265406e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f26740b9a20 tx=0x7f265c007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.627+0000 7f267c3e4740 1 Processor -- start 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.627+0000 7f267c3e4740 1 -- start start 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 0x559308f41c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f42160 0x559308f71f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559308eaac80 con 0x559308f6f060 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559308e53aa0 con 0x559308f6ec80 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559308ea6d20 con 0x559308f42160 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48930/0 (socket says 172.21.15.152:48930) 2024-03-18T15:01:54.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 -- 172.21.15.152:0/4025754283 learned_addr learned my addr 172.21.15.152:0/4025754283 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f26737fe640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f42160 0x559308f71f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f2672ffd640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 0x559308f41c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 -- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f42160 msgr2=0x559308f71f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f42160 0x559308f71f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 -- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 msgr2=0x559308f41c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 0x559308f41c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 -- 172.21.15.152:0/4025754283 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559308e75ff0 con 0x559308f6f060 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f2672ffd640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 0x559308f41c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.628+0000 7f266bfff640 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f265c001820 tx=0x7f265c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eca4a230a6b1101 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f2668ff9640 1 -- 172.21.15.152:0/4025754283 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c026070 con 0x559308f6f060 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f2668ff9640 1 -- 172.21.15.152:0/4025754283 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c001ce0 con 0x559308f6f060 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f2668ff9640 1 -- 172.21.15.152:0/4025754283 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f265c013d80 con 0x559308f6f060 2024-03-18T15:01:54.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 -- 172.21.15.152:0/4025754283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 msgr2=0x559308f71a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f265c001820 tx=0x7f265c013000 comp rx=0 tx=0).stop 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 -- 172.21.15.152:0/4025754283 shutdown_connections 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f42160 0x559308f71f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6f060 0x559308f71a10 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 --2- 172.21.15.152:0/4025754283 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6ec80 0x559308f41c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 -- 172.21.15.152:0/4025754283 >> 172.21.15.152:0/4025754283 conn(0x559308f43e90 msgr2=0x559308f8ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 -- 172.21.15.152:0/4025754283 shutdown_connections 2024-03-18T15:01:54.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.629+0000 7f267c3e4740 1 -- 172.21.15.152:0/4025754283 wait complete. 2024-03-18T15:01:54.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.630+0000 7f267c3e4740 1 -- start start 2024-03-18T15:01:54.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.630+0000 7f267c3e4740 1 Processor -- start 2024-03-18T15:01:54.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f67120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f75020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559308f46530 con 0x559308f6ec80 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559308e66ef0 con 0x559308f6f060 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559308f48d70 con 0x559308f73530 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 10 client.0 _ll_register_callbacks cb 0x559308e61dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48942/0 (socket says 172.21.15.152:48942) 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 -- 172.21.15.152:0/132776096 learned_addr learned my addr 172.21.15.152:0/132776096 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f266bfff640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f67120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f26737fe640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f75020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 -- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 msgr2=0x559308f75020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f75020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 -- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 msgr2=0x559308f67120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f67120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 -- 172.21.15.152:0/132776096 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559308e73a30 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f266bfff640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f67120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2672ffd640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2664060f20 tx=0x7f2664058ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8cb37d5e8547732 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664070e60 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f26640581b0 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.631+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f265c001ce0 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f2664021050 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 10 client.5358 fetch_fsmap learned FSMap version 13 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x559308bbf2d0 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f265c001ce0 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f2664024060 con 0x559308f6ec80 2024-03-18T15:01:54.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 10 client.5358 fetch_fsmap finished waiting for FSMap version 13 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 10 client.5358 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 20 client.5358 populate_metadata read hostname 'smithi152' 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559308f70a50 0x559308f9ceb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 4 client.5358 mds_command: new command op to 5148 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 --> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559308eb81c0 con 0x559308f70a50 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f266bfff640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559308f70a50 0x559308f9ceb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f2651ffb640 10 client.5358 ms_handle_connect on v2:172.21.15.152:6835/556153091 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.632+0000 7f266bfff640 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559308f70a50 0x559308f9ceb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=37cf3e362ebe9bcd server_cookie=169497c1109bf99a in_seq=0 out_seq=0 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f2651ffb640 1 -- 172.21.15.152:0/132776096 <== mds.0 v2:172.21.15.152:6835/556153091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+22966 (crc 0 0 0) 0x559308eb81c0 con 0x559308f70a50 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f2651ffb640 10 client.5358 handle_command_reply: tid=0 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 client.5358 shutdown 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 msgr2=0x559308fa0d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f2664060f20 tx=0x7f2664058ea0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 shutdown_connections 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559308f70a50 0x559308f9ceb0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f75020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f2651ffb640 0 client.5358 ms_handle_reset on v2:172.21.15.152:6835/556153091 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f67120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 --2- 172.21.15.152:0/132776096 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308fa0d30 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 >> 172.21.15.152:0/132776096 conn(0x559308f42160 msgr2=0x559308f45b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 shutdown_connections 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 1 -- 172.21.15.152:0/132776096 wait complete. 2024-03-18T15:01:54.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.633+0000 7f267c3e4740 20 client.5358 trim_cache size 0 max 16384 2024-03-18T15:01:54.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.651+0000 7f267c3e4740 1 Processor -- start 2024-03-18T15:01:54.651 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.651+0000 7f267c3e4740 1 -- start start 2024-03-18T15:01:54.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f6f060 0x559308f73e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f73530 0x559308f8db40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f26741f8630 con 0x559308f6ec80 2024-03-18T15:01:54.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f26741f7990 con 0x559308f73530 2024-03-18T15:01:54.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f26741f7fe0 con 0x559308f6f060 2024-03-18T15:01:54.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48946/0 (socket says 172.21.15.152:48946) 2024-03-18T15:01:54.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 -- 172.21.15.152:0/1706730877 learned_addr learned my addr 172.21.15.152:0/1706730877 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 -- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f6f060 msgr2=0x559308f73e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f6f060 0x559308f73e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 -- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f73530 msgr2=0x559308f8db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f26737fe640 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f73530 0x559308f8db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f73530 0x559308f8db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 -- 172.21.15.152:0/1706730877 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559308c896b0 con 0x559308f6ec80 2024-03-18T15:01:54.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.652+0000 7f2672ffd640 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2664057010 tx=0x7f266405a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f35574891416f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f2653fff640 1 -- 172.21.15.152:0/1706730877 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664088e40 con 0x559308f6ec80 2024-03-18T15:01:54.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f2653fff640 1 -- 172.21.15.152:0/1706730877 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640581b0 con 0x559308f6ec80 2024-03-18T15:01:54.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f2653fff640 1 -- 172.21.15.152:0/1706730877 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664054cb0 con 0x559308f6ec80 2024-03-18T15:01:54.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 -- 172.21.15.152:0/1706730877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 msgr2=0x559308f8f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f2664057010 tx=0x7f266405a000 comp rx=0 tx=0).stop 2024-03-18T15:01:54.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 -- 172.21.15.152:0/1706730877 shutdown_connections 2024-03-18T15:01:54.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f73530 0x559308f8db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f6f060 0x559308f73e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 --2- 172.21.15.152:0/1706730877 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f8f6a0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 -- 172.21.15.152:0/1706730877 >> 172.21.15.152:0/1706730877 conn(0x559308f42160 msgr2=0x559308f66f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 -- 172.21.15.152:0/1706730877 shutdown_connections 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.653+0000 7f267c3e4740 1 -- 172.21.15.152:0/1706730877 wait complete. 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.654+0000 7f267c3e4740 1 -- start start 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.654+0000 7f267c3e4740 1 Processor -- start 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f66310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f6f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x559308f708d0 con 0x559308f6ec80 2024-03-18T15:01:54.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x559308f72f30 con 0x559308f6f060 2024-03-18T15:01:54.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x559308f70f20 con 0x559308f73530 2024-03-18T15:01:54.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f267c3e4740 10 client.0 _ll_register_callbacks cb 0x7f265c007d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48958/0 (socket says 172.21.15.152:48958) 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 -- 172.21.15.152:0/3135736955 learned_addr learned my addr 172.21.15.152:0/3135736955 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f26737fe640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f6f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f266bfff640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f66310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 -- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 msgr2=0x559308f6f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f6f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 -- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 msgr2=0x559308f66310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f66310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 -- 172.21.15.152:0/3135736955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559308f65550 con 0x559308f6ec80 2024-03-18T15:01:54.672 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f26737fe640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f266bfff640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f66310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:01:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2672ffd640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f266400e930 tx=0x7f2664088dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631d40cf1ea056bf server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2651ffb640 10 client.0 ms_handle_connect on v2:172.21.15.152:3300/0 2024-03-18T15:01:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.655+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664070e60 con 0x559308f6ec80 2024-03-18T15:01:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mon.0 v2:172.21.15.152:3300/0 2 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f2664054cc0 con 0x559308f6ec80 2024-03-18T15:01:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f26640581b0 con 0x559308f6ec80 2024-03-18T15:01:54.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) ==== 24+0+0 (secure 0 0 0) 0x7f2664088e40 con 0x559308f6ec80 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 10 client.5364 fetch_fsmap learned FSMap version 13 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) -- 0x559308f65550 con 0x559308f6ec80 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mon.0 v2:172.21.15.152:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26640581b0 con 0x559308f6ec80 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mon.0 v2:172.21.15.152:3300/0 5 ==== fsmap(e 13) ==== 3494+0+0 (secure 0 0 0) 0x7f266407e070 con 0x559308f6ec80 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 10 client.5364 fetch_fsmap finished waiting for FSMap version 13 2024-03-18T15:01:54.675 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 10 client.5364 resolve_mds: resolved name 'c' to daemon mds.c 2024-03-18T15:01:54.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 20 client.5364 populate_metadata read hostname 'smithi152' 2024-03-18T15:01:54.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559309005ce0 0x5593090060c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 4 client.5364 mds_command: new command op to 5148 tid=0 multi_id=0 [{"prefix": "status"}] 2024-03-18T15:01:54.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 --> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] -- command(tid 0: {"prefix": "status"}) -- 0x559308f74c90 con 0x559309005ce0 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f266bfff640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559309005ce0 0x5593090060c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f2651ffb640 10 client.5364 ms_handle_connect on v2:172.21.15.152:6835/556153091 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.656+0000 7f266bfff640 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559309005ce0 0x5593090060c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1128b154c8835d2 server_cookie=964cfdc0d81d8281 in_seq=0 out_seq=0 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f2651ffb640 1 -- 172.21.15.152:0/3135736955 <== mds.0 v2:172.21.15.152:6835/556153091 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x559308f74c90 con 0x559309005ce0 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f2651ffb640 10 client.5364 handle_command_reply: tid=0 2024-03-18T15:01:54.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 client.5364 shutdown 2024-03-18T15:01:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 msgr2=0x559308f6d7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f266400e930 tx=0x7f2664088dd0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 shutdown_connections 2024-03-18T15:01:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:6835/556153091,v1:172.21.15.152:6837/556153091] conn(0x559309005ce0 0x5593090060c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x559308f73530 0x559308f6f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x559308f6f060 0x559308f66310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f2651ffb640 0 client.5364 ms_handle_reset on v2:172.21.15.152:6835/556153091 2024-03-18T15:01:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 --2- 172.21.15.152:0/3135736955 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x559308f6ec80 0x559308f6d7a0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 >> 172.21.15.152:0/3135736955 conn(0x559308f42160 msgr2=0x559308f8ebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 shutdown_connections 2024-03-18T15:01:54.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 1 -- 172.21.15.152:0/3135736955 wait complete. 2024-03-18T15:01:54.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f267c3e4740 20 client.5364 trim_cache size 0 max 16384 2024-03-18T15:01:54.680 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T15:01:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "cluster_fsid": "ee22e391-802c-4342-9093-15071cbd8b50", 2024-03-18T15:01:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "whoami": 0, 2024-03-18T15:01:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "id": 5148, 2024-03-18T15:01:54.681 INFO:teuthology.orchestra.run.smithi152.stdout: "want_state": "up:active", 2024-03-18T15:01:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "state": "up:active", 2024-03-18T15:01:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "fs_name": "cephfs", 2024-03-18T15:01:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "rank_uptime": 9.0916741180000002, 2024-03-18T15:01:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "mdsmap_epoch": 13, 2024-03-18T15:01:54.682 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch": 35, 2024-03-18T15:01:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "osdmap_epoch_barrier": 35, 2024-03-18T15:01:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: "uptime": 16.567183401000001 2024-03-18T15:01:54.683 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T15:01:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 msgr2=0x7f265406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 0x7f265406e090 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f26740b9a20 tx=0x7f265c007e80 comp rx=0 tx=0).stop 2024-03-18T15:01:54.686 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 msgr2=0x7f267415aab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f266400e960 tx=0x7f266400ee20 comp rx=0 tx=0).stop 2024-03-18T15:01:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 shutdown_connections 2024-03-18T15:01:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f267415e5a0 0x7f26740cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f265406bbd0 0x7f265406e090 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f26740d2d50 0x7f26740ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 --2- 172.21.15.152:0/2498690966 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f26740d1e40 0x7f267415aab0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 >> 172.21.15.152:0/2498690966 conn(0x7f26740d4060 msgr2=0x7f26740d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 shutdown_connections 2024-03-18T15:01:54.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.657+0000 7f26797f4640 1 -- 172.21.15.152:0/2498690966 wait complete. 2024-03-18T15:01:54.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-03-18T15:01:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.790+0000 7fc940836640 1 Processor -- start 2024-03-18T15:01:54.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.790+0000 7fc940836640 1 -- start start 2024-03-18T15:01:54.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc940836640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc93c1622b0 0x7fc93c0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc940836640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fc93c162690 0x7fc93c162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc940836640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc93c0b3440 con 0x7fc93c0cec80 2024-03-18T15:01:54.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc940836640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c0d16c0 con 0x7fc93c1622b0 2024-03-18T15:01:54.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc940836640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fc93c0d2660 con 0x7fc93c162690 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc93c1622b0 0x7fc93c0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc93c1622b0 0x7fc93c0d10d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48972/0 (socket says 172.21.15.152:48972) 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 -- 172.21.15.152:0/3711019555 learned_addr learned my addr 172.21.15.152:0/3711019555 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc933fff640 1 --2- 172.21.15.152:0/3711019555 >> v2:172.21.15.186:3300/0 conn(0x7fc93c162690 0x7fc93c162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 -- 172.21.15.152:0/3711019555 >> v2:172.21.15.186:3300/0 conn(0x7fc93c162690 msgr2=0x7fc93c162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:01:54.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3711019555 >> v2:172.21.15.186:3300/0 conn(0x7fc93c162690 0x7fc93c162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 -- 172.21.15.152:0/3711019555 >> v1:172.21.15.186:6789/0 conn(0x7fc93c0cec80 legacy=0x7fc93c0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.791+0000 7fc93a59c640 1 -- 172.21.15.152:0/3711019555 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c0d20a0 con 0x7fc93c1622b0 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.792+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3711019555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c1622b0 0x7fc93c0d10d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009870 tx=0x7fc92c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=165c7c544a5b8684 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.792+0000 7fc939d9b640 1 -- 172.21.15.152:0/3711019555 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c02e070 con 0x7fc93c1622b0 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.792+0000 7fc939d9b640 1 -- 172.21.15.152:0/3711019555 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc92c037070 con 0x7fc93c1622b0 2024-03-18T15:01:54.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.792+0000 7fc939d9b640 1 -- 172.21.15.152:0/3711019555 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc92c031a00 con 0x7fc93c1622b0 2024-03-18T15:01:54.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 -- 172.21.15.152:0/3711019555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c1622b0 msgr2=0x7fc93c0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 --2- 172.21.15.152:0/3711019555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c1622b0 0x7fc93c0d10d0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fc92c009870 tx=0x7fc92c02b880 comp rx=0 tx=0).stop 2024-03-18T15:01:54.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 -- 172.21.15.152:0/3711019555 shutdown_connections 2024-03-18T15:01:54.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 --2- 172.21.15.152:0/3711019555 >> v2:172.21.15.186:3300/0 conn(0x7fc93c162690 0x7fc93c162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 --2- 172.21.15.152:0/3711019555 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c1622b0 0x7fc93c0d10d0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 -- 172.21.15.152:0/3711019555 >> 172.21.15.152:0/3711019555 conn(0x7fc93c0d4070 msgr2=0x7fc93c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:54.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 -- 172.21.15.152:0/3711019555 shutdown_connections 2024-03-18T15:01:54.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.793+0000 7fc940836640 1 -- 172.21.15.152:0/3711019555 wait complete. 2024-03-18T15:01:54.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.794+0000 7fc940836640 1 Processor -- start 2024-03-18T15:01:54.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.794+0000 7fc940836640 1 -- start start 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 0x7fc93c06d4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc93c1622b0 0x7fc93c158120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c15faa0 con 0x7fc93c162690 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc93c0d2ab0 con 0x7fc93c1622b0 2024-03-18T15:01:54.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc940836640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc93c15fc20 con 0x7fc93c0cec80 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48986/0 (socket says 172.21.15.152:48986) 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 -- 172.21.15.152:0/3232870297 learned_addr learned my addr 172.21.15.152:0/3232870297 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc933fff640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc93c1622b0 0x7fc93c158120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 0x7fc93c06d4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 -- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 msgr2=0x7fc93c06d4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 0x7fc93c06d4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 -- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc93c1622b0 msgr2=0x7fc93c158120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc93c1622b0 0x7fc93c158120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 -- 172.21.15.152:0/3232870297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc93c0b5640 con 0x7fc93c162690 2024-03-18T15:01:54.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 0x7fc93c06d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T15:01:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.795+0000 7fc93ad9d640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c6b0 tx=0x7fc93400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.796+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934003b70 con 0x7fc93c162690 2024-03-18T15:01:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.796+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc934003d30 con 0x7fc93c162690 2024-03-18T15:01:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.796+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc93c0b5920 con 0x7fc93c162690 2024-03-18T15:01:54.810 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.796+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc934005310 con 0x7fc93c162690 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.796+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc93c0b5ee0 con 0x7fc93c162690 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.797+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc93c04f5b0 con 0x7fc93c162690 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.797+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc9340054b0 con 0x7fc93c162690 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.797+0000 7fc932ffd640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 0x7fc91c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.798+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fc93408a850 con 0x7fc93c162690 2024-03-18T15:01:54.811 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.798+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 0x7fc91c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:01:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.798+0000 7fc93a59c640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 0x7fc91c06e090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc92c036000 tx=0x7fc92c008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:01:54.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:54.806+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc9340593d0 con 0x7fc93c162690 2024-03-18T15:01:55.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.024+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc93c0d18d0 con 0x7fc93c162690 2024-03-18T15:01:55.025 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.025+0000 7fc932ffd640 1 -- 172.21.15.152:0/3232870297 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) ==== 53+0+73 (secure 0 0 0) 0x7fc934058cd0 con 0x7fc93c162690 2024-03-18T15:01:55.026 INFO:teuthology.orchestra.run.smithi152.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 msgr2=0x7fc91c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 0x7fc91c06e090 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc92c036000 tx=0x7fc92c008030 comp rx=0 tx=0).stop 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 msgr2=0x7fc93c158660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fc93400c6b0 tx=0x7fc93400cb70 comp rx=0 tx=0).stop 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 shutdown_connections 2024-03-18T15:01:55.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc93c162690 0x7fc93c158660 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc93c1622b0 0x7fc93c158120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc91c06bbd0 0x7fc91c06e090 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 --2- 172.21.15.152:0/3232870297 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc93c0cec80 0x7fc93c06d4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 >> 172.21.15.152:0/3232870297 conn(0x7fc93c0d4070 msgr2=0x7fc93c06ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 shutdown_connections 2024-03-18T15:01:55.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55.027+0000 7fc940836640 1 -- 172.21.15.152:0/3232870297 wait complete. 2024-03-18T15:01:55.039 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-03-18T15:01:55.039 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-18T15:01:55.039 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi152.front.sepia.ceph.com 2024-03-18T15:01:55.039 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-18T15:01:55.040 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:55.040 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-03-18T15:01:55.040 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2024-03-18T15:01:55.040 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-18T15:01:55.040 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T15:01:55.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.041 DEBUG:teuthology.orchestra.run.smithi152:> ip addr 2024-03-18T15:01:55.058 INFO:teuthology.orchestra.run.smithi152.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-18T15:01:55.058 INFO:teuthology.orchestra.run.smithi152.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-18T15:01:55.058 INFO:teuthology.orchestra.run.smithi152.stdout: inet 127.0.0.1/8 scope host lo 2024-03-18T15:01:55.058 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.058 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 ::1/128 scope host 2024-03-18T15:01:55.059 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.059 INFO:teuthology.orchestra.run.smithi152.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:55.059 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:44 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:55.059 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f0 2024-03-18T15:01:55.059 INFO:teuthology.orchestra.run.smithi152.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:da:6c:45 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout: altname enp7s0f1 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e2 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-18T15:01:55.060 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 0c:c4:7a:88:6d:e3 brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:55.061 INFO:teuthology.orchestra.run.smithi152.stdout: inet 172.21.15.152/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-18T15:01:55.061 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft 42694sec preferred_lft 42694sec 2024-03-18T15:01:55.061 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::ec4:7aff:fe88:6de3/64 scope link 2024-03-18T15:01:55.061 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.061 INFO:teuthology.orchestra.run.smithi152.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-03-18T15:01:55.062 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 3a:62:17:c1:f2:1d brd ff:ff:ff:ff:ff:ff 2024-03-18T15:01:55.062 INFO:teuthology.orchestra.run.smithi152.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-03-18T15:01:55.062 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.062 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::b4fa:27ff:fee1:15eb/64 scope link 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether 3a:62:17:c1:f2:1d brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::3862:17ff:fec1:f21d/64 scope link 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-03-18T15:01:55.063 INFO:teuthology.orchestra.run.smithi152.stdout: link/ether d2:15:3c:94:c7:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T15:01:55.064 INFO:teuthology.orchestra.run.smithi152.stdout: inet6 fe80::d015:3cff:fe94:c7e6/64 scope link 2024-03-18T15:01:55.064 INFO:teuthology.orchestra.run.smithi152.stdout: valid_lft forever preferred_lft forever 2024-03-18T15:01:55.064 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.065 DEBUG:teuthology.orchestra.run.smithi152:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-18T15:01:55.125 INFO:teuthology.orchestra.run.smithi152.stdout:1 2024-03-18T15:01:55.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.128 DEBUG:teuthology.orchestra.run.smithi152:> route 2024-03-18T15:01:55.183 INFO:teuthology.orchestra.run.smithi152.stdout:Kernel IP routing table 2024-03-18T15:01:55.183 INFO:teuthology.orchestra.run.smithi152.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-18T15:01:55.184 INFO:teuthology.orchestra.run.smithi152.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-18T15:01:55.184 INFO:teuthology.orchestra.run.smithi152.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-18T15:01:55.184 INFO:teuthology.orchestra.run.smithi152.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> set -e 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-18T15:01:55.184 DEBUG:teuthology.orchestra.run.smithi152:> ') 2024-03-18T15:01:55.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-03-18T15:01:55.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:55.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.320 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T15:01:55.334 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-18T15:01:55.334 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T15:01:55.334 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-18T15:01:55.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.335 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link set brx.0 up 2024-03-18T15:01:55.403 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:55.403 DEBUG:teuthology.orchestra.run.smithi152:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:55.458 INFO:teuthology.orchestra.run.smithi152.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-18T15:01:55.458 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-18T15:01:55.459 DEBUG:teuthology.orchestra.run.smithi152:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:55.513 INFO:tasks.cephfs.kernel_mount:mounting using device: 0@.cephfs=/ 2024-03-18T15:01:55.513 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.513 DEBUG:teuthology.orchestra.run.smithi152:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph 0@.cephfs=/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:55.604 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:55.605 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:55.612 INFO:teuthology.orchestra.run.smithi152.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,nofallback 2024-03-18T15:01:55.612 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes". 2024-03-18T15:01:55.612 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: resolved to: "172.21.15.152:3300,172.21.15.186:3300,172.21.15.186:3301" 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: trying mount with new device syntax: 0@ee22e391-802c-4342-9093-15071cbd8b50.cephfs=/ 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,ms_mode=prefer-crc,key=0,mon_addr=172.21.15.152:3300/172.21.15.186:3300/172.21.15.186:3301" will pass to kernel 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout: You just mounted a file system that supports labels which does not 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout: applications will generate AVC messages and not be allowed access to 2024-03-18T15:01:55.613 INFO:teuthology.orchestra.run.smithi152.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-03-18T15:01:55.616 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-03-18T15:01:55.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.616 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-18T15:01:55.646 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-03-18T15:01:55.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-03-18T15:01:55.743 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:01:55 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-03-18T15:01:55.749 INFO:teuthology.orchestra.run.smithi152.stdout:client5373 2024-03-18T15:01:55.749 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:01:55.749 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T15:01:55.764 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=xfstests-dev 2024-03-18T15:01:55.818 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.YntrTC91Q1xfstests-dev 2024-03-18T15:01:55.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.819 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.YntrTC91Q1xfstests-dev) 2024-03-18T15:01:55.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:55.887 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.YntrTC91Q1xfstests-dev) 2024-03-18T15:01:55.945 INFO:teuthology.orchestra.run.smithi152.stderr:Cloning into '/tmp/tmp.YntrTC91Q1xfstests-dev'... 2024-03-18T15:01:56.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:56.653 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2024-03-18T15:01:56.712 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=test 2024-03-18T15:01:56.768 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.n8huAW33L0test 2024-03-18T15:01:56.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:01:56.768 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2024-03-18T15:01:56.824 DEBUG:teuthology.orchestra.run.smithi152:> mktemp -d --suffix=scratch 2024-03-18T15:01:56.878 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.KIGoX27qplscratch 2024-03-18T15:01:56.879 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2024-03-18T15:01:56.879 DEBUG:teuthology.orchestra.run.smithi152:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2024-03-18T15:01:57.514 INFO:teuthology.orchestra.run.smithi152.stdout:Last metadata expiration check: 0:03:47 ago on Mon 18 Mar 2024 02:58:10 PM UTC. 2024-03-18T15:01:57.622 INFO:teuthology.orchestra.run.smithi152.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2024-03-18T15:01:57.623 INFO:teuthology.orchestra.run.smithi152.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2024-03-18T15:01:57.624 INFO:teuthology.orchestra.run.smithi152.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2024-03-18T15:01:57.626 INFO:teuthology.orchestra.run.smithi152.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2024-03-18T15:01:57.627 INFO:teuthology.orchestra.run.smithi152.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2024-03-18T15:01:57.629 INFO:teuthology.orchestra.run.smithi152.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2024-03-18T15:01:57.631 INFO:teuthology.orchestra.run.smithi152.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2024-03-18T15:01:57.632 INFO:teuthology.orchestra.run.smithi152.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2024-03-18T15:01:57.634 INFO:teuthology.orchestra.run.smithi152.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2024-03-18T15:01:57.637 INFO:teuthology.orchestra.run.smithi152.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-03-18T15:01:57.639 INFO:teuthology.orchestra.run.smithi152.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2024-03-18T15:01:57.641 INFO:teuthology.orchestra.run.smithi152.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2024-03-18T15:01:57.642 INFO:teuthology.orchestra.run.smithi152.stdout:Package libuuid-devel-2.37.4-18.el9.x86_64 is already installed. 2024-03-18T15:01:57.643 INFO:teuthology.orchestra.run.smithi152.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2024-03-18T15:01:57.644 INFO:teuthology.orchestra.run.smithi152.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2024-03-18T15:01:57.645 INFO:teuthology.orchestra.run.smithi152.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2024-03-18T15:01:57.647 INFO:teuthology.orchestra.run.smithi152.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2024-03-18T15:01:57.648 INFO:teuthology.orchestra.run.smithi152.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2024-03-18T15:01:57.649 INFO:teuthology.orchestra.run.smithi152.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2024-03-18T15:01:57.652 INFO:teuthology.orchestra.run.smithi152.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-03-18T15:01:57.719 INFO:teuthology.orchestra.run.smithi152.stdout:Dependencies resolved. 2024-03-18T15:01:57.723 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T15:01:57.723 INFO:teuthology.orchestra.run.smithi152.stdout: Package Arch Version Repository Size 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout:Installing: 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: indent x86_64 2.2.13-5.el9 epel 179 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: kernel-devel x86_64 5.14.0-427.el9 appstream 22 M 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: sqlite x86_64 3.34.1-7.el9 CentOS-AppStream 747 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrading: 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: cpp x86_64 11.4.1-3.el9 appstream 11 M 2024-03-18T15:01:57.724 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper x86_64 9:1.02.197-2.el9 baseos 141 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-event x86_64 9:1.02.197-2.el9 baseos 34 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-event-libs x86_64 9:1.02.197-2.el9 baseos 32 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-libs x86_64 9:1.02.197-2.el9 baseos 179 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: e2fsprogs x86_64 1.46.5-5.el9 baseos 1.0 M 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: e2fsprogs-libs x86_64 1.46.5-5.el9 baseos 222 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: gcc x86_64 11.4.1-3.el9 appstream 32 M 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: gcc-c++ x86_64 11.4.1-3.el9 appstream 13 M 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: gcc-plugin-annobin x86_64 11.4.1-3.el9 appstream 47 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: git x86_64 2.43.0-1.el9 appstream 51 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: git-core x86_64 2.43.0-1.el9 appstream 4.4 M 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: git-core-doc noarch 2.43.0-1.el9 appstream 2.9 M 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err x86_64 1.46.5-5.el9 baseos 26 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: libgcc x86_64 11.4.1-3.el9 baseos 92 k 2024-03-18T15:01:57.725 INFO:teuthology.orchestra.run.smithi152.stdout: libgomp x86_64 11.4.1-3.el9 baseos 268 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: libss x86_64 1.46.5-5.el9 baseos 32 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: libstdc++ x86_64 11.4.1-3.el9 baseos 743 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: libstdc++-devel x86_64 11.4.1-3.el9 appstream 2.4 M 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: lvm2 x86_64 9:2.03.23-2.el9 baseos 1.5 M 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: lvm2-libs x86_64 9:2.03.23-2.el9 baseos 1.0 M 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: make x86_64 1:4.3-8.el9 baseos 536 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: perl-Git noarch 2.43.0-1.el9 appstream 38 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: python-unversioned-command noarch 3.9.18-3.el9 CentOS-AppStream 8.3 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3 x86_64 3.9.18-3.el9 CentOS-BaseOS 25 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel x86_64 3.9.18-3.el9 CentOS-AppStream 204 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: python3-libs x86_64 3.9.18-3.el9 CentOS-BaseOS 7.3 M 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: sqlite-libs x86_64 3.34.1-7.el9 CentOS-BaseOS 619 k 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout:Installing dependencies: 2024-03-18T15:01:57.726 INFO:teuthology.orchestra.run.smithi152.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:Installing weak dependencies: 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction Summary 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:================================================================================ 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:Install 17 Packages 2024-03-18T15:01:57.727 INFO:teuthology.orchestra.run.smithi152.stdout:Upgrade 28 Packages 2024-03-18T15:01:57.728 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:01:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:Total download size: 109 M 2024-03-18T15:01:57.728 INFO:teuthology.orchestra.run.smithi152.stdout:Downloading Packages: 2024-03-18T15:01:58.481 INFO:teuthology.orchestra.run.smithi152.stdout:(1/45): fio-engine-http-3.35-1.el9.x86_64.rpm 59 kB/s | 17 kB 00:00 2024-03-18T15:01:58.506 INFO:teuthology.orchestra.run.smithi152.stdout:(2/45): fio-engine-libaio-3.35-1.el9.x86_64.rpm 46 kB/s | 14 kB 00:00 2024-03-18T15:01:58.682 INFO:teuthology.orchestra.run.smithi152.stdout:(3/45): fio-engine-nbd-3.35-1.el9.x86_64.rpm 68 kB/s | 13 kB 00:00 2024-03-18T15:01:58.707 INFO:teuthology.orchestra.run.smithi152.stdout:(4/45): fio-engine-rados-3.35-1.el9.x86_64.rpm 73 kB/s | 15 kB 00:00 2024-03-18T15:01:58.857 INFO:teuthology.orchestra.run.smithi152.stdout:(5/45): fio-engine-rbd-3.35-1.el9.x86_64.rpm 86 kB/s | 15 kB 00:00 2024-03-18T15:01:58.907 INFO:teuthology.orchestra.run.smithi152.stdout:(6/45): fio-engine-rdma-3.35-1.el9.x86_64.rpm 98 kB/s | 20 kB 00:00 2024-03-18T15:01:59.141 INFO:teuthology.orchestra.run.smithi152.stdout:(7/45): libcap-devel-2.48-9.el9.x86_64.rpm 116 kB/s | 33 kB 00:00 2024-03-18T15:01:59.308 INFO:teuthology.orchestra.run.smithi152.stdout:(8/45): fio-3.35-1.el9.x86_64.rpm 5.6 MB/s | 6.2 MB 00:01 2024-03-18T15:01:59.333 INFO:teuthology.orchestra.run.smithi152.stdout:(9/45): sqlite-3.34.1-7.el9.x86_64.rpm 1.7 MB/s | 747 kB 00:00 2024-03-18T15:01:59.358 INFO:teuthology.orchestra.run.smithi152.stdout:(10/45): udftools-2.2-5.el9.x86_64.rpm 664 kB/s | 144 kB 00:00 2024-03-18T15:01:59.375 INFO:teuthology.orchestra.run.smithi152.stdout:(11/45): rmt-1.6-6.el9.x86_64.rpm 680 kB/s | 45 kB 00:00 2024-03-18T15:01:59.709 INFO:teuthology.orchestra.run.smithi152.stdout:(12/45): gdbm-1.19-4.el9.x86_64.rpm 397 kB/s | 132 kB 00:00 2024-03-18T15:01:59.792 INFO:teuthology.orchestra.run.smithi152.stdout:(13/45): gdbm-devel-1.19-4.el9.x86_64.rpm 705 kB/s | 59 kB 00:00 2024-03-18T15:01:59.951 INFO:teuthology.orchestra.run.smithi152.stdout:(14/45): dump-0.4-0.51.b47.el9.x86_64.rpm 555 kB/s | 88 kB 00:00 2024-03-18T15:02:00.060 INFO:teuthology.orchestra.run.smithi152.stdout:(15/45): indent-2.2.13-5.el9.x86_64.rpm 1.6 MB/s | 179 kB 00:00 2024-03-18T15:02:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:(16/45): python-unversioned-command-3.9.18-3.el 200 kB/s | 8.3 kB 00:00 2024-03-18T15:02:00.169 INFO:teuthology.orchestra.run.smithi152.stdout:(17/45): python3-devel-3.9.18-3.el9.x86_64.rpm 3.0 MB/s | 204 kB 00:00 2024-03-18T15:02:00.202 INFO:teuthology.orchestra.run.smithi152.stdout:(18/45): python3-3.9.18-3.el9.x86_64.rpm 754 kB/s | 25 kB 00:00 2024-03-18T15:02:00.252 INFO:teuthology.orchestra.run.smithi152.stdout:(19/45): libnbd-1.18.1-3.el9.x86_64.rpm 186 kB/s | 166 kB 00:00 2024-03-18T15:02:00.594 INFO:teuthology.orchestra.run.smithi152.stdout:(20/45): sqlite-libs-3.34.1-7.el9.x86_64.rpm 1.8 MB/s | 619 kB 00:00 2024-03-18T15:02:00.778 INFO:teuthology.orchestra.run.smithi152.stdout:(21/45): python3-libs-3.9.18-3.el9.x86_64.rpm 13 MB/s | 7.3 MB 00:00 2024-03-18T15:02:01.420 INFO:teuthology.orchestra.run.smithi152.stdout:(22/45): device-mapper-event-1.02.197-2.el9.x86 53 kB/s | 34 kB 00:00 2024-03-18T15:02:01.445 INFO:teuthology.orchestra.run.smithi152.stdout:(23/45): device-mapper-1.02.197-2.el9.x86_64.rp 166 kB/s | 141 kB 00:00 2024-03-18T15:02:02.062 INFO:teuthology.orchestra.run.smithi152.stdout:(24/45): device-mapper-event-libs-1.02.197-2.el 50 kB/s | 32 kB 00:00 2024-03-18T15:02:02.396 INFO:teuthology.orchestra.run.smithi152.stdout:(25/45): device-mapper-libs-1.02.197-2.el9.x86_ 188 kB/s | 179 kB 00:00 2024-03-18T15:02:03.330 INFO:teuthology.orchestra.run.smithi152.stdout:(26/45): e2fsprogs-libs-1.46.5-5.el9.x86_64.rpm 238 kB/s | 222 kB 00:00 2024-03-18T15:02:04.055 INFO:teuthology.orchestra.run.smithi152.stdout:(27/45): libcom_err-1.46.5-5.el9.x86_64.rpm 36 kB/s | 26 kB 00:00 2024-03-18T15:02:04.105 INFO:teuthology.orchestra.run.smithi152.stdout:(28/45): e2fsprogs-1.46.5-5.el9.x86_64.rpm 504 kB/s | 1.0 MB 00:02 2024-03-18T15:02:04.788 INFO:teuthology.orchestra.run.smithi152.stdout:(29/45): libgcc-11.4.1-3.el9.x86_64.rpm 126 kB/s | 92 kB 00:00 2024-03-18T15:02:05.055 INFO:teuthology.orchestra.run.smithi152.stdout:(30/45): libgomp-11.4.1-3.el9.x86_64.rpm 283 kB/s | 268 kB 00:00 2024-03-18T15:02:05.397 INFO:teuthology.orchestra.run.smithi152.stdout:(31/45): libss-1.46.5-5.el9.x86_64.rpm 52 kB/s | 32 kB 00:00 2024-03-18T15:02:06.731 INFO:teuthology.orchestra.run.smithi152.stdout:(32/45): libstdc++-11.4.1-3.el9.x86_64.rpm 443 kB/s | 743 kB 00:01 2024-03-18T15:02:08.131 INFO:teuthology.orchestra.run.smithi152.stdout:(33/45): lvm2-2.03.23-2.el9.x86_64.rpm 576 kB/s | 1.5 MB 00:02 2024-03-18T15:02:08.639 INFO:teuthology.orchestra.run.smithi152.stdout:(34/45): lvm2-libs-2.03.23-2.el9.x86_64.rpm 536 kB/s | 1.0 MB 00:01 2024-03-18T15:02:09.556 INFO:teuthology.orchestra.run.smithi152.stdout:(35/45): make-4.3-8.el9.x86_64.rpm 377 kB/s | 536 kB 00:01 2024-03-18T15:02:12.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:02:12.637 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:02:21.597 INFO:teuthology.orchestra.run.smithi152.stdout:(36/45): kernel-devel-5.14.0-427.el9.x86_64.rpm 992 kB/s | 22 MB 00:22 2024-03-18T15:02:23.014 INFO:teuthology.orchestra.run.smithi152.stdout:(37/45): gcc-11.4.1-3.el9.x86_64.rpm 2.4 MB/s | 32 MB 00:13 2024-03-18T15:02:23.273 INFO:teuthology.orchestra.run.smithi152.stdout:(38/45): cpp-11.4.1-3.el9.x86_64.rpm 744 kB/s | 11 MB 00:14 2024-03-18T15:02:23.773 INFO:teuthology.orchestra.run.smithi152.stdout:(39/45): gcc-plugin-annobin-11.4.1-3.el9.x86_64 62 kB/s | 47 kB 00:00 2024-03-18T15:02:23.932 INFO:teuthology.orchestra.run.smithi152.stdout:(40/45): git-2.43.0-1.el9.x86_64.rpm 77 kB/s | 51 kB 00:00 2024-03-18T15:02:28.215 INFO:teuthology.orchestra.run.smithi152.stdout:(41/45): git-core-doc-2.43.0-1.el9.noarch.rpm 699 kB/s | 2.9 MB 00:04 2024-03-18T15:02:30.387 INFO:teuthology.orchestra.run.smithi152.stdout:(42/45): git-core-2.43.0-1.el9.x86_64.rpm 686 kB/s | 4.4 MB 00:06 2024-03-18T15:02:31.104 INFO:teuthology.orchestra.run.smithi152.stdout:(43/45): perl-Git-2.43.0-1.el9.noarch.rpm 53 kB/s | 38 kB 00:00 2024-03-18T15:02:32.479 INFO:teuthology.orchestra.run.smithi152.stdout:(44/45): libstdc++-devel-11.4.1-3.el9.x86_64.rp 581 kB/s | 2.4 MB 00:04 2024-03-18T15:02:39.003 INFO:teuthology.orchestra.run.smithi152.stdout:(45/45): gcc-c++-11.4.1-3.el9.x86_64.rpm 752 kB/s | 13 MB 00:17 2024-03-18T15:02:39.007 INFO:teuthology.orchestra.run.smithi152.stdout:-------------------------------------------------------------------------------- 2024-03-18T15:02:39.007 INFO:teuthology.orchestra.run.smithi152.stdout:Total 2.6 MB/s | 109 MB 00:41 2024-03-18T15:02:40.109 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction check 2024-03-18T15:02:40.429 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction check succeeded. 2024-03-18T15:02:40.429 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction test 2024-03-18T15:02:42.115 INFO:teuthology.orchestra.run.smithi152.stdout:Transaction test succeeded. 2024-03-18T15:02:42.115 INFO:teuthology.orchestra.run.smithi152.stdout:Running transaction 2024-03-18T15:02:42.893 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:02:42.895 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:02:45.459 INFO:teuthology.orchestra.run.smithi152.stdout: Preparing : 1/1 2024-03-18T15:02:45.537 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-18T15:02:45.600 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgcc-11.4.1-3.el9.x86_64 1/73 2024-03-18T15:02:45.670 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libcom_err-1.46.5-5.el9.x86_64 2/73 2024-03-18T15:02:45.731 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libstdc++-11.4.1-3.el9.x86_64 3/73 2024-03-18T15:02:45.787 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : e2fsprogs-libs-1.46.5-5.el9.x86_64 4/73 2024-03-18T15:02:45.844 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : device-mapper-libs-9:1.02.197-2.el9.x86_64 5/73 2024-03-18T15:02:45.885 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : device-mapper-9:1.02.197-2.el9.x86_64 6/73 2024-03-18T15:02:46.111 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 7/73 2024-03-18T15:02:46.272 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : git-core-2.43.0-1.el9.x86_64 8/73 2024-03-18T15:02:46.333 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : make-1:4.3-8.el9.x86_64 9/73 2024-03-18T15:02:47.768 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : sqlite-libs-3.34.1-7.el9.x86_64 10/73 2024-03-18T15:02:47.859 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : python3-libs-3.9.18-3.el9.x86_64 11/73 2024-03-18T15:02:47.906 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : python3-3.9.18-3.el9.x86_64 12/73 2024-03-18T15:02:48.769 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : python-unversioned-command-3.9.18-3.el9.noarch 13/73 2024-03-18T15:02:48.891 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : git-core-doc-2.43.0-1.el9.noarch 14/73 2024-03-18T15:02:48.939 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : perl-Git-2.43.0-1.el9.noarch 15/73 2024-03-18T15:02:48.980 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : git-2.43.0-1.el9.x86_64 16/73 2024-03-18T15:02:49.011 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-18T15:02:49.228 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: device-mapper-event-9:1.02.197-2.el9.x86_64 17/73 2024-03-18T15:02:50.193 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : lvm2-libs-9:2.03.23-2.el9.x86_64 18/73 2024-03-18T15:02:50.414 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libstdc++-devel-11.4.1-3.el9.x86_64 19/73 2024-03-18T15:02:50.762 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libss-1.46.5-5.el9.x86_64 20/73 2024-03-18T15:02:50.814 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : cpp-11.4.1-3.el9.x86_64 21/73 2024-03-18T15:02:51.767 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : libgomp-11.4.1-3.el9.x86_64 22/73 2024-03-18T15:02:51.930 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : gcc-11.4.1-3.el9.x86_64 23/73 2024-03-18T15:02:51.976 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: gcc-11.4.1-3.el9.x86_64 23/73 2024-03-18T15:02:52.013 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 24/73 2024-03-18T15:02:52.041 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 25/73 2024-03-18T15:02:52.066 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 26/73 2024-03-18T15:02:52.092 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 27/73 2024-03-18T15:02:52.117 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 28/73 2024-03-18T15:02:52.142 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 29/73 2024-03-18T15:02:52.167 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 30/73 2024-03-18T15:02:52.378 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 31/73 2024-03-18T15:02:52.423 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : fio-3.35-1.el9.x86_64 32/73 2024-03-18T15:02:52.459 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : rmt-2:1.6-6.el9.x86_64 33/73 2024-03-18T15:02:52.489 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 34/73 2024-03-18T15:03:02.620 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 35/73 2024-03-18T15:03:02.793 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-18T15:03:12.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:03:12.968 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:03:13.231 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: kernel-devel-5.14.0-427.el9.x86_64 36/73 2024-03-18T15:03:13.328 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : gcc-c++-11.4.1-3.el9.x86_64 37/73 2024-03-18T15:03:13.360 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-18T15:03:13.452 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-3.el9.x86_64 38/73 2024-03-18T15:03:13.671 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : e2fsprogs-1.46.5-5.el9.x86_64 39/73 2024-03-18T15:03:13.671 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-18T15:03:13.671 INFO:teuthology.orchestra.run.smithi152.stdout:warning: /etc/lvm/lvm.conf created as /etc/lvm/lvm.conf.rpmnew 2024-03-18T15:03:13.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:03:13.976 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lvm2-9:2.03.23-2.el9.x86_64 40/73 2024-03-18T15:03:14.038 INFO:teuthology.orchestra.run.smithi152.stdout: Upgrading : python3-devel-3.9.18-3.el9.x86_64 41/73 2024-03-18T15:03:14.097 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : sqlite-3.34.1-7.el9.x86_64 42/73 2024-03-18T15:03:14.138 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : indent-2.2.13-5.el9.x86_64 43/73 2024-03-18T15:03:14.180 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : udftools-2.2-5.el9.x86_64 44/73 2024-03-18T15:03:14.206 INFO:teuthology.orchestra.run.smithi152.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 45/73 2024-03-18T15:03:14.234 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : git-2.39.3-1.el9.x86_64 46/73 2024-03-18T15:03:14.275 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 47/73 2024-03-18T15:03:14.308 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 48/73 2024-03-18T15:03:14.342 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 49/73 2024-03-18T15:03:14.367 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 50/73 2024-03-18T15:03:14.392 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 51/73 2024-03-18T15:03:14.392 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-18T15:03:14.439 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 52/73 2024-03-18T15:03:14.477 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 53/73 2024-03-18T15:03:14.484 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T15:03:14.485 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T15:03:14.539 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: lvm2-9:2.03.21-3.el9.x86_64 54/73 2024-03-18T15:03:14.594 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 55/73 2024-03-18T15:03:14.628 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : git-core-doc-2.39.3-1.el9.noarch 56/73 2024-03-18T15:03:14.654 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : perl-Git-2.39.3-1.el9.noarch 57/73 2024-03-18T15:03:14.679 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : lvm2-libs-9:2.03.21-3.el9.x86_64 58/73 2024-03-18T15:03:14.684 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-18T15:03:14.713 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : device-mapper-event-9:1.02.195-3.el9.x86_64 59/73 2024-03-18T15:03:14.738 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 60/73 2024-03-18T15:03:14.763 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 61/73 2024-03-18T15:03:14.789 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 62/73 2024-03-18T15:03:14.814 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 63/73 2024-03-18T15:03:14.840 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : device-mapper-libs-9:1.02.195-3.el9.x86_64 64/73 2024-03-18T15:03:14.899 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : device-mapper-9:1.02.195-3.el9.x86_64 65/73 2024-03-18T15:03:14.960 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 66/73 2024-03-18T15:03:14.984 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : sqlite-libs-3.34.1-6.el9.x86_64 67/73 2024-03-18T15:03:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 68/73 2024-03-18T15:03:15.010 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-18T15:03:15.082 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 69/73 2024-03-18T15:03:15.113 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : git-core-2.39.3-1.el9.x86_64 70/73 2024-03-18T15:03:15.138 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 71/73 2024-03-18T15:03:15.164 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 72/73 2024-03-18T15:03:15.232 INFO:teuthology.orchestra.run.smithi152.stdout: Cleanup : make-1:4.3-7.el9.x86_64 73/73 2024-03-18T15:03:17.984 INFO:teuthology.orchestra.run.smithi152.stdout: Running scriptlet: make-1:4.3-7.el9.x86_64 73/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-3.35-1.el9.x86_64 1/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sqlite-3.34.1-7.el9.x86_64 9/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : kernel-devel-5.14.0-427.el9.x86_64 12/73 2024-03-18T15:03:17.985 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : indent-2.2.13-5.el9.x86_64 17/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python-unversioned-command-3.9.18-3.el9.noarch 18/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 19/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 20/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 21/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-3.9.18-3.el9.x86_64 22/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-3.9.17-2.el9.x86_64 23/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-libs-3.9.18-3.el9.x86_64 24/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 25/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sqlite-libs-3.34.1-7.el9.x86_64 26/73 2024-03-18T15:03:17.986 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : sqlite-libs-3.34.1-6.el9.x86_64 27/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-9:1.02.197-2.el9.x86_64 28/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-9:1.02.195-3.el9.x86_64 29/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-event-9:1.02.197-2.el9.x86_64 30/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-event-9:1.02.195-3.el9.x86_64 31/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-event-libs-9:1.02.197-2.el9.x86_64 32/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-event-libs-9:1.02.195-3.el9.x86_64 33/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-libs-9:1.02.197-2.el9.x86_64 34/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : device-mapper-libs-9:1.02.195-3.el9.x86_64 35/73 2024-03-18T15:03:17.991 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : e2fsprogs-1.46.5-5.el9.x86_64 36/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 37/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : e2fsprogs-libs-1.46.5-5.el9.x86_64 38/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 39/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-1.46.5-5.el9.x86_64 40/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 41/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgcc-11.4.1-3.el9.x86_64 42/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 43/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgomp-11.4.1-3.el9.x86_64 44/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 45/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libss-1.46.5-5.el9.x86_64 46/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libss-1.46.5-3.el9.x86_64 47/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libstdc++-11.4.1-3.el9.x86_64 48/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 49/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lvm2-9:2.03.23-2.el9.x86_64 50/73 2024-03-18T15:03:17.992 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lvm2-9:2.03.21-3.el9.x86_64 51/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lvm2-libs-9:2.03.23-2.el9.x86_64 52/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : lvm2-libs-9:2.03.21-3.el9.x86_64 53/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : make-1:4.3-8.el9.x86_64 54/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : make-1:4.3-7.el9.x86_64 55/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cpp-11.4.1-3.el9.x86_64 56/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 57/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-11.4.1-3.el9.x86_64 58/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 59/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-c++-11.4.1-3.el9.x86_64 60/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 61/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-plugin-annobin-11.4.1-3.el9.x86_64 62/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 63/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-2.43.0-1.el9.x86_64 64/73 2024-03-18T15:03:17.993 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-2.39.3-1.el9.x86_64 65/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-core-2.43.0-1.el9.x86_64 66/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-core-2.39.3-1.el9.x86_64 67/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-core-doc-2.43.0-1.el9.noarch 68/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : git-core-doc-2.39.3-1.el9.noarch 69/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libstdc++-devel-11.4.1-3.el9.x86_64 70/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 71/73 2024-03-18T15:03:17.994 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : perl-Git-2.43.0-1.el9.noarch 72/73 2024-03-18T15:03:19.362 INFO:teuthology.orchestra.run.smithi152.stdout: Verifying : perl-Git-2.39.3-1.el9.noarch 73/73 2024-03-18T15:03:19.362 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:03:19.362 INFO:teuthology.orchestra.run.smithi152.stdout:Upgraded: 2024-03-18T15:03:19.362 INFO:teuthology.orchestra.run.smithi152.stdout: cpp-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.362 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-9:1.02.197-2.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-event-9:1.02.197-2.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-event-libs-9:1.02.197-2.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: device-mapper-libs-9:1.02.197-2.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: e2fsprogs-1.46.5-5.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: e2fsprogs-libs-1.46.5-5.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: gcc-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: gcc-c++-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: gcc-plugin-annobin-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: git-2.43.0-1.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: git-core-2.43.0-1.el9.x86_64 2024-03-18T15:03:19.363 INFO:teuthology.orchestra.run.smithi152.stdout: git-core-doc-2.43.0-1.el9.noarch 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libcom_err-1.46.5-5.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libgcc-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libgomp-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libss-1.46.5-5.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libstdc++-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: libstdc++-devel-11.4.1-3.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: lvm2-9:2.03.23-2.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: lvm2-libs-9:2.03.23-2.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: make-1:4.3-8.el9.x86_64 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: perl-Git-2.43.0-1.el9.noarch 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: python-unversioned-command-3.9.18-3.el9.noarch 2024-03-18T15:03:19.364 INFO:teuthology.orchestra.run.smithi152.stdout: python3-3.9.18-3.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: python3-libs-3.9.18-3.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: sqlite-libs-3.34.1-7.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout:Installed: 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: indent-2.2.13-5.el9.x86_64 kernel-devel-5.14.0-427.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-7.el9.x86_64 2024-03-18T15:03:19.365 INFO:teuthology.orchestra.run.smithi152.stdout: udftools-2.2-5.el9.x86_64 2024-03-18T15:03:19.366 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:03:19.366 INFO:teuthology.orchestra.run.smithi152.stdout:Complete! 2024-03-18T15:03:20.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd -m fsgqa 2024-03-18T15:03:20.206 INFO:teuthology.orchestra.run.smithi152.stderr:useradd: user 'fsgqa' already exists 2024-03-18T15:03:20.207 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-18T15:03:20.207 DEBUG:teuthology.orchestra.run.smithi152:> sudo groupadd fsgqa 2024-03-18T15:03:20.274 INFO:teuthology.orchestra.run.smithi152.stderr:groupadd: group 'fsgqa' already exists 2024-03-18T15:03:20.275 DEBUG:teuthology.orchestra.run:got remote process result: 9 2024-03-18T15:03:20.275 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd fsgqa2 2024-03-18T15:03:20.918 DEBUG:teuthology.orchestra.run.smithi152:> sudo useradd 123456-fsgqa 2024-03-18T15:03:21.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2024-03-18T15:03:21.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.517+0000 7f18cc1a7640 1 Processor -- start 2024-03-18T15:03:21.518 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.518+0000 7f18cc1a7640 1 -- start start 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18cc1a7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f18c4154a90 0x7f18c406cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18cc1a7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f18c406d1b0 0x7f18c415e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18cc1a7640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f18c406e6f0 con 0x7f18c415e6b0 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18cc1a7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f18c415eb20 con 0x7f18c4154a90 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18cc1a7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f18c406d650 con 0x7f18c406d1b0 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18c9f43640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f18c4154a90 0x7f18c406cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18ca744640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f18c415e6b0 0x7f18c415ab80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55822/0 (socket says 172.21.15.152:55822) 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18ca744640 1 -- 172.21.15.152:0/2249831723 learned_addr learned my addr 172.21.15.152:0/2249831723 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:03:21.520 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.519+0000 7f18c8f41640 1 -- 172.21.15.152:0/2249831723 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 951926668 0 0) 0x7f18c406e6f0 con 0x7f18c415e6b0 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c8f41640 1 -- 172.21.15.152:0/2249831723 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f18ac004630 con 0x7f18c415e6b0 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9742640 1 --2- 172.21.15.152:0/2249831723 >> v2:172.21.15.186:3300/0 conn(0x7f18c406d1b0 0x7f18c415e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9f43640 1 -- 172.21.15.152:0/2249831723 >> v2:172.21.15.186:3300/0 conn(0x7f18c406d1b0 msgr2=0x7f18c415e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9f43640 1 --2- 172.21.15.152:0/2249831723 >> v2:172.21.15.186:3300/0 conn(0x7f18c406d1b0 0x7f18c415e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9f43640 1 -- 172.21.15.152:0/2249831723 >> v1:172.21.15.152:6789/0 conn(0x7f18c415e6b0 legacy=0x7f18c415ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.521 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9f43640 1 -- 172.21.15.152:0/2249831723 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c406d930 con 0x7f18c4154a90 2024-03-18T15:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c9f43640 1 --2- 172.21.15.152:0/2249831723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c406cc70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18c40b5420 tx=0x7f18b402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec52d9d0b56c6c50 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c8f41640 1 -- 172.21.15.152:0/2249831723 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4039070 con 0x7f18c4154a90 2024-03-18T15:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c8f41640 1 -- 172.21.15.152:0/2249831723 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b402cbe0 con 0x7f18c4154a90 2024-03-18T15:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.520+0000 7f18c8f41640 1 -- 172.21.15.152:0/2249831723 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b4034440 con 0x7f18c4154a90 2024-03-18T15:03:21.522 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2249831723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 msgr2=0x7f18c406cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2249831723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c406cc70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f18c40b5420 tx=0x7f18b402be30 comp rx=0 tx=0).stop 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2249831723 shutdown_connections 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2249831723 >> v2:172.21.15.186:3300/0 conn(0x7f18c406d1b0 0x7f18c415e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2249831723 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c406cc70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2249831723 >> 172.21.15.152:0/2249831723 conn(0x7f18c406b5e0 msgr2=0x7f18c406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2249831723 shutdown_connections 2024-03-18T15:03:21.523 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.521+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2249831723 wait complete. 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 Processor -- start 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 -- start start 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18c406d1b0 0x7f18c4149cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18c415e6b0 0x7f18c40b3380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f18c406e1d0 con 0x7f18c4154a90 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f18c406def0 con 0x7f18c406d1b0 2024-03-18T15:03:21.525 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.523+0000 7f18cc1a7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f18c4072020 con 0x7f18c415e6b0 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34050/0 (socket says 172.21.15.152:34050) 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 -- 172.21.15.152:0/2928195409 learned_addr learned my addr 172.21.15.152:0/2928195409 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 -- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18c415e6b0 msgr2=0x7f18c40b3380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18c415e6b0 0x7f18c40b3380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 -- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18c406d1b0 msgr2=0x7f18c4149cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18c406d1b0 0x7f18c4149cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 -- 172.21.15.152:0/2928195409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18c414a200 con 0x7f18c4154a90 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c9742640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c7f0 tx=0x7f18b800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8015070 con 0x7f18c4154a90 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18b8004220 con 0x7f18c4154a90 2024-03-18T15:03:21.526 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18c41535e0 con 0x7f18c4154a90 2024-03-18T15:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18b8007620 con 0x7f18c4154a90 2024-03-18T15:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.524+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18c4153880 con 0x7f18c4154a90 2024-03-18T15:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.525+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18c404f5b0 con 0x7f18c4154a90 2024-03-18T15:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.526+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f18b80079d0 con 0x7f18c4154a90 2024-03-18T15:03:21.527 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.526+0000 7f18c27fc640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 0x7f18b006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.526+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f18b808ad00 con 0x7f18c4154a90 2024-03-18T15:03:21.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.526+0000 7f18c9f43640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 0x7f18b006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.528 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.526+0000 7f18c9f43640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 0x7f18b006e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18b4036000 tx=0x7f18b402e000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.530 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.530+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f18c414a200 con 0x7f18c4154a90 2024-03-18T15:03:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.811+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f18c40b1870 con 0x7f18c4154a90 2024-03-18T15:03:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.811+0000 7f18c27fc640 1 -- 172.21.15.152:0/2928195409 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+1289 (secure 0 0 0) 0x7f18b8059880 con 0x7f18c4154a90 2024-03-18T15:03:21.812 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:03:21.812 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":1,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","modified":"2024-03-18T14:59:44.136648Z","created":"2024-03-18T14:59:44.136648Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:3300","nonce":0},{"type":"v1","addr":"172.21.15.152:6789","nonce":0}]},"addr":"172.21.15.152:6789/0","public_addr":"172.21.15.152:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3300","nonce":0},{"type":"v1","addr":"172.21.15.186:6789","nonce":0}]},"addr":"172.21.15.186:6789/0","public_addr":"172.21.15.186:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:3301","nonce":0},{"type":"v1","addr":"172.21.15.186:6790","nonce":0}]},"addr":"172.21.15.186:6790/0","public_addr":"172.21.15.186:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-03-18T15:03:21.812 INFO:teuthology.orchestra.run.smithi152.stderr:dumped monmap epoch 1 2024-03-18T15:03:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.813+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 msgr2=0x7f18b006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.813+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 0x7f18b006e090 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f18b4036000 tx=0x7f18b402e000 comp rx=0 tx=0).stop 2024-03-18T15:03:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.813+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 msgr2=0x7f18c41530a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.813+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f18b800c7f0 tx=0x7f18b800ccb0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 shutdown_connections 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f18b006bbd0 0x7f18b006e090 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f18c415e6b0 0x7f18c40b3380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f18c4154a90 0x7f18c41530a0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 --2- 172.21.15.152:0/2928195409 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f18c406d1b0 0x7f18c4149cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 >> 172.21.15.152:0/2928195409 conn(0x7f18c406b5e0 msgr2=0x7f18c40cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 shutdown_connections 2024-03-18T15:03:21.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.814+0000 7f18cc1a7640 1 -- 172.21.15.152:0/2928195409 wait complete. 2024-03-18T15:03:21.829 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2024-03-18T15:03:21.968 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.968+0000 7f1dc4513640 1 Processor -- start 2024-03-18T15:03:21.969 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.968+0000 7f1dc4513640 1 -- start start 2024-03-18T15:03:21.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc4513640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1dbc1622b0 0x7f1dbc0d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc4513640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f1dbc162690 0x7f1dbc162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc4513640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1dbc0b3440 con 0x7f1dbc0cec80 2024-03-18T15:03:21.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc4513640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1dbc0d16c0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.970 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc4513640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f1dbc0d2660 con 0x7f1dbc162690 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc22af640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1dbc1622b0 0x7f1dbc0d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc2ab0640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1dbc0cec80 0x7f1dbc0cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:55836/0 (socket says 172.21.15.152:55836) 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.969+0000 7f1dc2ab0640 1 -- 172.21.15.152:0/1907975311 learned_addr learned my addr 172.21.15.152:0/1907975311 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc1aae640 1 --2- 172.21.15.152:0/1907975311 >> v2:172.21.15.186:3300/0 conn(0x7f1dbc162690 0x7f1dbc162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc22af640 1 -- 172.21.15.152:0/1907975311 >> v2:172.21.15.186:3300/0 conn(0x7f1dbc162690 msgr2=0x7f1dbc162b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc22af640 1 --2- 172.21.15.152:0/1907975311 >> v2:172.21.15.186:3300/0 conn(0x7f1dbc162690 0x7f1dbc162b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc22af640 1 -- 172.21.15.152:0/1907975311 >> v1:172.21.15.152:6789/0 conn(0x7f1dbc0cec80 legacy=0x7f1dbc0cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc12ad640 1 -- 172.21.15.152:0/1907975311 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1274149134 0 0) 0x7f1dbc0b3440 con 0x7f1dbc0cec80 2024-03-18T15:03:21.971 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc22af640 1 -- 172.21.15.152:0/1907975311 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc0d20a0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.970+0000 7f1dc22af640 1 --2- 172.21.15.152:0/1907975311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0d10d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35e5bf772563f7fb server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc12ad640 1 -- 172.21.15.152:0/1907975311 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8038070 con 0x7f1dbc1622b0 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc12ad640 1 -- 172.21.15.152:0/1907975311 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1db8031700 con 0x7f1dbc1622b0 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc12ad640 1 -- 172.21.15.152:0/1907975311 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1db8031ad0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 -- 172.21.15.152:0/1907975311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 msgr2=0x7f1dbc0d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 --2- 172.21.15.152:0/1907975311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0d10d0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f1db80097a0 tx=0x7f1db802b7a0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 -- 172.21.15.152:0/1907975311 shutdown_connections 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 --2- 172.21.15.152:0/1907975311 >> v2:172.21.15.186:3300/0 conn(0x7f1dbc162690 0x7f1dbc162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 --2- 172.21.15.152:0/1907975311 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0d10d0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 -- 172.21.15.152:0/1907975311 >> 172.21.15.152:0/1907975311 conn(0x7f1dbc0d4070 msgr2=0x7f1dbc0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 -- 172.21.15.152:0/1907975311 shutdown_connections 2024-03-18T15:03:21.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.971+0000 7f1dc4513640 1 -- 172.21.15.152:0/1907975311 wait complete. 2024-03-18T15:03:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.972+0000 7f1dc4513640 1 Processor -- start 2024-03-18T15:03:21.974 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.972+0000 7f1dc4513640 1 -- start start 2024-03-18T15:03:21.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 0x7f1dbc0cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 0x7f1dbc0b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc15faa0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc0d2ab0 con 0x7f1dbc162690 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc4513640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc15fc20 con 0x7f1dbc0cec80 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc1aae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc1aae640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:34074/0 (socket says 172.21.15.152:34074) 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc1aae640 1 -- 172.21.15.152:0/2259733702 learned_addr learned my addr 172.21.15.152:0/2259733702 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc22af640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 0x7f1dbc0cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.973+0000 7f1dc2ab0640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 0x7f1dbc0b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 -- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 msgr2=0x7f1dbc0cb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 0x7f1dbc0cb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 -- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 msgr2=0x7f1dbc0b6300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 0x7f1dbc0b6300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:21.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 -- 172.21.15.152:0/2259733702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc0cbe60 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc22af640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 0x7f1dbc0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc2ab0640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 0x7f1dbc0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc1aae640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00d800 tx=0x7f1dac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00b6c0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1dac019070 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1dac00ba80 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc0cc140 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.974+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc0cc700 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.975+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc15abb0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.976+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1dac00bc20 con 0x7f1dbc1622b0 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.976+0000 7f1db2ffd640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 0x7f1da006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T15:03:21.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.976+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f1dac08aeb0 con 0x7f1dbc1622b0 2024-03-18T15:03:21.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.976+0000 7f1dc22af640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 0x7f1da006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T15:03:21.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.977+0000 7f1dc22af640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 0x7f1da006e090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1db8035000 tx=0x7f1db8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T15:03:21.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:21.981+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1dbc15abb0 con 0x7f1dbc1622b0 2024-03-18T15:03:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.218+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) -- 0x7f1dbc04f5b0 con 0x7f1dbc1622b0 2024-03-18T15:03:22.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.218+0000 7f1db2ffd640 1 -- 172.21.15.152:0/2259733702 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v11) ==== 92+0+63 (secure 0 0 0) 0x7f1dac059a30 con 0x7f1dbc1622b0 2024-03-18T15:03:22.219 INFO:teuthology.orchestra.run.smithi152.stdout:[client.admin] 2024-03-18T15:03:22.219 INFO:teuthology.orchestra.run.smithi152.stdout: key = AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== 2024-03-18T15:03:22.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 msgr2=0x7f1da006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:22.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 0x7f1da006e090 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f1db8035000 tx=0x7f1db8008030 comp rx=0 tx=0).stop 2024-03-18T15:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 msgr2=0x7f1dbc0b5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T15:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f1dac00d800 tx=0x7f1dac00dcc0 comp rx=0 tx=0).stop 2024-03-18T15:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 shutdown_connections 2024-03-18T15:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1dbc162690 0x7f1dbc0b6300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:22.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1dbc1622b0 0x7f1dbc0b5dc0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1da006bbd0 0x7f1da006e090 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 --2- 172.21.15.152:0/2259733702 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1dbc0cec80 0x7f1dbc0cb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T15:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 >> 172.21.15.152:0/2259733702 conn(0x7f1dbc0d4070 msgr2=0x7f1dbc06ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T15:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 shutdown_connections 2024-03-18T15:03:22.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T15:03:22.221+0000 7f1dc4513640 1 -- 172.21.15.152:0/2259733702 wait complete. 2024-03-18T15:03:22.237 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:03:22.237 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/tmp/tmp.YntrTC91Q1xfstests-dev/local.config 2024-03-18T15:03:22.264 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.152:6789:/test export TEST_DIR=/tmp/tmp.n8huAW33L0test export SCRATCH_DEV=172.21.15.152:6789:/scratch export SCRATCH_MNT=/tmp/tmp.KIGoX27qplscratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA==" 2024-03-18T15:03:22.264 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T15:03:22.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo dd of=/tmp/tmp.YntrTC91Q1xfstests-dev/ceph.exclude 2024-03-18T15:03:22.330 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo make) 2024-03-18T15:03:22.401 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize -cfi 2024-03-18T15:03:22.811 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: putting auxiliary files in '.'. 2024-03-18T15:03:22.811 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './config.guess' 2024-03-18T15:03:22.814 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './config.sub' 2024-03-18T15:03:22.818 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './install-sh' 2024-03-18T15:03:22.822 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file './ltmain.sh' 2024-03-18T15:03:22.845 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2024-03-18T15:03:22.845 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/libtool.m4' 2024-03-18T15:03:22.849 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2024-03-18T15:03:22.854 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2024-03-18T15:03:22.858 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/ltversion.m4' 2024-03-18T15:03:22.863 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2024-03-18T15:03:22.870 INFO:teuthology.orchestra.run.smithi152.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2024-03-18T15:03:22.871 INFO:teuthology.orchestra.run.smithi152.stdout:cp include/install-sh . 2024-03-18T15:03:22.872 INFO:teuthology.orchestra.run.smithi152.stdout:aclocal -I m4 2024-03-18T15:03:23.943 INFO:teuthology.orchestra.run.smithi152.stdout:autoheader 2024-03-18T15:03:24.269 INFO:teuthology.orchestra.run.smithi152.stdout:autoconf 2024-03-18T15:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout:./configure \ 2024-03-18T15:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: --libexecdir=/usr/lib \ 2024-03-18T15:03:24.460 INFO:teuthology.orchestra.run.smithi152.stdout: --exec_prefix=/var/lib 2024-03-18T15:03:24.672 INFO:teuthology.orchestra.run.smithi152.stdout:checking build system type... x86_64-pc-linux-gnu 2024-03-18T15:03:24.672 INFO:teuthology.orchestra.run.smithi152.stdout:checking host system type... x86_64-pc-linux-gnu 2024-03-18T15:03:24.673 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to print strings... printf 2024-03-18T15:03:24.674 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc... gcc 2024-03-18T15:03:24.725 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the C compiler works... yes 2024-03-18T15:03:24.725 INFO:teuthology.orchestra.run.smithi152.stdout:checking for C compiler default output file name... a.out 2024-03-18T15:03:24.757 INFO:teuthology.orchestra.run.smithi152.stdout:checking for suffix of executables... 2024-03-18T15:03:24.805 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether we are cross compiling... no 2024-03-18T15:03:24.821 INFO:teuthology.orchestra.run.smithi152.stdout:checking for suffix of object files... o 2024-03-18T15:03:24.837 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether we are using the GNU C compiler... yes 2024-03-18T15:03:24.854 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc accepts -g... yes 2024-03-18T15:03:24.879 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to accept ISO C89... none needed 2024-03-18T15:03:24.881 INFO:teuthology.orchestra.run.smithi152.stdout:checking for a sed that does not truncate output... /bin/sed 2024-03-18T15:03:24.883 INFO:teuthology.orchestra.run.smithi152.stdout:checking for grep that handles long lines and -e... /bin/grep 2024-03-18T15:03:24.884 INFO:teuthology.orchestra.run.smithi152.stdout:checking for egrep... /bin/grep -E 2024-03-18T15:03:24.885 INFO:teuthology.orchestra.run.smithi152.stdout:checking for fgrep... /bin/grep -F 2024-03-18T15:03:24.888 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ld used by gcc... /bin/ld 2024-03-18T15:03:24.890 INFO:teuthology.orchestra.run.smithi152.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2024-03-18T15:03:24.896 INFO:teuthology.orchestra.run.smithi152.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2024-03-18T15:03:25.855 INFO:teuthology.orchestra.run.smithi152.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2024-03-18T15:03:25.855 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether ln -s works... yes 2024-03-18T15:03:25.863 INFO:teuthology.orchestra.run.smithi152.stdout:checking the maximum length of command line arguments... 1572864 2024-03-18T15:03:25.866 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2024-03-18T15:03:25.866 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2024-03-18T15:03:25.866 INFO:teuthology.orchestra.run.smithi152.stdout:checking for /bin/ld option to reload object files... -r 2024-03-18T15:03:25.866 INFO:teuthology.orchestra.run.smithi152.stdout:checking for objdump... objdump 2024-03-18T15:03:25.867 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to recognize dependent libraries... pass_all 2024-03-18T15:03:25.867 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dlltool... no 2024-03-18T15:03:25.867 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to associate runtime and link libraries... printf %s\n 2024-03-18T15:03:25.867 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ar... ar 2024-03-18T15:03:25.907 INFO:teuthology.orchestra.run.smithi152.stdout:checking for archiver @FILE support... @ 2024-03-18T15:03:25.908 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strip... strip 2024-03-18T15:03:25.908 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ranlib... ranlib 2024-03-18T15:03:25.909 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gawk... gawk 2024-03-18T15:03:25.975 INFO:teuthology.orchestra.run.smithi152.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2024-03-18T15:03:25.976 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sysroot... no 2024-03-18T15:03:25.978 INFO:teuthology.orchestra.run.smithi152.stdout:checking for a working dd... /bin/dd 2024-03-18T15:03:25.981 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2024-03-18T15:03:25.993 INFO:teuthology.orchestra.run.smithi152.stdout:checking for mt... no 2024-03-18T15:03:25.995 INFO:teuthology.orchestra.run.smithi152.stdout:checking if : is a manifest tool... no 2024-03-18T15:03:26.041 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to run the C preprocessor... gcc -E 2024-03-18T15:03:26.208 INFO:teuthology.orchestra.run.smithi152.stdout:checking for ANSI C header files... yes 2024-03-18T15:03:26.228 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/types.h... yes 2024-03-18T15:03:26.256 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/stat.h... yes 2024-03-18T15:03:26.282 INFO:teuthology.orchestra.run.smithi152.stdout:checking for stdlib.h... yes 2024-03-18T15:03:26.304 INFO:teuthology.orchestra.run.smithi152.stdout:checking for string.h... yes 2024-03-18T15:03:26.332 INFO:teuthology.orchestra.run.smithi152.stdout:checking for memory.h... yes 2024-03-18T15:03:26.356 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strings.h... yes 2024-03-18T15:03:26.399 INFO:teuthology.orchestra.run.smithi152.stdout:checking for inttypes.h... yes 2024-03-18T15:03:26.423 INFO:teuthology.orchestra.run.smithi152.stdout:checking for stdint.h... yes 2024-03-18T15:03:26.463 INFO:teuthology.orchestra.run.smithi152.stdout:checking for unistd.h... yes 2024-03-18T15:03:26.498 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dlfcn.h... yes 2024-03-18T15:03:26.501 INFO:teuthology.orchestra.run.smithi152.stdout:checking for objdir... .libs 2024-03-18T15:03:26.562 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2024-03-18T15:03:26.562 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2024-03-18T15:03:26.576 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2024-03-18T15:03:26.594 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc static flag -static works... no 2024-03-18T15:03:26.615 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -c -o file.o... yes 2024-03-18T15:03:26.615 INFO:teuthology.orchestra.run.smithi152.stdout:checking if gcc supports -c -o file.o... (cached) yes 2024-03-18T15:03:26.621 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2024-03-18T15:03:26.646 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether -lc should be explicitly linked in... no 2024-03-18T15:03:26.708 INFO:teuthology.orchestra.run.smithi152.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2024-03-18T15:03:26.708 INFO:teuthology.orchestra.run.smithi152.stdout:checking how to hardcode library paths into programs... immediate 2024-03-18T15:03:26.709 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether stripping libraries is possible... yes 2024-03-18T15:03:26.709 INFO:teuthology.orchestra.run.smithi152.stdout:checking if libtool supports shared libraries... yes 2024-03-18T15:03:26.709 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether to build shared libraries... yes 2024-03-18T15:03:26.709 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether to build static libraries... yes 2024-03-18T15:03:26.715 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc... (cached) gcc 2024-03-18T15:03:26.731 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether we are using the GNU C compiler... (cached) yes 2024-03-18T15:03:26.731 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc accepts -g... (cached) yes 2024-03-18T15:03:26.731 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2024-03-18T15:03:26.731 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gmake... /usr/bin/gmake 2024-03-18T15:03:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:./configure: line 12082: test: $(SHELL): binary operator expected 2024-03-18T15:03:26.732 INFO:teuthology.orchestra.run.smithi152.stdout:checking for tar... /bin/tar 2024-03-18T15:03:26.733 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gzip... /bin/gzip 2024-03-18T15:03:26.743 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether gcc -MM is supported... yes 2024-03-18T15:03:26.743 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sort... /bin/sort 2024-03-18T15:03:26.743 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether ln -s works... yes 2024-03-18T15:03:26.743 INFO:teuthology.orchestra.run.smithi152.stdout:checking for rpm... /bin/rpm 2024-03-18T15:03:26.746 INFO:teuthology.orchestra.run.smithi152.stdout:checking for rpmbuild... no 2024-03-18T15:03:26.771 INFO:teuthology.orchestra.run.smithi152.stdout:checking assert.h usability... yes 2024-03-18T15:03:26.780 INFO:teuthology.orchestra.run.smithi152.stdout:checking assert.h presence... yes 2024-03-18T15:03:26.780 INFO:teuthology.orchestra.run.smithi152.stdout:checking for assert.h... yes 2024-03-18T15:03:26.806 INFO:teuthology.orchestra.run.smithi152.stdout:checking bstring.h usability... no 2024-03-18T15:03:26.816 INFO:teuthology.orchestra.run.smithi152.stdout:checking bstring.h presence... no 2024-03-18T15:03:26.816 INFO:teuthology.orchestra.run.smithi152.stdout:checking for bstring.h... no 2024-03-18T15:03:26.841 INFO:teuthology.orchestra.run.smithi152.stdout:checking libgen.h usability... yes 2024-03-18T15:03:26.849 INFO:teuthology.orchestra.run.smithi152.stdout:checking libgen.h presence... yes 2024-03-18T15:03:26.849 INFO:teuthology.orchestra.run.smithi152.stdout:checking for libgen.h... yes 2024-03-18T15:03:26.887 INFO:teuthology.orchestra.run.smithi152.stdout:checking dirent.h usability... yes 2024-03-18T15:03:26.896 INFO:teuthology.orchestra.run.smithi152.stdout:checking dirent.h presence... yes 2024-03-18T15:03:26.896 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dirent.h... yes 2024-03-18T15:03:26.955 INFO:teuthology.orchestra.run.smithi152.stdout:checking errno.h usability... yes 2024-03-18T15:03:26.963 INFO:teuthology.orchestra.run.smithi152.stdout:checking errno.h presence... yes 2024-03-18T15:03:26.964 INFO:teuthology.orchestra.run.smithi152.stdout:checking for errno.h... yes 2024-03-18T15:03:27.000 INFO:teuthology.orchestra.run.smithi152.stdout:checking malloc.h usability... yes 2024-03-18T15:03:27.010 INFO:teuthology.orchestra.run.smithi152.stdout:checking malloc.h presence... yes 2024-03-18T15:03:27.010 INFO:teuthology.orchestra.run.smithi152.stdout:checking for malloc.h... yes 2024-03-18T15:03:27.035 INFO:teuthology.orchestra.run.smithi152.stdout:checking uuid.h usability... no 2024-03-18T15:03:27.046 INFO:teuthology.orchestra.run.smithi152.stdout:checking uuid.h presence... no 2024-03-18T15:03:27.046 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid.h... no 2024-03-18T15:03:27.077 INFO:teuthology.orchestra.run.smithi152.stdout:checking uuid/uuid.h usability... yes 2024-03-18T15:03:27.087 INFO:teuthology.orchestra.run.smithi152.stdout:checking uuid/uuid.h presence... yes 2024-03-18T15:03:27.087 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid/uuid.h... yes 2024-03-18T15:03:27.113 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/uuid.h usability... no 2024-03-18T15:03:27.123 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/uuid.h presence... no 2024-03-18T15:03:27.123 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/uuid.h... no 2024-03-18T15:03:27.156 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/file.h usability... yes 2024-03-18T15:03:27.165 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/file.h presence... yes 2024-03-18T15:03:27.165 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/file.h... yes 2024-03-18T15:03:27.201 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fcntl.h usability... yes 2024-03-18T15:03:27.209 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fcntl.h presence... yes 2024-03-18T15:03:27.210 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fcntl.h... yes 2024-03-18T15:03:27.236 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/syssgi.h usability... no 2024-03-18T15:03:27.246 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/syssgi.h presence... no 2024-03-18T15:03:27.246 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/syssgi.h... no 2024-03-18T15:03:27.289 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/param.h usability... yes 2024-03-18T15:03:27.300 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/param.h presence... yes 2024-03-18T15:03:27.300 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/param.h... yes 2024-03-18T15:03:27.305 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/stat.h... (cached) yes 2024-03-18T15:03:27.332 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/statvfs.h usability... yes 2024-03-18T15:03:27.340 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/statvfs.h presence... yes 2024-03-18T15:03:27.340 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/statvfs.h... yes 2024-03-18T15:03:27.367 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/time.h usability... yes 2024-03-18T15:03:27.377 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/time.h presence... yes 2024-03-18T15:03:27.377 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/time.h... yes 2024-03-18T15:03:27.408 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/ioctl.h usability... yes 2024-03-18T15:03:27.416 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/ioctl.h presence... yes 2024-03-18T15:03:27.417 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/ioctl.h... yes 2024-03-18T15:03:27.449 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/wait.h usability... yes 2024-03-18T15:03:27.459 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/wait.h presence... yes 2024-03-18T15:03:27.459 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/wait.h... yes 2024-03-18T15:03:27.464 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/types.h... (cached) yes 2024-03-18T15:03:27.468 INFO:teuthology.orchestra.run.smithi152.stdout:checking for strings.h... (cached) yes 2024-03-18T15:03:27.495 INFO:teuthology.orchestra.run.smithi152.stdout:checking err.h usability... yes 2024-03-18T15:03:27.503 INFO:teuthology.orchestra.run.smithi152.stdout:checking err.h presence... yes 2024-03-18T15:03:27.503 INFO:teuthology.orchestra.run.smithi152.stdout:checking for err.h... yes 2024-03-18T15:03:27.530 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/falloc.h usability... yes 2024-03-18T15:03:27.538 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/falloc.h presence... yes 2024-03-18T15:03:27.538 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/falloc.h... yes 2024-03-18T15:03:27.563 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fs/xfs_fsops.h usability... no 2024-03-18T15:03:27.574 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fs/xfs_fsops.h presence... no 2024-03-18T15:03:27.574 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fs/xfs_fsops.h... no 2024-03-18T15:03:27.597 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fs/xfs_itable.h usability... no 2024-03-18T15:03:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/fs/xfs_itable.h presence... no 2024-03-18T15:03:27.608 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/fs/xfs_itable.h... no 2024-03-18T15:03:27.631 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfs/platform_defs.h usability... no 2024-03-18T15:03:27.641 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfs/platform_defs.h presence... no 2024-03-18T15:03:27.642 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/platform_defs.h... no 2024-03-18T15:03:27.665 INFO:teuthology.orchestra.run.smithi152.stdout:checking btrfs/ioctl.h usability... no 2024-03-18T15:03:27.675 INFO:teuthology.orchestra.run.smithi152.stdout:checking btrfs/ioctl.h presence... no 2024-03-18T15:03:27.675 INFO:teuthology.orchestra.run.smithi152.stdout:checking for btrfs/ioctl.h... no 2024-03-18T15:03:27.699 INFO:teuthology.orchestra.run.smithi152.stdout:checking cifs/ioctl.h usability... no 2024-03-18T15:03:27.709 INFO:teuthology.orchestra.run.smithi152.stdout:checking cifs/ioctl.h presence... no 2024-03-18T15:03:27.710 INFO:teuthology.orchestra.run.smithi152.stdout:checking for cifs/ioctl.h... no 2024-03-18T15:03:27.735 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/mman.h usability... yes 2024-03-18T15:03:27.744 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/mman.h presence... yes 2024-03-18T15:03:27.744 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/mman.h... yes 2024-03-18T15:03:27.759 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xfs_log_format.h... no 2024-03-18T15:03:27.794 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid_compare... no 2024-03-18T15:03:27.824 INFO:teuthology.orchestra.run.smithi152.stdout:checking for uuid_compare in -luuid... yes 2024-03-18T15:03:27.896 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xfs.h... yes 2024-03-18T15:03:27.909 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/libxfs.h... no 2024-03-18T15:03:27.924 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether xlog_assign_lsn is declared... no 2024-03-18T15:03:27.953 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/xqm.h... yes 2024-03-18T15:03:28.002 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfsctl from xfs/xfs.h... ok 2024-03-18T15:03:28.024 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfs/handle.h usability... yes 2024-03-18T15:03:28.032 INFO:teuthology.orchestra.run.smithi152.stdout:checking xfs/handle.h presence... yes 2024-03-18T15:03:28.032 INFO:teuthology.orchestra.run.smithi152.stdout:checking for xfs/handle.h... yes 2024-03-18T15:03:28.064 INFO:teuthology.orchestra.run.smithi152.stdout:checking for attr_list_by_handle in -lhandle... yes 2024-03-18T15:03:28.087 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/acl.h usability... yes 2024-03-18T15:03:28.097 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/acl.h presence... yes 2024-03-18T15:03:28.097 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/acl.h... yes 2024-03-18T15:03:28.119 INFO:teuthology.orchestra.run.smithi152.stdout:checking acl/libacl.h usability... yes 2024-03-18T15:03:28.129 INFO:teuthology.orchestra.run.smithi152.stdout:checking acl/libacl.h presence... yes 2024-03-18T15:03:28.129 INFO:teuthology.orchestra.run.smithi152.stdout:checking for acl/libacl.h... yes 2024-03-18T15:03:28.160 INFO:teuthology.orchestra.run.smithi152.stdout:checking for acl_init in -lacl... yes 2024-03-18T15:03:28.183 INFO:teuthology.orchestra.run.smithi152.stdout:checking gdbm-ndbm.h usability... no 2024-03-18T15:03:28.193 INFO:teuthology.orchestra.run.smithi152.stdout:checking gdbm-ndbm.h presence... no 2024-03-18T15:03:28.194 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gdbm-ndbm.h... no 2024-03-18T15:03:28.216 INFO:teuthology.orchestra.run.smithi152.stdout:checking gdbm/ndbm.h usability... yes 2024-03-18T15:03:28.226 INFO:teuthology.orchestra.run.smithi152.stdout:checking gdbm/ndbm.h presence... yes 2024-03-18T15:03:28.226 INFO:teuthology.orchestra.run.smithi152.stdout:checking for gdbm/ndbm.h... yes 2024-03-18T15:03:28.260 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_open in -lgdbm... no 2024-03-18T15:03:28.295 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_fetch in -lgdbm... no 2024-03-18T15:03:28.328 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_store in -lgdbm... no 2024-03-18T15:03:28.362 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_close in -lgdbm... no 2024-03-18T15:03:28.399 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_open in -lgdbm_compat... yes 2024-03-18T15:03:28.430 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2024-03-18T15:03:28.463 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_store in -lgdbm_compat... yes 2024-03-18T15:03:28.495 INFO:teuthology.orchestra.run.smithi152.stdout:checking for dbm_close in -lgdbm_compat... yes 2024-03-18T15:03:28.519 INFO:teuthology.orchestra.run.smithi152.stdout:checking libaio.h usability... yes 2024-03-18T15:03:28.530 INFO:teuthology.orchestra.run.smithi152.stdout:checking libaio.h presence... yes 2024-03-18T15:03:28.530 INFO:teuthology.orchestra.run.smithi152.stdout:checking for libaio.h... yes 2024-03-18T15:03:28.553 INFO:teuthology.orchestra.run.smithi152.stdout:checking liburing.h usability... no 2024-03-18T15:03:28.563 INFO:teuthology.orchestra.run.smithi152.stdout:checking liburing.h presence... no 2024-03-18T15:03:28.563 INFO:teuthology.orchestra.run.smithi152.stdout:checking for liburing.h... no 2024-03-18T15:03:28.589 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/capability.h usability... yes 2024-03-18T15:03:28.600 INFO:teuthology.orchestra.run.smithi152.stdout:checking sys/capability.h presence... yes 2024-03-18T15:03:28.600 INFO:teuthology.orchestra.run.smithi152.stdout:checking for sys/capability.h... yes 2024-03-18T15:03:28.624 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/fiemap.h usability... yes 2024-03-18T15:03:28.632 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/fiemap.h presence... yes 2024-03-18T15:03:28.632 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/fiemap.h... yes 2024-03-18T15:03:28.665 INFO:teuthology.orchestra.run.smithi152.stdout:checking for fallocate... yes 2024-03-18T15:03:28.699 INFO:teuthology.orchestra.run.smithi152.stdout:checking for open_by_handle_at... yes 2024-03-18T15:03:28.724 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/fs.h usability... yes 2024-03-18T15:03:28.732 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/fs.h presence... yes 2024-03-18T15:03:28.732 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/fs.h... yes 2024-03-18T15:03:28.763 INFO:teuthology.orchestra.run.smithi152.stdout:checking btrfsutil.h usability... no 2024-03-18T15:03:28.774 INFO:teuthology.orchestra.run.smithi152.stdout:checking btrfsutil.h presence... no 2024-03-18T15:03:28.774 INFO:teuthology.orchestra.run.smithi152.stdout:checking for btrfsutil.h... no 2024-03-18T15:03:28.810 INFO:teuthology.orchestra.run.smithi152.stdout:checking for copy_file_range... yes 2024-03-18T15:03:28.845 INFO:teuthology.orchestra.run.smithi152.stdout:checking for SEEK_DATA... yes 2024-03-18T15:03:28.894 INFO:teuthology.orchestra.run.smithi152.stdout:checking for BMV_OF_SHARED... yes 2024-03-18T15:03:28.930 INFO:teuthology.orchestra.run.smithi152.stdout:checking for nftw... yes 2024-03-18T15:03:28.969 INFO:teuthology.orchestra.run.smithi152.stdout:checking for RLIMIT_NOFILE... yes 2024-03-18T15:03:29.001 INFO:teuthology.orchestra.run.smithi152.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2024-03-18T15:03:29.034 INFO:teuthology.orchestra.run.smithi152.stdout:checking for FICLONE... yes 2024-03-18T15:03:29.067 INFO:teuthology.orchestra.run.smithi152.stdout:checking for renameat2... yes 2024-03-18T15:03:29.100 INFO:teuthology.orchestra.run.smithi152.stdout:checking for reallocarray... yes 2024-03-18T15:03:29.129 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct mount_attr... yes 2024-03-18T15:03:29.162 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_qgroup_limit... yes 2024-03-18T15:03:29.193 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_qgroup_inherit... yes 2024-03-18T15:03:29.228 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args... yes 2024-03-18T15:03:29.259 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2024-03-18T15:03:29.290 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2024-03-18T15:03:29.322 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2024-03-18T15:03:29.354 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2024-03-18T15:03:29.381 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/btrfs.h usability... yes 2024-03-18T15:03:29.389 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/btrfs.h presence... yes 2024-03-18T15:03:29.389 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/btrfs.h... yes 2024-03-18T15:03:29.419 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/btrfs_tree.h usability... yes 2024-03-18T15:03:29.428 INFO:teuthology.orchestra.run.smithi152.stdout:checking linux/btrfs_tree.h presence... yes 2024-03-18T15:03:29.428 INFO:teuthology.orchestra.run.smithi152.stdout:checking for linux/btrfs_tree.h... yes 2024-03-18T15:03:29.449 INFO:teuthology.orchestra.run.smithi152.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2024-03-18T15:03:29.471 INFO:teuthology.orchestra.run.smithi152.stdout:checking whether BTRFS_IOC_SNAP_DESTROY_V2 is declared... yes 2024-03-18T15:03:29.487 INFO:teuthology.orchestra.run.smithi152.stdout:configure: creating ./config.status 2024-03-18T15:03:29.786 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: creating include/builddefs 2024-03-18T15:03:29.796 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: creating include/config.h 2024-03-18T15:03:29.804 INFO:teuthology.orchestra.run.smithi152.stdout:config.status: executing libtool commands 2024-03-18T15:03:29.841 INFO:teuthology.orchestra.run.smithi152.stdout:Building include 2024-03-18T15:03:29.845 INFO:teuthology.orchestra.run.smithi152.stdout:Building lib 2024-03-18T15:03:29.847 INFO:teuthology.orchestra.run.smithi152.stdout: [LTDEP] 2024-03-18T15:03:29.982 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dataascii.lo 2024-03-18T15:03:30.087 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] databin.lo 2024-03-18T15:03:30.220 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] datapid.lo 2024-03-18T15:03:30.324 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] file_lock.lo 2024-03-18T15:03:30.474 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] forker.lo 2024-03-18T15:03:30.603 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] pattern.lo 2024-03-18T15:03:30.722 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] open_flags.lo 2024-03-18T15:03:30.858 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] random_range.lo 2024-03-18T15:03:31.075 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] string_to_tokens.lo 2024-03-18T15:03:31.176 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] str_to_bytes.lo 2024-03-18T15:03:31.327 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] tlibio.lo 2024-03-18T15:03:31.549 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] write_log.lo 2024-03-18T15:03:31.768 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] random.lo 2024-03-18T15:03:31.866 INFO:teuthology.orchestra.run.smithi152.stdout: [LD] 2024-03-18T15:03:31.963 INFO:teuthology.orchestra.run.smithi152.stdout:Building ltp 2024-03-18T15:03:31.966 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:32.103 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] doio 2024-03-18T15:03:32.750 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsstress 2024-03-18T15:03:34.103 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsx 2024-03-18T15:03:34.806 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] growfiles 2024-03-18T15:03:35.293 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] iogen 2024-03-18T15:03:35.785 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-stress 2024-03-18T15:03:36.195 INFO:teuthology.orchestra.run.smithi152.stdout:Building src 2024-03-18T15:03:36.200 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:37.968 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:37.999 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:38.006 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:38.214 INFO:teuthology.orchestra.run.smithi152.stdout: [DEP] 2024-03-18T15:03:38.235 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirstress 2024-03-18T15:03:38.454 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fill 2024-03-18T15:03:38.589 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fill2 2024-03-18T15:03:38.812 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] getpagesize 2024-03-18T15:03:38.942 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] holes 2024-03-18T15:03:39.117 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] lstat64 2024-03-18T15:03:39.282 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] nametest 2024-03-18T15:03:39.498 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] permname 2024-03-18T15:03:39.695 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] randholes 2024-03-18T15:03:39.947 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] runas 2024-03-18T15:03:40.102 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] truncfile 2024-03-18T15:03:40.271 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] usemem 2024-03-18T15:03:40.424 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmapcat 2024-03-18T15:03:40.568 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] append_reader 2024-03-18T15:03:40.708 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] append_writer 2024-03-18T15:03:40.861 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirperf 2024-03-18T15:03:41.077 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] metaperf 2024-03-18T15:03:41.320 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] devzero 2024-03-18T15:03:41.488 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] feature 2024-03-18T15:03:41.693 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] alloc 2024-03-18T15:03:41.905 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fault 2024-03-18T15:03:42.073 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fstest 2024-03-18T15:03:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_access_root 2024-03-18T15:03:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] godown 2024-03-18T15:03:42.645 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] resvtest 2024-03-18T15:03:42.828 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] writemod 2024-03-18T15:03:42.984 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] writev_on_pagefault 2024-03-18T15:03:43.103 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:03:43.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:03:43.146 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] makeextents 2024-03-18T15:03:43.302 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] itrash 2024-03-18T15:03:43.463 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] rename 2024-03-18T15:03:43.613 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] multi_open_unlink 2024-03-18T15:03:43.768 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] unwritten_sync 2024-03-18T15:03:43.930 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] genhashnames 2024-03-18T15:03:44.100 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_holes 2024-03-18T15:03:44.228 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_writev 2024-03-18T15:03:44.375 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_truncate_cmtime 2024-03-18T15:03:44.513 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dirhash_collide 2024-03-18T15:03:44.685 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_rename_overwrite 2024-03-18T15:03:44.805 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] holetest 2024-03-18T15:03:45.042 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_truncate_self 2024-03-18T15:03:45.166 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] af_unix 2024-03-18T15:03:45.304 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_stale_pmd 2024-03-18T15:03:45.440 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_cow_race 2024-03-18T15:03:45.591 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_fallocate 2024-03-18T15:03:45.728 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsync-err 2024-03-18T15:03:45.887 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_write_ro 2024-03-18T15:03:46.022 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ext4_dax_journal_corruption 2024-03-18T15:03:46.186 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ext4_dax_inline_corruption 2024-03-18T15:03:46.317 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_ofd_locks 2024-03-18T15:03:46.497 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_collision 2024-03-18T15:03:46.692 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmap-write-concurrent 2024-03-18T15:03:46.863 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_get_file_time 2024-03-18T15:03:46.996 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_create_short_dirs 2024-03-18T15:03:47.172 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_create_long_dirs 2024-03-18T15:03:47.340 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_enospc 2024-03-18T15:03:47.500 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_writev_overlap 2024-03-18T15:03:47.676 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] checkpoint_journal 2024-03-18T15:03:47.836 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mmap-rw-fault 2024-03-18T15:03:48.021 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] allocstale 2024-03-18T15:03:48.193 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_cow_memory_failure 2024-03-18T15:03:48.370 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fake-dump-rootino 2024-03-18T15:03:48.526 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-buf-fault 2024-03-18T15:03:48.668 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] rewinddir-test 2024-03-18T15:03:48.837 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] readdir-while-renames 2024-03-18T15:03:48.981 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] xfsctl 2024-03-18T15:03:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bstat 2024-03-18T15:03:49.358 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mtab 2024-03-18T15:03:49.574 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] getdevicesize 2024-03-18T15:03:49.703 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] preallo_rw_pattern_reader 2024-03-18T15:03:49.853 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] preallo_rw_pattern_writer 2024-03-18T15:03:50.018 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] ftrunc 2024-03-18T15:03:50.161 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] trunc 2024-03-18T15:03:50.314 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fs_perms 2024-03-18T15:03:50.475 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] testx 2024-03-18T15:03:50.604 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] looptest 2024-03-18T15:03:50.798 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] locktest 2024-03-18T15:03:51.099 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] unwritten_mmap 2024-03-18T15:03:51.265 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_unlink_test 2024-03-18T15:03:51.463 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] deduperace 2024-03-18T15:03:51.657 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_unlink_test_modified 2024-03-18T15:03:51.846 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_offset 2024-03-18T15:03:51.997 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_futimens 2024-03-18T15:03:52.146 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_immutable 2024-03-18T15:03:52.744 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] stale_handle 2024-03-18T15:03:52.909 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] pwrite_mmap_blocked 2024-03-18T15:03:53.056 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_offset2 2024-03-18T15:03:53.249 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] seek_sanity_test 2024-03-18T15:03:53.701 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] seek_copy_test 2024-03-18T15:03:53.880 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_1 2024-03-18T15:03:54.024 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_2 2024-03-18T15:03:54.179 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fsync-tester 2024-03-18T15:03:54.423 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] nsexec 2024-03-18T15:03:54.601 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] cloner 2024-03-18T15:03:54.783 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] renameat2 2024-03-18T15:03:54.938 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_getcwd 2024-03-18T15:03:55.104 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] e4compact 2024-03-18T15:03:55.282 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] test-nextquota 2024-03-18T15:03:55.432 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] punch-alternating 2024-03-18T15:03:55.577 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] attr-list-by-handle-cursor-test 2024-03-18T15:03:55.724 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] listxattr 2024-03-18T15:03:55.868 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-interleaved 2024-03-18T15:03:56.016 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_dir_type 2024-03-18T15:03:56.177 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dio-invalidate-cache 2024-03-18T15:03:56.375 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] stat_test 2024-03-18T15:03:56.634 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_encrypted_d_revalidate 2024-03-18T15:03:56.818 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] attr_replace_test 2024-03-18T15:03:56.968 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] swapon 2024-03-18T15:03:57.143 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mkswap 2024-03-18T15:03:57.273 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_attr_corruption 2024-03-18T15:03:57.406 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_open_tmpfiles 2024-03-18T15:03:57.573 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fscrypt-crypt-util 2024-03-18T15:03:58.218 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] bulkstat_null_ocount 2024-03-18T15:03:58.353 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] splice-test 2024-03-18T15:03:58.556 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] chprojid_fail 2024-03-18T15:03:58.711 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] detached_mounts_propagation 2024-03-18T15:03:58.889 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] ext4_resize 2024-03-18T15:03:59.040 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_readdir_3 2024-03-18T15:03:59.233 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] splice2pipe 2024-03-18T15:03:59.397 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] uuid_ioctl 2024-03-18T15:03:59.544 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_snapshot_deleted_subvolume 2024-03-18T15:03:59.714 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fiemap-tester 2024-03-18T15:03:59.957 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_stripealign 2024-03-18T15:04:00.113 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] open_by_handle 2024-03-18T15:04:00.334 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] dbtest 2024-03-18T15:04:00.587 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_mmap_dio 2024-03-18T15:04:00.747 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] xfsfind 2024-03-18T15:04:00.929 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] t_reflink_read_race 2024-03-18T15:04:01.118 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] fssum 2024-03-18T15:04:01.528 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-03-18T15:04:01.533 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] replay-log 2024-03-18T15:04:01.827 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-03-18T15:04:01.831 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-03-18T15:04:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aiocp 2024-03-18T15:04:02.042 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-append-write-fallocate-race 2024-03-18T15:04:02.185 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-append-write-read-race 2024-03-18T15:04:02.358 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-cow-race 2024-03-18T15:04:02.501 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-cycle-write 2024-03-18T15:04:02.659 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-eof-race 2024-03-18T15:04:02.821 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-extend-stat 2024-03-18T15:04:02.969 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-fcntl-race 2024-03-18T15:04:03.131 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-hole-filling-race 2024-03-18T15:04:03.274 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-invalidate-failure 2024-03-18T15:04:03.430 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-invalidate-readahead 2024-03-18T15:04:03.594 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aiodio_sparse2 2024-03-18T15:04:03.784 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-subblock-eof-read 2024-03-18T15:04:03.918 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-dio-write-verify 2024-03-18T15:04:04.111 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2024-03-18T15:04:04.235 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2024-03-18T15:04:04.373 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] aio-last-ref-held-by-io 2024-03-18T15:04:04.547 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-03-18T15:04:04.552 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] vfstest 2024-03-18T15:04:08.215 INFO:teuthology.orchestra.run.smithi152.stdout: [CC] mount-idmapped 2024-03-18T15:04:08.562 INFO:teuthology.orchestra.run.smithi152.stdout:Building m4 2024-03-18T15:04:08.566 INFO:teuthology.orchestra.run.smithi152.stdout:Building common 2024-03-18T15:04:08.569 INFO:teuthology.orchestra.run.smithi152.stdout:Building tests 2024-03-18T15:04:08.574 INFO:teuthology.orchestra.run.smithi152.stdout:Building btrfs 2024-03-18T15:04:08.580 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/btrfs/group.list 2024-03-18T15:04:08.642 INFO:teuthology.orchestra.run.smithi152.stdout:Building ceph 2024-03-18T15:04:08.647 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ceph/group.list 2024-03-18T15:04:08.661 INFO:teuthology.orchestra.run.smithi152.stdout:Building cifs 2024-03-18T15:04:08.666 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/cifs/group.list 2024-03-18T15:04:08.678 INFO:teuthology.orchestra.run.smithi152.stdout:Building ext4 2024-03-18T15:04:08.683 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ext4/group.list 2024-03-18T15:04:08.719 INFO:teuthology.orchestra.run.smithi152.stdout:Building f2fs 2024-03-18T15:04:08.724 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/f2fs/group.list 2024-03-18T15:04:08.741 INFO:teuthology.orchestra.run.smithi152.stdout:Building generic 2024-03-18T15:04:08.747 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/generic/group.list 2024-03-18T15:04:08.840 INFO:teuthology.orchestra.run.smithi152.stdout:Building nfs 2024-03-18T15:04:08.845 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/nfs/group.list 2024-03-18T15:04:08.859 INFO:teuthology.orchestra.run.smithi152.stdout:Building ocfs2 2024-03-18T15:04:08.864 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ocfs2/group.list 2024-03-18T15:04:08.877 INFO:teuthology.orchestra.run.smithi152.stdout:Building overlay 2024-03-18T15:04:08.882 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/overlay/group.list 2024-03-18T15:04:08.921 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-03-18T15:04:08.926 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/perf/group.list 2024-03-18T15:04:08.937 INFO:teuthology.orchestra.run.smithi152.stdout:Building selftest 2024-03-18T15:04:08.942 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/selftest/group.list 2024-03-18T15:04:08.955 INFO:teuthology.orchestra.run.smithi152.stdout:Building shared 2024-03-18T15:04:08.960 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/shared/group.list 2024-03-18T15:04:08.976 INFO:teuthology.orchestra.run.smithi152.stdout:Building tmpfs 2024-03-18T15:04:08.981 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/tmpfs/group.list 2024-03-18T15:04:08.993 INFO:teuthology.orchestra.run.smithi152.stdout:Building udf 2024-03-18T15:04:08.998 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/udf/group.list 2024-03-18T15:04:09.009 INFO:teuthology.orchestra.run.smithi152.stdout:Building xfs 2024-03-18T15:04:09.015 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/xfs/group.list 2024-03-18T15:04:09.116 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo make install) 2024-03-18T15:04:09.154 INFO:teuthology.orchestra.run.smithi152.stdout:Building include 2024-03-18T15:04:09.158 INFO:teuthology.orchestra.run.smithi152.stdout:Building lib 2024-03-18T15:04:09.162 INFO:teuthology.orchestra.run.smithi152.stdout:Building ltp 2024-03-18T15:04:09.166 INFO:teuthology.orchestra.run.smithi152.stdout:Building src 2024-03-18T15:04:09.199 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-03-18T15:04:09.202 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-03-18T15:04:09.205 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-03-18T15:04:09.209 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-03-18T15:04:09.213 INFO:teuthology.orchestra.run.smithi152.stdout:Building m4 2024-03-18T15:04:09.216 INFO:teuthology.orchestra.run.smithi152.stdout:Building common 2024-03-18T15:04:09.219 INFO:teuthology.orchestra.run.smithi152.stdout:Building tests 2024-03-18T15:04:09.224 INFO:teuthology.orchestra.run.smithi152.stdout:Building btrfs 2024-03-18T15:04:09.230 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/btrfs/group.list 2024-03-18T15:04:09.292 INFO:teuthology.orchestra.run.smithi152.stdout:Building ceph 2024-03-18T15:04:09.296 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ceph/group.list 2024-03-18T15:04:09.310 INFO:teuthology.orchestra.run.smithi152.stdout:Building cifs 2024-03-18T15:04:09.315 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/cifs/group.list 2024-03-18T15:04:09.327 INFO:teuthology.orchestra.run.smithi152.stdout:Building ext4 2024-03-18T15:04:09.332 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ext4/group.list 2024-03-18T15:04:09.369 INFO:teuthology.orchestra.run.smithi152.stdout:Building f2fs 2024-03-18T15:04:09.374 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/f2fs/group.list 2024-03-18T15:04:09.390 INFO:teuthology.orchestra.run.smithi152.stdout:Building generic 2024-03-18T15:04:09.397 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/generic/group.list 2024-03-18T15:04:09.489 INFO:teuthology.orchestra.run.smithi152.stdout:Building nfs 2024-03-18T15:04:09.493 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/nfs/group.list 2024-03-18T15:04:09.507 INFO:teuthology.orchestra.run.smithi152.stdout:Building ocfs2 2024-03-18T15:04:09.512 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ocfs2/group.list 2024-03-18T15:04:09.524 INFO:teuthology.orchestra.run.smithi152.stdout:Building overlay 2024-03-18T15:04:09.530 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/overlay/group.list 2024-03-18T15:04:09.568 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-03-18T15:04:09.573 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/perf/group.list 2024-03-18T15:04:09.584 INFO:teuthology.orchestra.run.smithi152.stdout:Building selftest 2024-03-18T15:04:09.590 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/selftest/group.list 2024-03-18T15:04:09.602 INFO:teuthology.orchestra.run.smithi152.stdout:Building shared 2024-03-18T15:04:09.607 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/shared/group.list 2024-03-18T15:04:09.623 INFO:teuthology.orchestra.run.smithi152.stdout:Building tmpfs 2024-03-18T15:04:09.628 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/tmpfs/group.list 2024-03-18T15:04:09.641 INFO:teuthology.orchestra.run.smithi152.stdout:Building udf 2024-03-18T15:04:09.646 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/udf/group.list 2024-03-18T15:04:09.657 INFO:teuthology.orchestra.run.smithi152.stdout:Building xfs 2024-03-18T15:04:09.663 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/xfs/group.list 2024-03-18T15:04:09.756 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2024-03-18T15:04:09.758 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T15:04:09.758 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2024-03-18T15:04:09.760 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T15:04:09.760 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2024-03-18T15:04:09.762 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2024-03-18T15:04:09.771 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2024-03-18T15:04:09.836 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2024-03-18T15:04:09.844 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2024-03-18T15:04:09.860 INFO:teuthology.orchestra.run.smithi152.stdout:Building log-writes 2024-03-18T15:04:09.864 INFO:teuthology.orchestra.run.smithi152.stdout:Building perf 2024-03-18T15:04:09.867 INFO:teuthology.orchestra.run.smithi152.stdout:Building aio-dio-regress 2024-03-18T15:04:09.871 INFO:teuthology.orchestra.run.smithi152.stdout:Building vfs 2024-03-18T15:04:09.874 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C log-writes install 2024-03-18T15:04:09.875 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2024-03-18T15:04:09.883 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2024-03-18T15:04:09.891 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C perf install 2024-03-18T15:04:09.892 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2024-03-18T15:04:09.900 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2024-03-18T15:04:09.921 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C aio-dio-regress install 2024-03-18T15:04:09.923 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2024-03-18T15:04:09.931 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2024-03-18T15:04:09.977 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake -C vfs install 2024-03-18T15:04:09.979 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2024-03-18T15:04:09.987 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2024-03-18T15:04:09.998 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2024-03-18T15:04:10.006 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test readdir-while-renames xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl t_snapshot_deleted_subvolume fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2024-03-18T15:04:11.167 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2024-03-18T15:04:11.259 INFO:teuthology.orchestra.run.smithi152.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2024-03-18T15:04:11.283 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2024-03-18T15:04:11.285 INFO:teuthology.orchestra.run.smithi152.stdout:gmake[1]: Nothing to be done for 'install'. 2024-03-18T15:04:11.285 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2024-03-18T15:04:11.286 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2024-03-18T15:04:11.294 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2024-03-18T15:04:11.416 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2024-03-18T15:04:11.417 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/btrfs/ install 2024-03-18T15:04:11.420 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/btrfs/group.list 2024-03-18T15:04:11.479 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2024-03-18T15:04:11.487 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 /var/lib/xfstests/tests/btrfs 2024-03-18T15:04:12.249 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2024-03-18T15:04:12.257 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out /var/lib/xfstests/tests/btrfs 2024-03-18T15:04:13.028 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ceph/ install 2024-03-18T15:04:13.030 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ceph/group.list 2024-03-18T15:04:13.044 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2024-03-18T15:04:13.052 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2024-03-18T15:04:13.069 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2024-03-18T15:04:13.077 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2024-03-18T15:04:13.094 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/cifs/ install 2024-03-18T15:04:13.096 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/cifs/group.list 2024-03-18T15:04:13.108 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2024-03-18T15:04:13.117 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2024-03-18T15:04:13.125 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2024-03-18T15:04:13.133 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2024-03-18T15:04:13.141 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ext4/ install 2024-03-18T15:04:13.144 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ext4/group.list 2024-03-18T15:04:13.175 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:04:13.178 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:04:13.180 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2024-03-18T15:04:13.188 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2024-03-18T15:04:13.357 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2024-03-18T15:04:13.365 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2024-03-18T15:04:13.543 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/f2fs/ install 2024-03-18T15:04:13.545 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/f2fs/group.list 2024-03-18T15:04:13.561 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2024-03-18T15:04:13.569 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2024-03-18T15:04:13.579 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2024-03-18T15:04:13.587 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2024-03-18T15:04:13.598 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/generic/ install 2024-03-18T15:04:13.601 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/generic/group.list 2024-03-18T15:04:13.695 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2024-03-18T15:04:13.703 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 /var/lib/xfstests/tests/generic 2024-03-18T15:04:15.502 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2024-03-18T15:04:15.511 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out /var/lib/xfstests/tests/generic 2024-03-18T15:04:17.309 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/nfs/ install 2024-03-18T15:04:17.311 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/nfs/group.list 2024-03-18T15:04:17.324 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2024-03-18T15:04:17.332 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2024-03-18T15:04:17.340 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2024-03-18T15:04:17.348 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2024-03-18T15:04:17.356 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ocfs2/ install 2024-03-18T15:04:17.359 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/ocfs2/group.list 2024-03-18T15:04:17.371 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2024-03-18T15:04:17.379 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2024-03-18T15:04:17.387 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2024-03-18T15:04:17.395 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2024-03-18T15:04:17.403 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/overlay/ install 2024-03-18T15:04:17.406 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/overlay/group.list 2024-03-18T15:04:17.446 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2024-03-18T15:04:17.454 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2024-03-18T15:04:17.709 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2024-03-18T15:04:17.717 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2024-03-18T15:04:17.976 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/perf/ install 2024-03-18T15:04:17.978 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/perf/group.list 2024-03-18T15:04:17.989 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2024-03-18T15:04:17.997 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2024-03-18T15:04:18.005 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2024-03-18T15:04:18.013 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2024-03-18T15:04:18.021 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/selftest/ install 2024-03-18T15:04:18.024 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/selftest/group.list 2024-03-18T15:04:18.035 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2024-03-18T15:04:18.043 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2024-03-18T15:04:18.063 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2024-03-18T15:04:18.071 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2024-03-18T15:04:18.090 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/shared/ install 2024-03-18T15:04:18.093 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/shared/group.list 2024-03-18T15:04:18.109 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2024-03-18T15:04:18.117 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2024-03-18T15:04:18.130 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2024-03-18T15:04:18.138 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2024-03-18T15:04:18.151 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/tmpfs/ install 2024-03-18T15:04:18.153 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/tmpfs/group.list 2024-03-18T15:04:18.165 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2024-03-18T15:04:18.174 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2024-03-18T15:04:18.182 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2024-03-18T15:04:18.190 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2024-03-18T15:04:18.198 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/udf/ install 2024-03-18T15:04:18.201 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/udf/group.list 2024-03-18T15:04:18.213 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2024-03-18T15:04:18.221 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2024-03-18T15:04:18.229 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2024-03-18T15:04:18.237 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2024-03-18T15:04:18.246 INFO:teuthology.orchestra.run.smithi152.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.YntrTC91Q1xfstests-dev/tests/xfs/ install 2024-03-18T15:04:18.249 INFO:teuthology.orchestra.run.smithi152.stdout: [GROUP] /tmp/tmp.YntrTC91Q1xfstests-dev/tests/xfs/group.list 2024-03-18T15:04:18.347 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2024-03-18T15:04:18.355 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2024-03-18T15:04:20.047 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2024-03-18T15:04:20.055 INFO:teuthology.orchestra.run.smithi152.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2024-03-18T15:04:21.762 INFO:teuthology.orchestra.run.smithi152.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2024-03-18T15:04:21.770 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2024-03-18T15:04:21.778 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2024-03-18T15:04:21.786 INFO:teuthology.orchestra.run.smithi152.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2024-03-18T15:04:21.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T15:04:21.796 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec ls tests/generic) 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:001 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:001.out 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:002 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:002.out 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:003 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:003.out 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:004 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:004.out 2024-03-18T15:04:21.815 INFO:teuthology.orchestra.run.smithi152.stdout:005 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:005.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:006 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:006.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:007 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:007.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:008 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:008.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:009 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:009.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:010 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:010.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:011 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:011.out 2024-03-18T15:04:21.816 INFO:teuthology.orchestra.run.smithi152.stdout:012 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:012.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:013 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:013.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:014 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:014.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:015 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:015.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:016 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:016.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:017 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:017.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:018 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:018.out 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:019 2024-03-18T15:04:21.817 INFO:teuthology.orchestra.run.smithi152.stdout:019.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:020 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:020.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:021 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:021.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:022 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:022.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:023 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:023.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:024 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:024.out 2024-03-18T15:04:21.818 INFO:teuthology.orchestra.run.smithi152.stdout:025 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:025.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:026 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:026.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:027 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:027.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:028 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:028.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:029 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:029.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:030 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:030.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:031 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:031.out 2024-03-18T15:04:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:032 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:032.out 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:033 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:033.out 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:034 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:034.out 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:035 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:035.cfg 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:035.out.default 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:035.out.nfs 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:036 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:036.out 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:037 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:037.out 2024-03-18T15:04:21.820 INFO:teuthology.orchestra.run.smithi152.stdout:038 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:038.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:039 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:039.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:040 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:040.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:041 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:041.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:042 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:042.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:043 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:043.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:044 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:044.out 2024-03-18T15:04:21.821 INFO:teuthology.orchestra.run.smithi152.stdout:045 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:045.out 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:046 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:046.out 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:047 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:047.out 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:048 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:048.out 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:049 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:049.out 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:050 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:050.cfg 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.default 2024-03-18T15:04:21.822 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.nojournal 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:050.out.xfsquota 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:051 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:051.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:052 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:052.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:053 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:053.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:054 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:054.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:055 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:055.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:056 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:056.out 2024-03-18T15:04:21.823 INFO:teuthology.orchestra.run.smithi152.stdout:057 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:057.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:058 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:058.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:059 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:059.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:060 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:060.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:061 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:061.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:062 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:062.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:063 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:063.out 2024-03-18T15:04:21.824 INFO:teuthology.orchestra.run.smithi152.stdout:064 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:064.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:065 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:065.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:066 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:066.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:067 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:067.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:068 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:068.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:069 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:069.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:070 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:070.out 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:071 2024-03-18T15:04:21.825 INFO:teuthology.orchestra.run.smithi152.stdout:071.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:072 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:072.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:073 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:073.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:074 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:074.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:075 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:075.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:076 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:076.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:077 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:077.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:078 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:078.out 2024-03-18T15:04:21.826 INFO:teuthology.orchestra.run.smithi152.stdout:079 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:079.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:080 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:080.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:081 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:081.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:082 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:082.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:083 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:083.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:084 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:084.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:085 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:085.out 2024-03-18T15:04:21.827 INFO:teuthology.orchestra.run.smithi152.stdout:086 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:086.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:087 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:087.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:088 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:088.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:089 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:089.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:090 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:090.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:091 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:091.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:092 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:092.out 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:093 2024-03-18T15:04:21.828 INFO:teuthology.orchestra.run.smithi152.stdout:093.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:094 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:094.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:095 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:095.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:096 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:096.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:097 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:097.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:098 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:098.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:099 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:099.out 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:100 2024-03-18T15:04:21.829 INFO:teuthology.orchestra.run.smithi152.stdout:100.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:101 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:101.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:102 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:102.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:103 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:103.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:104 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:104.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:105 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:105.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:106 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:106.out 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:107 2024-03-18T15:04:21.830 INFO:teuthology.orchestra.run.smithi152.stdout:107.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:108 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:108.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:109 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:109.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:110 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:110.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:111 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:111.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:112 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:112.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:113 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:113.out 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:114 2024-03-18T15:04:21.831 INFO:teuthology.orchestra.run.smithi152.stdout:114.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:115 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:115.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:116 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:116.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:117 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:117.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:118 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:118.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:119 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:119.out 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:120 2024-03-18T15:04:21.832 INFO:teuthology.orchestra.run.smithi152.stdout:120.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:121 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:121.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:122 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:122.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:123 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:123.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:124 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:124.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:125 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:125.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:126 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:126.out 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:127 2024-03-18T15:04:21.833 INFO:teuthology.orchestra.run.smithi152.stdout:127.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:128 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:128.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:129 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:129.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:130 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:130.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:131 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:131.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:132 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:132.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:133 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:133.out 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:134 2024-03-18T15:04:21.834 INFO:teuthology.orchestra.run.smithi152.stdout:134.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:135 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:135.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:136 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:136.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:137 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:137.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:138 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:138.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:139 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:139.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:140 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:140.out 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:141 2024-03-18T15:04:21.835 INFO:teuthology.orchestra.run.smithi152.stdout:141.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:142 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:142.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:143 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:143.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:144 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:144.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:145 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:145.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:146 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:146.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:147 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:147.out 2024-03-18T15:04:21.836 INFO:teuthology.orchestra.run.smithi152.stdout:148 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:148.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:149 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:149.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:150 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:150.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:151 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:151.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:152 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:152.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:153 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:153.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:154 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:154.out 2024-03-18T15:04:21.837 INFO:teuthology.orchestra.run.smithi152.stdout:155 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:155.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:156 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:156.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:157 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:157.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:158 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:158.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:159 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:159.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:160 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:160.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:161 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:161.out 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:162 2024-03-18T15:04:21.838 INFO:teuthology.orchestra.run.smithi152.stdout:162.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:163 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:163.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:164 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:164.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:165 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:165.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:166 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:166.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:167 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:167.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:168 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:168.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:169 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:169.out 2024-03-18T15:04:21.839 INFO:teuthology.orchestra.run.smithi152.stdout:170 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:170.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:171 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:171.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:172 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:172.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:173 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:173.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:174 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:174.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:175 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:175.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:176 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:176.out 2024-03-18T15:04:21.840 INFO:teuthology.orchestra.run.smithi152.stdout:177 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:177.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:178 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:178.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:179 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:179.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:180 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:180.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:181 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:181.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:182 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:182.out 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:183 2024-03-18T15:04:21.841 INFO:teuthology.orchestra.run.smithi152.stdout:183.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:184 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:184.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:185 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:185.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:186 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:186.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:187 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:187.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:188 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:188.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:189 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:189.out 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:190 2024-03-18T15:04:21.842 INFO:teuthology.orchestra.run.smithi152.stdout:190.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:191 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:191.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:192 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:192.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:193 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:193.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:194 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:194.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:195 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:195.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:196 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:196.out 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:197 2024-03-18T15:04:21.843 INFO:teuthology.orchestra.run.smithi152.stdout:197.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:198 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:198.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:199 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:199.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:200 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:200.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:201 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:201.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:202 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:202.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:203 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:203.out 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:204 2024-03-18T15:04:21.844 INFO:teuthology.orchestra.run.smithi152.stdout:204.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:205 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:205.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:206 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:206.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:207 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:207.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:208 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:208.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:209 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:209.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:210 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:210.out 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:211 2024-03-18T15:04:21.845 INFO:teuthology.orchestra.run.smithi152.stdout:211.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:212 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:212.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:213 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:213.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:214 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:214.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:215 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:215.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:216 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:216.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:217 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:217.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:218 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:218.out 2024-03-18T15:04:21.846 INFO:teuthology.orchestra.run.smithi152.stdout:219 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:219.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:220 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:220.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:221 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:221.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:222 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:222.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:223 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:223.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:224 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:224.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:225 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:225.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:226 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:226.out 2024-03-18T15:04:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:227 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:227.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:228 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:228.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:229 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:229.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:230 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:230.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:231 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:231.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:232 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:232.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:233 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:233.out 2024-03-18T15:04:21.848 INFO:teuthology.orchestra.run.smithi152.stdout:234 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:234.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:235 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:235.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:236 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:236.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:237 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:237.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:238 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:238.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:239 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:239.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:240 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:240.out 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:241 2024-03-18T15:04:21.849 INFO:teuthology.orchestra.run.smithi152.stdout:241.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:242 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:242.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:243 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:243.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:244 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:244.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:245 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:245.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:246 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:246.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:247 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:247.out 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:248 2024-03-18T15:04:21.850 INFO:teuthology.orchestra.run.smithi152.stdout:248.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:249 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:249.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:250 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:250.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:251 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:251.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:252 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:252.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:253 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:253.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:254 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:254.out 2024-03-18T15:04:21.851 INFO:teuthology.orchestra.run.smithi152.stdout:255 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:255.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:256 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:256.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:257 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:257.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:258 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:258.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:259 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:259.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:260 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:260.out 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:261 2024-03-18T15:04:21.852 INFO:teuthology.orchestra.run.smithi152.stdout:261.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:262 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:262.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:263 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:263.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:264 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:264.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:265 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:265.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:266 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:266.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:267 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:267.out 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:268 2024-03-18T15:04:21.853 INFO:teuthology.orchestra.run.smithi152.stdout:268.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:269 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:269.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:270 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:270.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:271 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:271.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:272 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:272.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:273 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:273.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:274 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:274.out 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:275 2024-03-18T15:04:21.854 INFO:teuthology.orchestra.run.smithi152.stdout:275.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:276 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:276.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:277 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:277.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:278 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:278.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:279 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:279.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:280 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:280.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:281 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:281.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:282 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:282.out 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:283 2024-03-18T15:04:21.855 INFO:teuthology.orchestra.run.smithi152.stdout:283.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:284 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:284.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:285 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:285.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:286 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:286.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:287 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:287.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:288 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:288.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:289 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:289.out 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:290 2024-03-18T15:04:21.856 INFO:teuthology.orchestra.run.smithi152.stdout:290.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:291 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:291.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:292 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:292.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:293 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:293.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:294 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:294.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:295 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:295.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:296 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:296.out 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:297 2024-03-18T15:04:21.857 INFO:teuthology.orchestra.run.smithi152.stdout:297.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:298 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:298.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:299 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:299.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:300 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:300.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:301 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:301.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:302 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:302.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:303 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:303.out 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:304 2024-03-18T15:04:21.858 INFO:teuthology.orchestra.run.smithi152.stdout:304.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:305 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:305.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:306 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:306.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:307 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:307.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:308 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:308.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:309 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:309.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:310 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:310.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:311 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:311.out 2024-03-18T15:04:21.859 INFO:teuthology.orchestra.run.smithi152.stdout:312 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:312.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:313 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:313.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:314 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:314.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:315 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:315.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:316 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:316.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:317 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:317.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:318 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:318.out 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:319 2024-03-18T15:04:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:319.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:320 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:320.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:321 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:321.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:322 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:322.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:323 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:323.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:324 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:324.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:325 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:325.out 2024-03-18T15:04:21.861 INFO:teuthology.orchestra.run.smithi152.stdout:326 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:326.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:327 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:327.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:328 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:328.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:329 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:329.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:330 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:330.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:331 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:331.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:332 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:332.out 2024-03-18T15:04:21.862 INFO:teuthology.orchestra.run.smithi152.stdout:333 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:333.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:334 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:334.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:335 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:335.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:336 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:336.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:337 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:337.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:338 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:338.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:339 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:339.out 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:340 2024-03-18T15:04:21.863 INFO:teuthology.orchestra.run.smithi152.stdout:340.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:341 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:341.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:342 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:342.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:343 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:343.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:344 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:344.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:345 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:345.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:346 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:346.out 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:347 2024-03-18T15:04:21.864 INFO:teuthology.orchestra.run.smithi152.stdout:347.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:348 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:348.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:349 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:349.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:350 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:350.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:351 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:351.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:352 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:352.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:353 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:353.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:354 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:354.out 2024-03-18T15:04:21.865 INFO:teuthology.orchestra.run.smithi152.stdout:355 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:355.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:356 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:356.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:357 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:357.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:358 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:358.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:359 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:359.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:360 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:360.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:361 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:361.out 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:362 2024-03-18T15:04:21.866 INFO:teuthology.orchestra.run.smithi152.stdout:362.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:363 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:363.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:364 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:364.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:365 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:365.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:366 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:366.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:367 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:367.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:368 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:368.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:369 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:369.out 2024-03-18T15:04:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:370 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:370.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:371 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:371.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:372 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:372.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:373 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:373.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:374 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:374.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:375 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:375.out 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:376 2024-03-18T15:04:21.868 INFO:teuthology.orchestra.run.smithi152.stdout:376.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:377 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:377.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:378 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:378.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:379 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:379.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:380 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:380.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:381 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:381.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:382 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:382.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:383 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:383.out 2024-03-18T15:04:21.869 INFO:teuthology.orchestra.run.smithi152.stdout:384 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:384.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:385 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:385.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:386 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:386.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:387 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:387.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:388 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:388.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:389 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:389.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:390 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:390.out 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:391 2024-03-18T15:04:21.870 INFO:teuthology.orchestra.run.smithi152.stdout:391.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:392 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:392.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:393 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:393.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:394 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:394.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:395 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:395.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:396 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:396.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:397 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:397.out 2024-03-18T15:04:21.871 INFO:teuthology.orchestra.run.smithi152.stdout:398 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:398.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:399 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:399.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:400 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:400.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:401 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:401.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:402 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:402.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:403 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:403.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:404 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:404.out 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:405 2024-03-18T15:04:21.872 INFO:teuthology.orchestra.run.smithi152.stdout:405.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:406 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:406.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:407 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:407.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:408 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:408.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:409 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:409.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:410 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:410.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:411 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:411.out 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:412 2024-03-18T15:04:21.873 INFO:teuthology.orchestra.run.smithi152.stdout:412.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:413 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:413.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:414 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:414.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:415 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:415.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:416 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:416.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:417 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:417.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:418 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:418.out 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:419 2024-03-18T15:04:21.874 INFO:teuthology.orchestra.run.smithi152.stdout:419.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:420 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:420.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:421 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:421.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:422 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:422.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:423 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:423.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:424 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:424.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:425 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:425.out 2024-03-18T15:04:21.875 INFO:teuthology.orchestra.run.smithi152.stdout:426 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:426.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:427 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:427.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:428 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:428.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:429 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:429.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:430 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:430.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:431 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:431.out 2024-03-18T15:04:21.876 INFO:teuthology.orchestra.run.smithi152.stdout:432 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:432.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:433 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:433.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:434 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:434.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:435 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:435.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:436 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:436.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:437 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:437.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:438 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:438.out 2024-03-18T15:04:21.877 INFO:teuthology.orchestra.run.smithi152.stdout:439 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:439.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:440 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:440.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:441 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:441.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:442 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:442.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:443 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:443.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:444 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:444.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:445 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:445.out 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:446 2024-03-18T15:04:21.878 INFO:teuthology.orchestra.run.smithi152.stdout:446.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:447 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:447.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:448 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:448.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:449 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:449.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:450 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:450.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:451 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:451.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:452 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:452.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:453 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:453.out 2024-03-18T15:04:21.879 INFO:teuthology.orchestra.run.smithi152.stdout:454 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:454.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:455 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:455.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:456 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:456.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:457 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:457.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:458 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:458.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:459 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:459.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:460 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:460.out 2024-03-18T15:04:21.880 INFO:teuthology.orchestra.run.smithi152.stdout:461 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:461.out 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:462 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:462.out 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:463 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:463.out 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:464 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:464.out 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:465 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:465.out 2024-03-18T15:04:21.881 INFO:teuthology.orchestra.run.smithi152.stdout:466 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:466.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:467 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:467.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:468 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:468.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:469 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:469.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:470 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:470.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:471 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:471.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:472 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:472.out 2024-03-18T15:04:21.882 INFO:teuthology.orchestra.run.smithi152.stdout:473 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:473.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:474 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:474.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:475 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:475.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:476 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:476.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:477 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:477.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:478 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:478.out 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:479 2024-03-18T15:04:21.883 INFO:teuthology.orchestra.run.smithi152.stdout:479.out 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:480 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:480.out 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:481 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:481.out 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:482 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:482.out 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:483 2024-03-18T15:04:21.884 INFO:teuthology.orchestra.run.smithi152.stdout:483.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:484 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:484.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:485 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:485.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:486 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:486.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:487 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:487.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:488 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:488.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:489 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:489.out 2024-03-18T15:04:21.885 INFO:teuthology.orchestra.run.smithi152.stdout:490 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:490.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:491 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:491.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:492 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:492.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:493 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:493.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:494 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:494.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:495 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:495.out 2024-03-18T15:04:21.886 INFO:teuthology.orchestra.run.smithi152.stdout:496 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:496.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:497 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:497.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:498 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:498.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:499 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:499.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:500 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:500.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:501 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:501.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:502 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:502.out 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:503 2024-03-18T15:04:21.887 INFO:teuthology.orchestra.run.smithi152.stdout:503.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:504 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:504.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:505 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:505.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:506 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:506.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:507 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:507.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:508 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:508.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:509 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:509.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:510 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:510.out 2024-03-18T15:04:21.888 INFO:teuthology.orchestra.run.smithi152.stdout:511 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:511.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:512 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:512.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:513 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:513.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:514 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:514.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:515 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:515.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:516 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:516.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:517 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:517.out 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:518 2024-03-18T15:04:21.889 INFO:teuthology.orchestra.run.smithi152.stdout:518.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:519 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:519.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:520 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:520.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:521 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:521.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:522 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:522.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:523 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:523.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:524 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:524.out 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:525 2024-03-18T15:04:21.890 INFO:teuthology.orchestra.run.smithi152.stdout:525.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:526 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:526.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:527 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:527.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:528 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:528.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:529 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:529.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:530 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:530.out 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:531 2024-03-18T15:04:21.891 INFO:teuthology.orchestra.run.smithi152.stdout:531.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:532 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:532.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:533 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:533.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:534 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:534.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:535 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:535.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:536 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:536.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:537 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:537.out 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:538 2024-03-18T15:04:21.892 INFO:teuthology.orchestra.run.smithi152.stdout:538.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:539 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:539.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:540 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:540.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:541 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:541.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:542 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:542.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:543 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:543.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:544 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:544.out 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:545 2024-03-18T15:04:21.893 INFO:teuthology.orchestra.run.smithi152.stdout:545.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:546 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:546.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:547 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:547.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:548 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:548.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:549 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:549.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:550 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:550.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:551 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:551.out 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:552 2024-03-18T15:04:21.894 INFO:teuthology.orchestra.run.smithi152.stdout:552.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:553 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:553.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:554 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:554.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:555 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:555.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:556 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:556.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:557 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:557.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:558 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:558.out 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:559 2024-03-18T15:04:21.895 INFO:teuthology.orchestra.run.smithi152.stdout:559.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:560 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:560.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:561 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:561.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:562 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:562.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:563 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:563.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:564 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:564.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:565 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:565.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:566 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:566.out 2024-03-18T15:04:21.896 INFO:teuthology.orchestra.run.smithi152.stdout:567 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:567.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:568 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:568.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:569 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:569.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:570 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:570.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:571 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:571.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:572 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:572.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:573 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:573.out 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:574 2024-03-18T15:04:21.897 INFO:teuthology.orchestra.run.smithi152.stdout:574.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:575 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:575.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:576 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:576.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:577 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:577.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:578 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:578.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:579 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:579.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:580 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:580.out 2024-03-18T15:04:21.898 INFO:teuthology.orchestra.run.smithi152.stdout:581 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:581.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:582 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:582.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:583 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:583.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:584 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:584.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:585 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:585.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:586 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:586.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:587 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:587.out 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:588 2024-03-18T15:04:21.899 INFO:teuthology.orchestra.run.smithi152.stdout:588.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:589 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:589.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:590 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:590.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:591 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:591.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:592 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:592.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:593 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:593.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:594 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:594.out 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:595 2024-03-18T15:04:21.900 INFO:teuthology.orchestra.run.smithi152.stdout:595.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:596 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:596.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:597 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:597.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:598 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:598.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:599 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:599.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:600 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:600.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:601 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:601.out 2024-03-18T15:04:21.901 INFO:teuthology.orchestra.run.smithi152.stdout:602 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:602.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:603 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:603.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:604 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:604.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:605 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:605.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:606 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:606.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:607 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:607.out 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:608 2024-03-18T15:04:21.902 INFO:teuthology.orchestra.run.smithi152.stdout:608.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:609 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:609.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:610 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:610.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:611 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:611.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:612 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:612.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:613 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:613.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:614 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:614.out 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:615 2024-03-18T15:04:21.903 INFO:teuthology.orchestra.run.smithi152.stdout:615.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:616 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:616.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:617 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:617.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:618 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:618.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:619 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:619.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:620 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:620.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:621 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:621.out 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:622 2024-03-18T15:04:21.904 INFO:teuthology.orchestra.run.smithi152.stdout:622.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:623 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:623.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:624 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:624.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:625 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:625.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:626 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:626.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:627 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:627.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:628 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:628.out 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:629 2024-03-18T15:04:21.905 INFO:teuthology.orchestra.run.smithi152.stdout:629.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:630 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:630.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:631 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:631.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:632 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:632.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:633 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:633.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:634 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:634.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:635 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:635.out 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:636 2024-03-18T15:04:21.906 INFO:teuthology.orchestra.run.smithi152.stdout:636.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:637 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:637.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:638 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:638.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:639 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:639.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:640 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:640.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:641 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:641.out 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:642 2024-03-18T15:04:21.907 INFO:teuthology.orchestra.run.smithi152.stdout:642.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:643 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:643.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:644 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:644.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:645 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:645.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:646 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:646.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:647 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:647.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:648 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:648.out 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:649 2024-03-18T15:04:21.908 INFO:teuthology.orchestra.run.smithi152.stdout:649.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:650 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:650.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:651 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:651.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:652 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:652.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:653 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:653.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:654 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:654.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:655 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:655.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:656 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:656.out 2024-03-18T15:04:21.909 INFO:teuthology.orchestra.run.smithi152.stdout:657 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:657.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:658 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:658.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:659 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:659.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:660 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:660.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:661 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:661.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:662 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:662.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:663 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:663.out 2024-03-18T15:04:21.910 INFO:teuthology.orchestra.run.smithi152.stdout:664 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:664.out 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:665 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:665.out 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:666 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:666.out 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:667 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:667.out 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:668 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:668.out 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:669 2024-03-18T15:04:21.911 INFO:teuthology.orchestra.run.smithi152.stdout:669.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:670 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:670.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:671 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:671.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:672 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:672.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:673 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:673.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:674 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:674.out 2024-03-18T15:04:21.912 INFO:teuthology.orchestra.run.smithi152.stdout:675 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:675.out 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:676 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:676.out 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:677 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:677.out 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:678 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:678.out 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:679 2024-03-18T15:04:21.913 INFO:teuthology.orchestra.run.smithi152.stdout:679.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:680 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:680.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:681 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:681.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:682 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:682.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:683 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:683.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:684 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:684.out 2024-03-18T15:04:21.914 INFO:teuthology.orchestra.run.smithi152.stdout:685 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:685.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:686 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:686.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:687 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:687.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:688 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:688.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:689 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:689.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:690 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:690.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:691 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:691.out 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:692 2024-03-18T15:04:21.915 INFO:teuthology.orchestra.run.smithi152.stdout:692.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:693 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:693.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:694 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:694.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:695 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:695.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:696 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:696.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:697 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:697.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:698 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:698.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:699 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:699.out 2024-03-18T15:04:21.916 INFO:teuthology.orchestra.run.smithi152.stdout:700 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:700.out 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:701 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:701.out 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:702 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:702.out 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:703 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:703.out 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:704 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:704.out 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:705 2024-03-18T15:04:21.917 INFO:teuthology.orchestra.run.smithi152.stdout:705.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:706 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:706.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:707 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:707.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:708 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:708.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:709 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:709.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:710 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:710.out 2024-03-18T15:04:21.918 INFO:teuthology.orchestra.run.smithi152.stdout:711 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:711.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:712 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:712.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:713 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:713.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:714 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:714.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:715 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:715.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:716 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:716.out 2024-03-18T15:04:21.919 INFO:teuthology.orchestra.run.smithi152.stdout:717 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:717.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:718 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:718.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:719 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:719.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:720 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:720.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:721 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:721.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:722 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:722.out 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:723 2024-03-18T15:04:21.920 INFO:teuthology.orchestra.run.smithi152.stdout:723.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:724 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:724.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:725 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:725.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:726 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:726.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:727 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:727.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:728 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:728.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:729 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:729.out 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:730 2024-03-18T15:04:21.921 INFO:teuthology.orchestra.run.smithi152.stdout:730.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:731 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:731.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:732 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:732.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:733 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:733.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:734 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:734.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:735 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:735.out 2024-03-18T15:04:21.922 INFO:teuthology.orchestra.run.smithi152.stdout:736 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:736.out 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:737 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:737.out 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:738 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:738.out 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:739 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:739.out 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:group.list 2024-03-18T15:04:21.923 INFO:teuthology.orchestra.run.smithi152.stdout:Makefile 2024-03-18T15:04:21.924 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2024-03-18T15:04:22.104 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:22.108 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:22.108 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:22.109 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:22.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:27.272 INFO:teuthology.orchestra.run.smithi152.stdout:generic/001 5s 2024-03-18T15:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/001 2024-03-18T15:04:27.277 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:27.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:27.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:27.558 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2024-03-18T15:04:27.826 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:27.832 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:27.833 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:27.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:28.272 INFO:teuthology.orchestra.run.smithi152.stdout:generic/002 1s 2024-03-18T15:04:28.278 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/002 2024-03-18T15:04:28.278 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:28.280 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:28.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:28.311 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2024-03-18T15:04:28.493 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:28.496 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:28.497 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:28.498 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:28.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:28.699 INFO:teuthology.orchestra.run.smithi152.stdout:generic/003 [not run] atime not maintained by ceph 2024-03-18T15:04:28.702 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/003 2024-03-18T15:04:28.703 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/003 2024-03-18T15:04:28.703 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:28.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:28.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:28.716 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2024-03-18T15:04:28.892 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:28.895 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:28.896 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:28.897 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:28.897 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:29.095 INFO:teuthology.orchestra.run.smithi152.stdout:generic/004 [not run] O_TMPFILE is not supported 2024-03-18T15:04:29.099 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/004 2024-03-18T15:04:29.099 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/004 2024-03-18T15:04:29.100 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:29.102 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:29.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:29.112 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2024-03-18T15:04:29.295 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:29.299 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:29.299 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:29.300 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:29.300 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:29.665 INFO:teuthology.orchestra.run.smithi152.stdout:generic/005 0s 2024-03-18T15:04:29.672 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/005 2024-03-18T15:04:29.672 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:29.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:29.712 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:29.712 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2024-03-18T15:04:29.900 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:29.903 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:29.904 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:29.905 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:29.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:43.331 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:04:43.335 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:04:55.868 INFO:teuthology.orchestra.run.smithi152.stdout:generic/006 26s 2024-03-18T15:04:55.873 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/006 2024-03-18T15:04:55.873 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:04:55.876 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:04:56.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:04:56.214 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2024-03-18T15:04:56.406 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:04:56.410 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:04:56.410 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:04:56.411 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:04:56.411 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:13.480 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:05:13.483 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:05:43.854 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:05:43.857 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:05:50.712 INFO:teuthology.orchestra.run.smithi152.stdout:generic/007 54s 2024-03-18T15:05:50.746 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/007 2024-03-18T15:05:50.746 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:05:50.750 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:50.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:05:50.849 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2024-03-18T15:05:51.041 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:05:51.045 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:05:51.045 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:05:51.046 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:05:51.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:51.311 INFO:teuthology.orchestra.run.smithi152.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T15:05:51.315 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/008 2024-03-18T15:05:51.315 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/008 2024-03-18T15:05:51.315 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:05:51.317 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:51.331 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:05:51.331 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2024-03-18T15:05:51.515 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:05:51.518 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:05:51.519 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:05:51.520 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:05:51.520 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:51.807 INFO:teuthology.orchestra.run.smithi152.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T15:05:51.811 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/009 2024-03-18T15:05:51.811 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/009 2024-03-18T15:05:51.811 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:05:51.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:51.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:05:51.828 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2024-03-18T15:05:51.997 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:05:52.000 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:05:52.001 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:05:52.002 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:05:52.002 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:52.529 INFO:teuthology.orchestra.run.smithi152.stdout:generic/010 0s 2024-03-18T15:05:52.535 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/010 2024-03-18T15:05:52.535 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:05:52.537 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:05:52.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:05:52.568 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2024-03-18T15:05:52.755 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:05:52.758 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:05:52.759 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:05:52.760 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:05:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:06:14.127 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:06:14.130 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:06:22.854 INFO:teuthology.orchestra.run.smithi152.stdout:generic/011 30s 2024-03-18T15:06:22.918 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/011 2024-03-18T15:06:22.918 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:06:22.920 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:06:22.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:06:22.984 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2024-03-18T15:06:23.159 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:06:23.162 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:06:23.163 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:06:23.163 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:06:23.163 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:06:23.451 INFO:teuthology.orchestra.run.smithi152.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:06:23.455 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/012 2024-03-18T15:06:23.455 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/012 2024-03-18T15:06:23.455 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:06:23.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:06:23.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:06:23.501 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2024-03-18T15:06:23.696 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:06:23.700 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:06:23.700 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:06:23.701 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:06:23.701 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:06:44.317 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:06:44.320 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:07:15.085 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:07:15.089 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:07:29.362 INFO:teuthology.orchestra.run.smithi152.stdout:generic/013 66s 2024-03-18T15:07:29.369 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/013 2024-03-18T15:07:29.370 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:29.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:29.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:29.397 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2024-03-18T15:07:29.648 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:29.654 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:29.654 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:29.655 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:29.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:29.977 INFO:teuthology.orchestra.run.smithi152.stdout:generic/014 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:07:29.983 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/014 2024-03-18T15:07:29.983 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/014 2024-03-18T15:07:29.984 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:29.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:30.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:30.007 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2024-03-18T15:07:30.279 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:30.284 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:30.285 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:30.286 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:30.286 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:30.561 INFO:teuthology.orchestra.run.smithi152.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:07:30.567 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/015 2024-03-18T15:07:30.567 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/015 2024-03-18T15:07:30.567 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:30.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:30.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:30.586 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2024-03-18T15:07:30.842 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:30.847 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:30.847 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:30.849 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:30.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:31.232 INFO:teuthology.orchestra.run.smithi152.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:07:31.237 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/016 2024-03-18T15:07:31.237 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/016 2024-03-18T15:07:31.237 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:31.241 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:31.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:31.275 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2024-03-18T15:07:31.562 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:31.568 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:31.569 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:31.570 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:31.570 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:31.864 INFO:teuthology.orchestra.run.smithi152.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:07:31.870 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/017 2024-03-18T15:07:31.870 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/017 2024-03-18T15:07:31.870 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:31.873 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:31.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:31.892 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2024-03-18T15:07:32.148 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:32.154 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:32.154 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:32.155 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:32.155 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:32.521 INFO:teuthology.orchestra.run.smithi152.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2024-03-18T15:07:32.530 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/018 2024-03-18T15:07:32.530 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/018 2024-03-18T15:07:32.530 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:32.532 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:32.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:32.547 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2024-03-18T15:07:32.806 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:32.812 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:32.812 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:32.814 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:32.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:33.097 INFO:teuthology.orchestra.run.smithi152.stdout:generic/019 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:07:33.103 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/019 2024-03-18T15:07:33.103 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/019 2024-03-18T15:07:33.103 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:33.105 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:33.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:33.119 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2024-03-18T15:07:33.397 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:33.404 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:33.404 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:33.406 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:33.406 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:37.149 INFO:teuthology.orchestra.run.smithi152.stdout:generic/020 4s 2024-03-18T15:07:37.281 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/020 2024-03-18T15:07:37.281 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:37.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:37.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:37.325 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2024-03-18T15:07:37.618 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:37.625 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:37.626 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:37.627 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:37.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:38.023 INFO:teuthology.orchestra.run.smithi152.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:07:38.028 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/021 2024-03-18T15:07:38.028 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/021 2024-03-18T15:07:38.028 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:38.032 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:38.072 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:38.072 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2024-03-18T15:07:38.411 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:38.417 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:38.417 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:38.418 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:38.418 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:38.824 INFO:teuthology.orchestra.run.smithi152.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:07:38.829 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/022 2024-03-18T15:07:38.829 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/022 2024-03-18T15:07:38.829 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:38.832 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:38.874 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:38.874 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2024-03-18T15:07:39.160 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:39.165 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:39.166 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:39.167 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:39.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:40.419 INFO:teuthology.orchestra.run.smithi152.stdout:generic/023 1s 2024-03-18T15:07:40.588 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/023 2024-03-18T15:07:40.588 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:40.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:40.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:40.660 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2024-03-18T15:07:40.953 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:40.958 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:40.959 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:40.960 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:40.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:41.265 INFO:teuthology.orchestra.run.smithi152.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2024-03-18T15:07:41.270 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/024 2024-03-18T15:07:41.270 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/024 2024-03-18T15:07:41.270 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:41.274 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:41.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:41.313 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2024-03-18T15:07:41.616 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:41.621 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:41.622 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:41.623 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:41.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:41.938 INFO:teuthology.orchestra.run.smithi152.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2024-03-18T15:07:41.942 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/025 2024-03-18T15:07:41.943 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/025 2024-03-18T15:07:41.943 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:41.946 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:41.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:41.975 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2024-03-18T15:07:42.277 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:42.281 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:42.282 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:42.284 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:42.601 INFO:teuthology.orchestra.run.smithi152.stdout:generic/026 [not run] ceph does not define maximum ACL count 2024-03-18T15:07:42.606 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/026 2024-03-18T15:07:42.606 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/026 2024-03-18T15:07:42.606 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:42.610 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:42.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:42.633 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2024-03-18T15:07:42.919 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:42.924 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:42.925 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:42.926 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:42.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:43.204 INFO:teuthology.orchestra.run.smithi152.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:07:43.209 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/027 2024-03-18T15:07:43.210 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/027 2024-03-18T15:07:43.210 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:43.213 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:43.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:43.227 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2024-03-18T15:07:43.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:43.482 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:43.483 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:43.484 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:43.484 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:45.156 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:07:45.159 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:07:48.792 INFO:teuthology.orchestra.run.smithi152.stdout:generic/028 5s 2024-03-18T15:07:48.801 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/028 2024-03-18T15:07:48.802 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:48.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:48.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:48.827 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2024-03-18T15:07:49.087 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:49.092 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:49.093 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:49.094 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:49.094 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:52.826 INFO:teuthology.orchestra.run.smithi152.stdout:generic/029 3s 2024-03-18T15:07:52.834 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/029 2024-03-18T15:07:52.834 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:52.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:52.848 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:52.848 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2024-03-18T15:07:53.101 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:53.106 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:53.107 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:53.108 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:53.108 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:54.372 INFO:teuthology.orchestra.run.smithi152.stdout:generic/030 1s 2024-03-18T15:07:54.380 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/030 2024-03-18T15:07:54.380 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:54.384 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:54.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:54.395 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2024-03-18T15:07:54.652 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:54.657 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:54.657 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:54.659 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:54.659 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:55.016 INFO:teuthology.orchestra.run.smithi152.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T15:07:55.022 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/031 2024-03-18T15:07:55.022 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/031 2024-03-18T15:07:55.022 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:55.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:55.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:55.049 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2024-03-18T15:07:55.311 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:55.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:55.317 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:55.319 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:55.319 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:55.621 INFO:teuthology.orchestra.run.smithi152.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:07:55.626 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/032 2024-03-18T15:07:55.626 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/032 2024-03-18T15:07:55.626 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:55.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:55.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:55.649 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2024-03-18T15:07:55.904 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:55.909 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:55.909 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:55.911 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:55.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:56.281 INFO:teuthology.orchestra.run.smithi152.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T15:07:56.287 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/033 2024-03-18T15:07:56.287 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/033 2024-03-18T15:07:56.287 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:56.291 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:56.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:56.317 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2024-03-18T15:07:56.570 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:56.575 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:56.576 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:56.577 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:56.577 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:56.874 INFO:teuthology.orchestra.run.smithi152.stdout:generic/034 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:07:56.879 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/034 2024-03-18T15:07:56.880 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/034 2024-03-18T15:07:56.880 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:56.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:56.899 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:56.899 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2024-03-18T15:07:57.156 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:57.163 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:57.164 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:57.164 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:57.165 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:57.532 INFO:teuthology.orchestra.run.smithi152.stdout:generic/035 0s 2024-03-18T15:07:57.539 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/035 2024-03-18T15:07:57.539 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:07:57.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:07:57.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:07:57.582 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2024-03-18T15:07:57.891 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:07:57.898 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:07:57.899 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:07:57.901 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:07:57.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:08.293 INFO:teuthology.orchestra.run.smithi152.stdout:generic/036 10s 2024-03-18T15:08:08.302 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/036 2024-03-18T15:08:08.302 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:08.305 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:08.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:08.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2024-03-18T15:08:08.645 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:08.651 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:08.651 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:08.652 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:08.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:14.038 INFO:teuthology.orchestra.run.smithi152.stdout:generic/037 6s 2024-03-18T15:08:14.045 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/037 2024-03-18T15:08:14.045 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:14.048 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:14.060 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:14.060 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2024-03-18T15:08:14.318 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:14.324 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:14.325 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:14.326 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:14.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:14.625 INFO:teuthology.orchestra.run.smithi152.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:08:14.631 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/038 2024-03-18T15:08:14.631 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/038 2024-03-18T15:08:14.631 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:14.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:14.652 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:14.653 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2024-03-18T15:08:14.905 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:14.911 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:14.911 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:14.912 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:14.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:15.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:08:15.220 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:08:15.230 INFO:teuthology.orchestra.run.smithi152.stdout:generic/039 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:15.235 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/039 2024-03-18T15:08:15.235 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/039 2024-03-18T15:08:15.235 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:15.240 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:15.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:15.265 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2024-03-18T15:08:15.580 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:15.586 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:15.587 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:15.588 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:15.588 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:15.897 INFO:teuthology.orchestra.run.smithi152.stdout:generic/040 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:15.903 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/040 2024-03-18T15:08:15.903 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/040 2024-03-18T15:08:15.903 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:15.906 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:15.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:15.927 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2024-03-18T15:08:16.180 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:16.185 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:16.186 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:16.187 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:16.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:16.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/041 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:16.511 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/041 2024-03-18T15:08:16.511 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/041 2024-03-18T15:08:16.511 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:16.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:16.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:16.537 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2024-03-18T15:08:16.790 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:16.795 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:16.796 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:16.797 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:16.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:17.159 INFO:teuthology.orchestra.run.smithi152.stdout:generic/042 [not run] ceph does not support shutdown 2024-03-18T15:08:17.170 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/042 2024-03-18T15:08:17.170 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/042 2024-03-18T15:08:17.171 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:17.175 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:17.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:17.190 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2024-03-18T15:08:17.442 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:17.448 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:17.449 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:17.451 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:17.451 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:17.821 INFO:teuthology.orchestra.run.smithi152.stdout:generic/043 [not run] ceph does not support shutdown 2024-03-18T15:08:17.830 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/043 2024-03-18T15:08:17.830 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/043 2024-03-18T15:08:17.830 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:17.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:17.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:17.849 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2024-03-18T15:08:18.114 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:18.120 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:18.121 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:18.122 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:18.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:18.507 INFO:teuthology.orchestra.run.smithi152.stdout:generic/044 [not run] ceph does not support shutdown 2024-03-18T15:08:18.517 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/044 2024-03-18T15:08:18.517 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/044 2024-03-18T15:08:18.517 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:18.520 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:18.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:18.536 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2024-03-18T15:08:18.783 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:18.788 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:18.789 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:18.790 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:18.790 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:19.163 INFO:teuthology.orchestra.run.smithi152.stdout:generic/045 [not run] ceph does not support shutdown 2024-03-18T15:08:19.171 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/045 2024-03-18T15:08:19.171 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/045 2024-03-18T15:08:19.171 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:19.174 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:19.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:19.191 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2024-03-18T15:08:19.454 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:19.459 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:19.460 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:19.461 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:19.461 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:19.829 INFO:teuthology.orchestra.run.smithi152.stdout:generic/046 [not run] ceph does not support shutdown 2024-03-18T15:08:19.846 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/046 2024-03-18T15:08:19.846 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/046 2024-03-18T15:08:19.846 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:19.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:19.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:19.865 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2024-03-18T15:08:20.124 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:20.130 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:20.131 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:20.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:20.498 INFO:teuthology.orchestra.run.smithi152.stdout:generic/047 [not run] ceph does not support shutdown 2024-03-18T15:08:20.511 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/047 2024-03-18T15:08:20.511 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/047 2024-03-18T15:08:20.512 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:20.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:20.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:20.529 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2024-03-18T15:08:20.794 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:20.799 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:20.799 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:20.800 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:20.800 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:21.184 INFO:teuthology.orchestra.run.smithi152.stdout:generic/048 [not run] ceph does not support shutdown 2024-03-18T15:08:21.195 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/048 2024-03-18T15:08:21.195 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/048 2024-03-18T15:08:21.195 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:21.198 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:21.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:21.216 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2024-03-18T15:08:21.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:21.484 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:21.484 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:21.486 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:21.486 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:21.847 INFO:teuthology.orchestra.run.smithi152.stdout:generic/049 [not run] ceph does not support shutdown 2024-03-18T15:08:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/049 2024-03-18T15:08:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/049 2024-03-18T15:08:21.867 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:21.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:21.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:21.884 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2024-03-18T15:08:22.173 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:22.178 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:22.179 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:22.180 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:22.180 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:22.556 INFO:teuthology.orchestra.run.smithi152.stdout:generic/050 [not run] ceph does not support shutdown 2024-03-18T15:08:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/050 2024-03-18T15:08:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/050 2024-03-18T15:08:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:22.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:22.599 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:22.600 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2024-03-18T15:08:22.865 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:22.870 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:22.870 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:22.872 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:22.872 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:23.250 INFO:teuthology.orchestra.run.smithi152.stdout:generic/051 [not run] ceph does not support shutdown 2024-03-18T15:08:23.255 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/051 2024-03-18T15:08:23.255 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/051 2024-03-18T15:08:23.255 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:23.259 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:23.275 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:23.275 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2024-03-18T15:08:23.543 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:23.550 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:23.551 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:23.945 INFO:teuthology.orchestra.run.smithi152.stdout:generic/052 [not run] ceph does not support shutdown 2024-03-18T15:08:23.964 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/052 2024-03-18T15:08:23.964 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/052 2024-03-18T15:08:23.964 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:23.967 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:23.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:23.982 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2024-03-18T15:08:24.238 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:24.242 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:24.243 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:24.244 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:24.244 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:24.930 INFO:teuthology.orchestra.run.smithi152.stdout:generic/053 0s 2024-03-18T15:08:24.946 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/053 2024-03-18T15:08:24.947 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:24.953 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:24.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:24.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2024-03-18T15:08:25.222 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:25.227 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:25.228 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:25.229 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:25.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:25.619 INFO:teuthology.orchestra.run.smithi152.stdout:generic/054 [not run] ceph does not support shutdown 2024-03-18T15:08:25.627 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/054 2024-03-18T15:08:25.627 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/054 2024-03-18T15:08:25.627 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:25.630 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:25.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:25.654 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2024-03-18T15:08:25.909 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:25.914 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:25.914 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:25.916 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:25.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:26.308 INFO:teuthology.orchestra.run.smithi152.stdout:generic/055 [not run] ceph does not support shutdown 2024-03-18T15:08:26.319 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/055 2024-03-18T15:08:26.319 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/055 2024-03-18T15:08:26.319 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:26.322 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:26.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:26.337 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2024-03-18T15:08:26.596 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:26.604 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:26.605 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:26.606 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:26.606 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:26.906 INFO:teuthology.orchestra.run.smithi152.stdout:generic/056 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:26.911 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/056 2024-03-18T15:08:26.911 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/056 2024-03-18T15:08:26.912 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:26.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:26.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:26.935 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2024-03-18T15:08:27.192 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:27.198 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:27.199 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:27.200 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:27.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:27.509 INFO:teuthology.orchestra.run.smithi152.stdout:generic/057 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:27.514 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/057 2024-03-18T15:08:27.515 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/057 2024-03-18T15:08:27.515 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:27.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:27.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:27.540 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2024-03-18T15:08:27.797 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:27.803 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:27.803 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:27.804 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:27.804 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:28.179 INFO:teuthology.orchestra.run.smithi152.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:08:28.184 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/058 2024-03-18T15:08:28.184 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/058 2024-03-18T15:08:28.184 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:28.190 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:28.218 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:28.218 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2024-03-18T15:08:28.573 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:28.578 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:28.579 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:28.581 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:28.581 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:28.886 INFO:teuthology.orchestra.run.smithi152.stdout:generic/059 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:28.892 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/059 2024-03-18T15:08:28.892 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/059 2024-03-18T15:08:28.892 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:28.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:28.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:28.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2024-03-18T15:08:29.173 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:29.179 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:29.179 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:29.181 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:29.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:29.568 INFO:teuthology.orchestra.run.smithi152.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:08:29.573 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/060 2024-03-18T15:08:29.573 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/060 2024-03-18T15:08:29.573 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:29.576 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:29.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:29.611 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2024-03-18T15:08:29.930 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:29.935 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:29.936 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:29.937 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:29.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:30.323 INFO:teuthology.orchestra.run.smithi152.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:08:30.328 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/061 2024-03-18T15:08:30.328 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/061 2024-03-18T15:08:30.328 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:30.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:30.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:30.372 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2024-03-18T15:08:30.684 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:30.689 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:30.690 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:30.691 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:30.691 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:32.572 INFO:teuthology.orchestra.run.smithi152.stdout:generic/062 2s 2024-03-18T15:08:32.578 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/062 2024-03-18T15:08:32.578 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:32.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:32.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:32.596 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2024-03-18T15:08:32.879 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:32.884 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:32.885 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:32.886 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:32.886 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:33.358 INFO:teuthology.orchestra.run.smithi152.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:08:33.366 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/063 2024-03-18T15:08:33.366 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/063 2024-03-18T15:08:33.366 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:33.370 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:33.405 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:33.405 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2024-03-18T15:08:33.725 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:33.731 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:33.731 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:33.732 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:33.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:34.034 INFO:teuthology.orchestra.run.smithi152.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:08:34.039 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/064 2024-03-18T15:08:34.040 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/064 2024-03-18T15:08:34.040 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:34.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:34.064 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:34.064 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2024-03-18T15:08:34.324 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:34.329 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:34.332 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:34.333 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:34.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:34.652 INFO:teuthology.orchestra.run.smithi152.stdout:generic/065 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:34.658 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/065 2024-03-18T15:08:34.658 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/065 2024-03-18T15:08:34.658 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:34.661 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:34.681 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:34.681 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2024-03-18T15:08:34.934 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:34.939 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:34.940 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:34.942 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:34.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:35.239 INFO:teuthology.orchestra.run.smithi152.stdout:generic/066 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:35.244 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/066 2024-03-18T15:08:35.244 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/066 2024-03-18T15:08:35.244 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:35.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:35.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:35.264 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2024-03-18T15:08:35.529 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:35.534 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:35.534 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:35.536 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:35.536 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:35.837 INFO:teuthology.orchestra.run.smithi152.stdout:generic/067 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:08:35.843 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/067 2024-03-18T15:08:35.843 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/067 2024-03-18T15:08:35.843 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:35.846 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:35.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:35.864 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2024-03-18T15:08:36.123 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:36.129 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:36.129 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:36.131 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:36.131 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:36.423 INFO:teuthology.orchestra.run.smithi152.stdout:generic/068 [not run] ceph does not support freezing 2024-03-18T15:08:36.428 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/068 2024-03-18T15:08:36.428 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/068 2024-03-18T15:08:36.428 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:36.431 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:36.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:36.455 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2024-03-18T15:08:36.712 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:36.719 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:36.719 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:36.719 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:36.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:43.827 INFO:teuthology.orchestra.run.smithi152.stdout:generic/069 7s 2024-03-18T15:08:43.834 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/069 2024-03-18T15:08:43.834 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:08:43.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:43.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:08:43.852 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2024-03-18T15:08:44.136 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:08:44.142 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:08:44.142 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:08:44.143 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:08:44.144 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:08:45.287 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:08:45.290 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:09:10.478 INFO:teuthology.orchestra.run.smithi152.stdout:generic/070 26s 2024-03-18T15:09:10.487 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/070 2024-03-18T15:09:10.487 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:10.493 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:10.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:10.579 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2024-03-18T15:09:10.880 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:10.887 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:10.888 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:10.889 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:10.890 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:11.203 INFO:teuthology.orchestra.run.smithi152.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T15:09:11.208 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/071 2024-03-18T15:09:11.208 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/071 2024-03-18T15:09:11.208 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:11.212 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:11.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:11.232 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2024-03-18T15:09:11.491 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:11.496 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:11.497 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:11.498 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:11.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:11.853 INFO:teuthology.orchestra.run.smithi152.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T15:09:11.858 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/072 2024-03-18T15:09:11.858 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/072 2024-03-18T15:09:11.859 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:11.862 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:11.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:11.883 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2024-03-18T15:09:12.144 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:12.149 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:12.150 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:12.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:12.446 INFO:teuthology.orchestra.run.smithi152.stdout:generic/073 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:09:12.453 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/073 2024-03-18T15:09:12.453 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/073 2024-03-18T15:09:12.453 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:12.456 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:12.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:12.470 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2024-03-18T15:09:12.729 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:12.734 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:12.734 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:12.736 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:12.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:15.923 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:09:15.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:09:15.994 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T15:09:15.994+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159307) UID: 0 2024-03-18T15:09:15.996 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:09:15.994+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 159307) UID: 0 2024-03-18T15:09:29.661 INFO:teuthology.orchestra.run.smithi152.stdout:generic/074 17s 2024-03-18T15:09:29.668 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/074 2024-03-18T15:09:29.668 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:29.672 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:30.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:30.703 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2024-03-18T15:09:31.035 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:31.041 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:31.041 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:31.043 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:31.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:54.390 INFO:teuthology.orchestra.run.smithi152.stdout:generic/075 23s 2024-03-18T15:09:54.398 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/075 2024-03-18T15:09:54.398 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:54.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:54.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:54.445 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2024-03-18T15:09:54.795 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:54.801 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:54.801 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:54.803 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:54.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:55.092 INFO:teuthology.orchestra.run.smithi152.stdout:generic/076 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T15:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/076 2024-03-18T15:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/076 2024-03-18T15:09:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:55.101 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:55.115 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:55.115 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2024-03-18T15:09:55.392 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:55.397 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:55.398 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:55.399 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:55.399 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:56.610 INFO:teuthology.orchestra.run.smithi152.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:09:56.615 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/077 2024-03-18T15:09:56.616 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/077 2024-03-18T15:09:56.616 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:56.619 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:56.661 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:56.661 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2024-03-18T15:09:57.036 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:57.041 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:57.042 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:57.044 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:57.383 INFO:teuthology.orchestra.run.smithi152.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2024-03-18T15:09:57.390 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/078 2024-03-18T15:09:57.390 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/078 2024-03-18T15:09:57.390 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:57.394 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:57.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:57.420 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2024-03-18T15:09:57.776 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:57.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:57.782 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:57.783 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:57.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:58.099 INFO:teuthology.orchestra.run.smithi152.stdout:generic/079 [not run] file system doesn't support chattr +ia 2024-03-18T15:09:58.106 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/079 2024-03-18T15:09:58.106 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/079 2024-03-18T15:09:58.106 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:09:58.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:09:58.133 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:09:58.133 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2024-03-18T15:09:58.406 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:09:58.412 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:09:58.413 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:09:58.414 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:09:58.414 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:00.793 INFO:teuthology.orchestra.run.smithi152.stdout:generic/080 2s 2024-03-18T15:10:00.800 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/080 2024-03-18T15:10:00.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:00.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:00.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:00.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2024-03-18T15:10:01.108 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:01.114 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:01.114 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:01.115 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:01.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:01.493 INFO:teuthology.orchestra.run.smithi152.stdout:generic/081 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:10:01.498 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/081 2024-03-18T15:10:01.498 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/081 2024-03-18T15:10:01.498 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:01.501 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:01.516 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:01.516 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2024-03-18T15:10:01.814 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:01.821 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:01.822 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:01.823 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:01.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:02.138 INFO:teuthology.orchestra.run.smithi152.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:10:02.144 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/082 2024-03-18T15:10:02.144 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/082 2024-03-18T15:10:02.144 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:02.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:02.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:02.166 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2024-03-18T15:10:02.451 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:02.464 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:02.466 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:02.468 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:02.468 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:02.783 INFO:teuthology.orchestra.run.smithi152.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:10:02.791 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/083 2024-03-18T15:10:02.791 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/083 2024-03-18T15:10:02.791 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:02.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:02.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:02.808 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2024-03-18T15:10:03.080 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:03.084 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:03.085 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:03.086 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:03.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:08.691 INFO:teuthology.orchestra.run.smithi152.stdout:generic/084 5s 2024-03-18T15:10:08.697 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/084 2024-03-18T15:10:08.697 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:08.700 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:08.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:08.714 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2024-03-18T15:10:09.059 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:09.064 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:09.064 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:09.066 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:09.066 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:09.392 INFO:teuthology.orchestra.run.smithi152.stdout:generic/085 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:10:09.399 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/085 2024-03-18T15:10:09.399 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/085 2024-03-18T15:10:09.399 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:09.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:09.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:09.420 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2024-03-18T15:10:09.715 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:09.721 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:09.722 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:09.724 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:09.724 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:10.041 INFO:teuthology.orchestra.run.smithi152.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:10:10.048 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/086 2024-03-18T15:10:10.048 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/086 2024-03-18T15:10:10.048 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:10.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:10.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:10.069 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2024-03-18T15:10:10.350 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:10.355 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:10.356 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:10.357 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:10.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:10.796 INFO:teuthology.orchestra.run.smithi152.stdout:generic/087 0s 2024-03-18T15:10:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/087 2024-03-18T15:10:10.805 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:10.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:10.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:10.889 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2024-03-18T15:10:11.250 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:11.256 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:11.256 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:11.260 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:11.260 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:11.616 INFO:teuthology.orchestra.run.smithi152.stdout:generic/088 0s 2024-03-18T15:10:11.624 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/088 2024-03-18T15:10:11.624 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:10:11.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:10:11.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:10:11.679 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2024-03-18T15:10:12.039 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:10:12.044 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:10:12.045 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:10:12.046 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:10:12.046 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:12:23.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:12:23.099 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:12:53.507 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:12:53.511 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:13:23.588 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:13:23.596 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:13:53.797 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:13:53.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:14:24.293 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:14:24.295 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:14:54.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:14:54.359 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:14:54.422 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T15:14:54.421+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169984) UID: 0 2024-03-18T15:14:54.423 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:14:54.421+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 169984) UID: 0 2024-03-18T15:18:08.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:18:08.273 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:18:38.565 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:18:38.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:18:38.621 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T15:18:38.621+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 172035) UID: 0 2024-03-18T15:18:38.622 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:18:38.621+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 172035) UID: 0 2024-03-18T15:19:31.807 INFO:teuthology.orchestra.run.smithi152.stdout:generic/089 559s 2024-03-18T15:19:31.852 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/089 2024-03-18T15:19:31.853 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:19:31.855 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:19:32.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:19:32.103 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2024-03-18T15:19:32.881 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:19:32.885 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:19:32.885 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:19:32.886 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:19:32.886 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:19:33.128 INFO:teuthology.orchestra.run.smithi152.stdout:generic/090 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:19:33.131 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/090 2024-03-18T15:19:33.132 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/090 2024-03-18T15:19:33.132 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:19:33.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:19:33.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:19:33.149 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2024-03-18T15:19:33.337 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:19:33.340 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:19:33.341 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:19:33.342 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:19:33.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:10.441 INFO:teuthology.orchestra.run.smithi152.stdout:generic/091 97s 2024-03-18T15:21:10.446 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/091 2024-03-18T15:21:10.446 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:10.448 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:10.514 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:10.515 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2024-03-18T15:21:10.943 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:10.948 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:10.948 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:10.949 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:10.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:11.181 INFO:teuthology.orchestra.run.smithi152.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:21:11.185 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/092 2024-03-18T15:21:11.185 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/092 2024-03-18T15:21:11.185 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:11.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:11.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:11.201 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2024-03-18T15:21:11.375 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:11.379 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:11.379 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:11.380 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:11.380 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:14.242 INFO:teuthology.orchestra.run.smithi152.stdout:generic/093 3s 2024-03-18T15:21:14.247 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/093 2024-03-18T15:21:14.247 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:14.250 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:14.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:14.304 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2024-03-18T15:21:14.715 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:14.719 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:14.720 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:14.720 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:14.720 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:14.992 INFO:teuthology.orchestra.run.smithi152.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:21:14.996 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/094 2024-03-18T15:21:14.996 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/094 2024-03-18T15:21:14.996 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:14.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:15.044 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:15.044 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2024-03-18T15:21:15.439 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:15.441 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:15.442 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:15.443 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:15.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:26.219 INFO:teuthology.orchestra.run.smithi152.stdout:generic/095 11s 2024-03-18T15:21:26.227 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/095 2024-03-18T15:21:26.228 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:26.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:26.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:26.244 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2024-03-18T15:21:26.466 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:26.470 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:26.470 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:26.472 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:26.472 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:26.757 INFO:teuthology.orchestra.run.smithi152.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T15:21:26.761 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/096 2024-03-18T15:21:26.761 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/096 2024-03-18T15:21:26.761 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:26.763 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:26.781 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:26.781 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2024-03-18T15:21:26.973 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:26.977 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:26.977 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:26.978 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:26.978 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:27.678 INFO:teuthology.orchestra.run.smithi152.stdout:generic/097 0s 2024-03-18T15:21:27.684 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/097 2024-03-18T15:21:27.684 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:27.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:27.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:27.698 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2024-03-18T15:21:27.875 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:27.879 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:27.879 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:27.880 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:27.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:29.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/098 2s 2024-03-18T15:21:29.831 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/098 2024-03-18T15:21:29.831 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:29.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:29.842 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:29.842 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2024-03-18T15:21:30.035 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:30.038 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:30.039 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:30.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:30.769 INFO:teuthology.orchestra.run.smithi152.stdout:generic/099 0s 2024-03-18T15:21:30.774 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/099 2024-03-18T15:21:30.774 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:30.777 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:30.833 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:30.833 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2024-03-18T15:21:31.234 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:31.237 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:31.238 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:31.239 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:31.239 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:42.421 INFO:teuthology.orchestra.run.smithi152.stdout:generic/100 11s 2024-03-18T15:21:42.426 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/100 2024-03-18T15:21:42.426 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:44.180 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:21:44.184 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:21:45.947 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:45.947 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2024-03-18T15:21:46.314 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:46.316 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:46.317 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:46.318 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:46.318 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:46.549 INFO:teuthology.orchestra.run.smithi152.stdout:generic/101 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:21:46.552 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/101 2024-03-18T15:21:46.552 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/101 2024-03-18T15:21:46.553 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:46.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:46.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:46.568 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2024-03-18T15:21:46.745 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:46.749 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:46.750 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:46.750 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:46.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:46.966 INFO:teuthology.orchestra.run.smithi152.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:21:46.969 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/102 2024-03-18T15:21:46.970 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/102 2024-03-18T15:21:46.970 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:46.972 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:46.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:46.985 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2024-03-18T15:21:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:47.171 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:47.171 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:47.172 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:47.172 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:47.397 INFO:teuthology.orchestra.run.smithi152.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:21:47.400 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/103 2024-03-18T15:21:47.401 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/103 2024-03-18T15:21:47.401 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:47.403 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:47.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:47.464 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2024-03-18T15:21:47.848 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:47.853 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:47.853 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:47.855 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:47.855 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:48.116 INFO:teuthology.orchestra.run.smithi152.stdout:generic/104 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:21:48.120 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/104 2024-03-18T15:21:48.120 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/104 2024-03-18T15:21:48.121 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:48.123 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:48.139 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:48.140 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2024-03-18T15:21:48.320 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:48.324 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:48.324 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:48.326 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:48.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:48.887 INFO:teuthology.orchestra.run.smithi152.stdout:generic/105 0s 2024-03-18T15:21:48.897 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/105 2024-03-18T15:21:48.897 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:48.900 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:48.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:48.913 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2024-03-18T15:21:49.262 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:49.267 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:49.268 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:49.269 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:49.269 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:49.531 INFO:teuthology.orchestra.run.smithi152.stdout:generic/106 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:21:49.535 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/106 2024-03-18T15:21:49.535 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/106 2024-03-18T15:21:49.535 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:49.537 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:49.554 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:49.555 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2024-03-18T15:21:49.739 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:49.742 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:49.743 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:49.744 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:49.744 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:49.972 INFO:teuthology.orchestra.run.smithi152.stdout:generic/107 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:21:49.976 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/107 2024-03-18T15:21:49.976 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/107 2024-03-18T15:21:49.976 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:49.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:49.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:49.996 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2024-03-18T15:21:50.177 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:50.181 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:50.181 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:50.183 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:50.183 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:50.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/108 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:21:50.646 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/108 2024-03-18T15:21:50.646 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/108 2024-03-18T15:21:50.646 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:21:50.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:21:50.662 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:21:50.662 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2024-03-18T15:21:50.846 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:21:50.850 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:21:50.851 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:21:50.852 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:21:50.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:01.792 INFO:teuthology.orchestra.run.smithi152.stdout:generic/109 11s 2024-03-18T15:22:01.797 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/109 2024-03-18T15:22:01.797 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:01.800 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:01.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:01.809 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2024-03-18T15:22:02.691 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:02.695 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:02.695 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:02.697 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:02.697 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:14.274 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:22:14.277 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:22:21.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:22:21.651 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/110 2024-03-18T15:22:21.651 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/110 2024-03-18T15:22:21.651 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:21.654 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:21.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:21.735 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2024-03-18T15:22:22.247 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:22.256 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:22.256 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:22.258 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:22.258 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:22.573 INFO:teuthology.orchestra.run.smithi152.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:22:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/111 2024-03-18T15:22:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/111 2024-03-18T15:22:22.577 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:22.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:22.627 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:22.627 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2024-03-18T15:22:23.010 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:23.015 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:23.016 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:23.017 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:23.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:38.112 INFO:teuthology.orchestra.run.smithi152.stdout:generic/112 15s 2024-03-18T15:22:38.117 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/112 2024-03-18T15:22:38.117 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:38.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:38.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:38.201 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2024-03-18T15:22:38.566 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:38.571 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:38.571 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:38.572 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:38.572 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:44.407 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:22:44.410 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:22:53.934 INFO:teuthology.orchestra.run.smithi152.stdout:generic/113 15s 2024-03-18T15:22:54.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/113 2024-03-18T15:22:54.008 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:54.010 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:54.057 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:54.057 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2024-03-18T15:22:54.499 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:54.502 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:54.503 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:54.504 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:54.504 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:55.036 INFO:teuthology.orchestra.run.smithi152.stdout:generic/114 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:22:55.040 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/114 2024-03-18T15:22:55.040 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/114 2024-03-18T15:22:55.040 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:55.042 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:55.063 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:55.063 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2024-03-18T15:22:55.235 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:55.238 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:55.239 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:55.239 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:55.240 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:55.561 INFO:teuthology.orchestra.run.smithi152.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:22:55.565 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/115 2024-03-18T15:22:55.565 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/115 2024-03-18T15:22:55.565 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:55.567 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:55.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:55.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2024-03-18T15:22:55.978 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:55.982 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:55.983 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:55.983 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:56.235 INFO:teuthology.orchestra.run.smithi152.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:22:56.239 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/116 2024-03-18T15:22:56.239 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/116 2024-03-18T15:22:56.239 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:22:56.242 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:22:56.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:22:56.313 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2024-03-18T15:22:56.689 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:22:56.693 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:22:56.694 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:22:56.695 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:22:56.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:08.325 INFO:teuthology.orchestra.run.smithi152.stdout:generic/117 12s 2024-03-18T15:23:08.336 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/117 2024-03-18T15:23:08.336 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:08.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:08.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:08.360 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2024-03-18T15:23:08.604 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:08.608 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:08.608 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:08.609 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:08.609 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:09.253 INFO:teuthology.orchestra.run.smithi152.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:23:09.261 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/118 2024-03-18T15:23:09.261 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/118 2024-03-18T15:23:09.261 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:09.265 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:09.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:09.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2024-03-18T15:23:09.698 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:09.704 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:09.704 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:09.706 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:09.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:09.955 INFO:teuthology.orchestra.run.smithi152.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:23:09.959 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/119 2024-03-18T15:23:09.959 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/119 2024-03-18T15:23:09.959 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:09.961 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:10.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:10.015 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2024-03-18T15:23:10.394 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:10.398 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:10.398 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:10.399 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:10.399 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:10.609 INFO:teuthology.orchestra.run.smithi152.stdout:generic/120 [not run] atime not maintained by ceph 2024-03-18T15:23:10.613 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/120 2024-03-18T15:23:10.613 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/120 2024-03-18T15:23:10.613 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:10.615 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:10.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:10.626 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2024-03-18T15:23:10.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:10.807 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:10.807 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:10.808 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:10.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:11.040 INFO:teuthology.orchestra.run.smithi152.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:23:11.044 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/121 2024-03-18T15:23:11.044 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/121 2024-03-18T15:23:11.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:11.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:11.101 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:11.102 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2024-03-18T15:23:11.460 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:11.464 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:11.464 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:11.465 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:11.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:11.732 INFO:teuthology.orchestra.run.smithi152.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:23:11.736 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/122 2024-03-18T15:23:11.736 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/122 2024-03-18T15:23:11.737 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:11.739 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:11.783 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:11.784 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2024-03-18T15:23:12.142 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:12.147 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:12.148 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:12.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:12.701 INFO:teuthology.orchestra.run.smithi152.stdout:generic/123 0s 2024-03-18T15:23:12.706 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/123 2024-03-18T15:23:12.706 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:12.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:12.768 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:12.768 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2024-03-18T15:23:13.129 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:13.133 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:13.134 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:13.135 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:13.135 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:14.499 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:23:14.502 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:23:14.920 INFO:teuthology.orchestra.run.smithi152.stdout:generic/124 1s 2024-03-18T15:23:14.930 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/124 2024-03-18T15:23:14.930 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:23:14.932 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:15.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:23:15.637 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2024-03-18T15:23:16.044 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:23:16.050 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:23:16.051 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:23:16.052 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:23:16.052 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:23:44.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:23:44.567 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:24:14.702 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:24:14.705 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:24:17.537 INFO:teuthology.orchestra.run.smithi152.stdout:generic/125 61s 2024-03-18T15:24:17.542 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/125 2024-03-18T15:24:17.542 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:24:17.545 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:24:17.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:24:17.569 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2024-03-18T15:24:17.967 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:24:17.971 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:24:17.971 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:24:17.972 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:24:17.972 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:24:18.407 INFO:teuthology.orchestra.run.smithi152.stdout:generic/126 0s 2024-03-18T15:24:18.412 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/126 2024-03-18T15:24:18.413 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:24:18.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:24:18.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:24:18.498 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2024-03-18T15:24:18.944 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:24:18.949 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:24:18.949 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:24:18.951 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:24:18.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:24:44.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:24:44.804 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:25:14.866 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:25:14.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:25:44.995 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:25:44.999 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:26:15.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:26:15.175 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:26:45.268 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:26:45.271 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:27:15.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:27:15.377 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:27:45.487 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:27:45.490 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:28:15.699 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:28:15.702 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:28:45.855 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:28:45.861 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:29:16.071 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:29:16.074 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:29:46.208 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:29:46.210 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:30:16.281 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:30:16.284 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:30:46.395 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:30:46.399 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:31:16.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:31:16.512 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:31:46.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:31:46.662 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:32:17.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:32:17.052 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:32:47.118 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:32:47.121 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:33:17.176 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:33:17.179 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:33:31.173 INFO:teuthology.orchestra.run.smithi152.stdout:generic/127 552s 2024-03-18T15:33:31.178 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/127 2024-03-18T15:33:31.178 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:31.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:31.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:31.226 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2024-03-18T15:33:31.593 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:31.599 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:31.600 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:31.601 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:31.601 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:32.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/128 1s 2024-03-18T15:33:32.574 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/128 2024-03-18T15:33:32.574 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:32.577 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:32.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:32.589 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2024-03-18T15:33:32.812 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:32.815 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:32.816 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:32.817 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:32.817 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:33.050 INFO:teuthology.orchestra.run.smithi152.stdout:generic/129 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:33:33.054 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/129 2024-03-18T15:33:33.054 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/129 2024-03-18T15:33:33.054 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:33.056 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:33.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:33.082 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2024-03-18T15:33:33.276 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:33.279 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:33.280 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:33.281 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:33.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:33.503 INFO:teuthology.orchestra.run.smithi152.stdout:generic/130 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:33:33.507 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/130 2024-03-18T15:33:33.507 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/130 2024-03-18T15:33:33.507 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:33.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:33.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:33.530 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2024-03-18T15:33:33.703 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:33.707 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:33.707 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:33.708 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:35.052 INFO:teuthology.orchestra.run.smithi152.stdout:generic/131 2s 2024-03-18T15:33:35.057 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/131 2024-03-18T15:33:35.058 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:35.060 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:35.104 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:35.104 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2024-03-18T15:33:35.483 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:35.488 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:35.488 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:35.489 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:35.489 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:47.512 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:33:47.515 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:33:49.032 INFO:teuthology.orchestra.run.smithi152.stdout:generic/132 14s 2024-03-18T15:33:49.037 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/132 2024-03-18T15:33:49.038 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:33:49.040 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:33:49.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:33:49.049 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2024-03-18T15:33:49.251 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:33:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:33:49.255 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:33:49.256 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:33:49.256 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:34:17.652 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:34:17.655 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:34:47.799 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:34:47.803 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:35:17.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:35:17.949 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:35:48.070 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:35:48.073 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:36:18.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:36:18.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:36:48.345 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:36:48.348 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:37:18.470 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:37:18.473 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:37:37.258 INFO:teuthology.orchestra.run.smithi152.stdout:generic/133 228s 2024-03-18T15:37:37.263 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/133 2024-03-18T15:37:37.263 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:37.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:37.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:37.303 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2024-03-18T15:37:37.700 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:37.705 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:37.705 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:37.707 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:37.707 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:38.043 INFO:teuthology.orchestra.run.smithi152.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:38.047 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/134 2024-03-18T15:37:38.047 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/134 2024-03-18T15:37:38.048 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:38.050 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:38.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:38.086 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2024-03-18T15:37:38.445 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:38.450 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:38.451 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:38.452 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:38.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:39.245 INFO:teuthology.orchestra.run.smithi152.stdout:generic/135 1s 2024-03-18T15:37:39.250 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/135 2024-03-18T15:37:39.251 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:39.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:39.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:39.262 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2024-03-18T15:37:39.442 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:39.446 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:39.446 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:39.447 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:39.447 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:39.685 INFO:teuthology.orchestra.run.smithi152.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:37:39.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/136 2024-03-18T15:37:39.689 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/136 2024-03-18T15:37:39.689 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:39.691 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:39.745 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:39.745 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2024-03-18T15:37:40.128 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:40.132 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:40.133 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:40.134 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:40.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:40.403 INFO:teuthology.orchestra.run.smithi152.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/137 2024-03-18T15:37:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/137 2024-03-18T15:37:40.407 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:40.409 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:40.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:40.470 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2024-03-18T15:37:40.861 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:40.865 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:40.865 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:40.866 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:40.866 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:41.104 INFO:teuthology.orchestra.run.smithi152.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:41.108 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/138 2024-03-18T15:37:41.108 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/138 2024-03-18T15:37:41.108 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:41.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:41.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:41.155 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2024-03-18T15:37:41.550 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:41.554 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:41.554 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:41.555 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:41.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:41.803 INFO:teuthology.orchestra.run.smithi152.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:41.807 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/139 2024-03-18T15:37:41.807 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/139 2024-03-18T15:37:41.807 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:41.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:41.901 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:41.901 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2024-03-18T15:37:42.248 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:42.251 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:42.252 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:42.253 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:42.506 INFO:teuthology.orchestra.run.smithi152.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:42.509 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/140 2024-03-18T15:37:42.510 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/140 2024-03-18T15:37:42.510 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:42.567 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:42.568 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2024-03-18T15:37:42.936 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:42.940 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:42.940 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:42.941 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:42.941 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:43.302 INFO:teuthology.orchestra.run.smithi152.stdout:generic/141 0s 2024-03-18T15:37:43.307 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/141 2024-03-18T15:37:43.308 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:43.310 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:43.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:43.319 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2024-03-18T15:37:43.497 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:43.500 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:43.501 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:43.502 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:43.502 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:43.732 INFO:teuthology.orchestra.run.smithi152.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:43.736 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/142 2024-03-18T15:37:43.736 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/142 2024-03-18T15:37:43.736 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:43.739 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:43.798 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:43.799 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2024-03-18T15:37:44.145 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:44.148 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:44.148 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:44.149 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:44.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:44.406 INFO:teuthology.orchestra.run.smithi152.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:44.410 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/143 2024-03-18T15:37:44.410 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/143 2024-03-18T15:37:44.410 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:44.412 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:44.455 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:44.455 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2024-03-18T15:37:44.837 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:44.843 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:44.843 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:44.845 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:44.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:45.094 INFO:teuthology.orchestra.run.smithi152.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:45.098 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/144 2024-03-18T15:37:45.098 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/144 2024-03-18T15:37:45.098 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:45.100 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:45.184 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:45.184 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2024-03-18T15:37:45.551 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:45.555 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:45.555 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:45.556 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:45.556 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:45.795 INFO:teuthology.orchestra.run.smithi152.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:45.799 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/145 2024-03-18T15:37:45.799 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/145 2024-03-18T15:37:45.799 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:45.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:45.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:45.863 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2024-03-18T15:37:46.241 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:46.245 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:46.245 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:46.247 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:46.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:46.490 INFO:teuthology.orchestra.run.smithi152.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:46.494 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/146 2024-03-18T15:37:46.495 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/146 2024-03-18T15:37:46.495 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:46.497 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:46.547 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:46.547 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2024-03-18T15:37:46.917 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:46.921 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:46.922 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:46.923 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:46.923 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:47.165 INFO:teuthology.orchestra.run.smithi152.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:47.169 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/147 2024-03-18T15:37:47.170 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/147 2024-03-18T15:37:47.170 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:47.172 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:47.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:47.244 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2024-03-18T15:37:47.626 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:47.630 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:47.631 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:47.632 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:47.878 INFO:teuthology.orchestra.run.smithi152.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:47.881 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/148 2024-03-18T15:37:47.882 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/148 2024-03-18T15:37:47.882 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:47.884 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:47.923 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:47.923 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2024-03-18T15:37:48.344 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:48.347 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:48.348 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:48.349 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:48.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:48.592 INFO:teuthology.orchestra.run.smithi152.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:48.596 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/149 2024-03-18T15:37:48.596 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/149 2024-03-18T15:37:48.596 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:48.598 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:48.606 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:37:48.608 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:37:48.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:48.665 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2024-03-18T15:37:49.031 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:49.035 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:49.036 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:49.037 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:49.037 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:49.288 INFO:teuthology.orchestra.run.smithi152.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/150 2024-03-18T15:37:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/150 2024-03-18T15:37:49.292 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:49.294 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:49.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:49.352 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2024-03-18T15:37:49.710 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:49.716 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:49.716 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:49.717 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:49.718 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:49.977 INFO:teuthology.orchestra.run.smithi152.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:49.981 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/151 2024-03-18T15:37:49.981 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/151 2024-03-18T15:37:49.981 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:49.983 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:50.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:50.051 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2024-03-18T15:37:50.446 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:50.450 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:50.450 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:50.451 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:50.451 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:50.698 INFO:teuthology.orchestra.run.smithi152.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:50.702 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/152 2024-03-18T15:37:50.702 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/152 2024-03-18T15:37:50.703 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:50.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:50.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:50.757 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2024-03-18T15:37:51.116 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:51.120 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:51.121 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:51.122 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:51.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:51.366 INFO:teuthology.orchestra.run.smithi152.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:51.371 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/153 2024-03-18T15:37:51.371 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/153 2024-03-18T15:37:51.371 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:51.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:51.431 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:51.432 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2024-03-18T15:37:51.804 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:51.808 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:51.809 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:51.810 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:51.810 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/154 2024-03-18T15:37:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/154 2024-03-18T15:37:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:52.055 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:52.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:52.120 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2024-03-18T15:37:52.485 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:52.489 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:52.490 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:52.491 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:52.491 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:52.742 INFO:teuthology.orchestra.run.smithi152.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:52.746 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/155 2024-03-18T15:37:52.746 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/155 2024-03-18T15:37:52.746 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:52.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:52.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:52.807 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2024-03-18T15:37:53.181 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:53.185 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:53.185 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:53.186 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:53.186 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:53.437 INFO:teuthology.orchestra.run.smithi152.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/156 2024-03-18T15:37:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/156 2024-03-18T15:37:53.441 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:53.444 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:53.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:53.492 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2024-03-18T15:37:53.864 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:53.869 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:53.869 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:53.870 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:53.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:54.130 INFO:teuthology.orchestra.run.smithi152.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:37:54.134 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/157 2024-03-18T15:37:54.134 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/157 2024-03-18T15:37:54.134 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:54.136 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:54.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:54.192 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2024-03-18T15:37:54.569 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:54.573 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:54.573 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:54.575 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:54.575 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:54.820 INFO:teuthology.orchestra.run.smithi152.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:37:54.824 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/158 2024-03-18T15:37:54.824 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/158 2024-03-18T15:37:54.824 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:54.826 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:54.882 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:54.882 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2024-03-18T15:37:55.273 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:55.277 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:55.278 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:55.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:55.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:55.522 INFO:teuthology.orchestra.run.smithi152.stdout:generic/159 [not run] file system doesn't support chattr +i 2024-03-18T15:37:55.525 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/159 2024-03-18T15:37:55.526 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/159 2024-03-18T15:37:55.526 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:55.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:55.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:55.556 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2024-03-18T15:37:55.739 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:55.742 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:55.743 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:55.744 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:55.744 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:55.980 INFO:teuthology.orchestra.run.smithi152.stdout:generic/160 [not run] file system doesn't support chattr +i 2024-03-18T15:37:55.984 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/160 2024-03-18T15:37:55.984 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/160 2024-03-18T15:37:55.984 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:55.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:56.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:56.004 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2024-03-18T15:37:56.189 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:56.193 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:56.193 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:56.194 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:56.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:56.546 INFO:teuthology.orchestra.run.smithi152.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:37:56.553 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/161 2024-03-18T15:37:56.553 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/161 2024-03-18T15:37:56.553 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:56.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:56.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:56.802 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2024-03-18T15:37:57.021 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:57.025 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:57.025 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:57.026 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:57.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:57.339 INFO:teuthology.orchestra.run.smithi152.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T15:37:57.389 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/162 2024-03-18T15:37:57.389 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/162 2024-03-18T15:37:57.389 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:57.393 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:57.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:57.592 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2024-03-18T15:37:57.840 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:57.844 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:57.844 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:57.845 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:57.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:58.154 INFO:teuthology.orchestra.run.smithi152.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T15:37:58.217 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/163 2024-03-18T15:37:58.218 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/163 2024-03-18T15:37:58.218 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:58.223 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:58.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:58.479 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2024-03-18T15:37:58.692 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:58.696 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:58.697 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:58.698 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:58.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:59.049 INFO:teuthology.orchestra.run.smithi152.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:37:59.060 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/164 2024-03-18T15:37:59.060 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/164 2024-03-18T15:37:59.061 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:59.067 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:59.253 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:37:59.253 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2024-03-18T15:37:59.510 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:37:59.514 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:37:59.514 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:37:59.515 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:37:59.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:37:59.871 INFO:teuthology.orchestra.run.smithi152.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:37:59.879 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/165 2024-03-18T15:37:59.879 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/165 2024-03-18T15:37:59.879 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:37:59.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:00.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:00.148 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2024-03-18T15:38:00.364 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:00.368 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:00.369 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:00.369 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:00.370 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:00.747 INFO:teuthology.orchestra.run.smithi152.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:00.754 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/166 2024-03-18T15:38:00.754 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/166 2024-03-18T15:38:00.754 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:00.757 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:00.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:00.997 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2024-03-18T15:38:01.201 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:01.204 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:01.205 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:01.206 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:01.206 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:01.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:01.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/167 2024-03-18T15:38:01.571 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/167 2024-03-18T15:38:01.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:01.574 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:01.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:01.773 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2024-03-18T15:38:02.021 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:02.025 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:02.025 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:02.026 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:02.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:02.385 INFO:teuthology.orchestra.run.smithi152.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:02.391 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/168 2024-03-18T15:38:02.392 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/168 2024-03-18T15:38:02.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:02.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:02.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:02.641 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2024-03-18T15:38:02.863 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:02.867 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:02.867 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:02.868 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:02.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:03.302 INFO:teuthology.orchestra.run.smithi152.stdout:generic/169 1s 2024-03-18T15:38:03.308 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/169 2024-03-18T15:38:03.308 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:03.310 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:03.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:03.319 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2024-03-18T15:38:03.500 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:03.504 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:03.504 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:03.505 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:03.505 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:03.864 INFO:teuthology.orchestra.run.smithi152.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:03.869 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/170 2024-03-18T15:38:03.869 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/170 2024-03-18T15:38:03.870 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:03.874 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:03.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:03.993 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2024-03-18T15:38:04.284 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:04.288 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:04.288 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:04.289 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:04.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:04.666 INFO:teuthology.orchestra.run.smithi152.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/171 2024-03-18T15:38:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/171 2024-03-18T15:38:04.676 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:04.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:04.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:04.886 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2024-03-18T15:38:05.105 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:05.109 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:05.109 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:05.110 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:05.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:05.480 INFO:teuthology.orchestra.run.smithi152.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:05.487 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/172 2024-03-18T15:38:05.488 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/172 2024-03-18T15:38:05.488 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:05.490 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:05.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:05.706 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2024-03-18T15:38:05.937 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:05.940 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:05.941 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:05.942 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:05.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:06.316 INFO:teuthology.orchestra.run.smithi152.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:06.323 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/173 2024-03-18T15:38:06.323 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/173 2024-03-18T15:38:06.323 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:06.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:06.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:06.596 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2024-03-18T15:38:06.796 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:06.800 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:06.801 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:06.801 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:06.802 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:07.155 INFO:teuthology.orchestra.run.smithi152.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:07.161 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/174 2024-03-18T15:38:07.161 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/174 2024-03-18T15:38:07.161 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:07.165 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:07.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:07.318 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2024-03-18T15:38:07.604 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:07.607 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:07.608 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:07.609 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:07.609 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:08.032 INFO:teuthology.orchestra.run.smithi152.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:08.037 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/175 2024-03-18T15:38:08.038 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/175 2024-03-18T15:38:08.038 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:08.048 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:08.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:08.278 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2024-03-18T15:38:08.501 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:08.505 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:08.505 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:08.506 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:08.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:08.954 INFO:teuthology.orchestra.run.smithi152.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:08.960 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/176 2024-03-18T15:38:08.960 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/176 2024-03-18T15:38:08.960 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:08.963 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:09.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:09.170 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2024-03-18T15:38:09.410 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:09.413 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:09.414 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:09.415 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:09.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:09.765 INFO:teuthology.orchestra.run.smithi152.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:38:09.768 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/177 2024-03-18T15:38:09.769 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/177 2024-03-18T15:38:09.769 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:09.771 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:09.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:09.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2024-03-18T15:38:10.202 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:10.206 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:10.207 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:10.208 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:10.208 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:10.463 INFO:teuthology.orchestra.run.smithi152.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:38:10.467 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/178 2024-03-18T15:38:10.467 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/178 2024-03-18T15:38:10.467 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:10.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:10.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:10.522 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2024-03-18T15:38:10.935 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:10.938 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:10.939 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:10.940 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:10.940 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:11.187 INFO:teuthology.orchestra.run.smithi152.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:38:11.191 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/179 2024-03-18T15:38:11.191 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/179 2024-03-18T15:38:11.191 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:11.193 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:11.249 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:11.249 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2024-03-18T15:38:11.616 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:11.620 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:11.620 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:11.621 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:11.621 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:11.880 INFO:teuthology.orchestra.run.smithi152.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:38:11.884 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/180 2024-03-18T15:38:11.884 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/180 2024-03-18T15:38:11.884 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:11.887 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:11.940 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:11.940 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2024-03-18T15:38:12.314 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:12.318 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:12.318 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:12.319 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:12.319 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:12.581 INFO:teuthology.orchestra.run.smithi152.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:38:12.585 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/181 2024-03-18T15:38:12.585 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/181 2024-03-18T15:38:12.585 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:12.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:12.644 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:12.644 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2024-03-18T15:38:13.011 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:13.015 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:13.015 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:13.016 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:13.017 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:13.261 INFO:teuthology.orchestra.run.smithi152.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:38:13.265 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/182 2024-03-18T15:38:13.265 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/182 2024-03-18T15:38:13.265 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:13.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:13.323 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:13.323 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2024-03-18T15:38:13.714 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:13.718 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:13.718 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:13.719 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:13.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:14.088 INFO:teuthology.orchestra.run.smithi152.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:14.095 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/183 2024-03-18T15:38:14.095 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/183 2024-03-18T15:38:14.095 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:14.097 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:14.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:14.380 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2024-03-18T15:38:14.579 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:14.582 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:14.583 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:14.584 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:14.584 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:14.829 INFO:teuthology.orchestra.run.smithi152.stdout:generic/184 0s 2024-03-18T15:38:14.834 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/184 2024-03-18T15:38:14.834 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:14.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:14.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:14.855 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2024-03-18T15:38:15.036 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:15.040 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:15.040 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:15.041 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:15.041 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:15.385 INFO:teuthology.orchestra.run.smithi152.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:15.391 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/185 2024-03-18T15:38:15.391 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/185 2024-03-18T15:38:15.391 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:15.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:15.587 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:15.588 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2024-03-18T15:38:15.865 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:15.868 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:15.869 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:15.870 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:15.870 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:16.222 INFO:teuthology.orchestra.run.smithi152.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:16.229 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/186 2024-03-18T15:38:16.229 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/186 2024-03-18T15:38:16.229 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:16.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:16.439 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:16.439 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2024-03-18T15:38:16.708 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:16.712 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:16.713 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:16.713 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:17.063 INFO:teuthology.orchestra.run.smithi152.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:17.072 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/187 2024-03-18T15:38:17.072 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/187 2024-03-18T15:38:17.072 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:17.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:17.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:17.268 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2024-03-18T15:38:17.524 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:17.528 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:17.528 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:17.529 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:17.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:17.875 INFO:teuthology.orchestra.run.smithi152.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:17.884 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/188 2024-03-18T15:38:17.884 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/188 2024-03-18T15:38:17.884 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:17.887 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:18.170 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:18.170 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2024-03-18T15:38:18.374 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:18.378 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:18.378 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:18.379 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:18.379 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:18.693 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:38:18.696 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:38:18.743 INFO:teuthology.orchestra.run.smithi152.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:18.748 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/189 2024-03-18T15:38:18.748 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/189 2024-03-18T15:38:18.748 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:18.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:18.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:18.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2024-03-18T15:38:19.197 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:19.201 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:19.202 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:19.203 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:19.203 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:19.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:19.569 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/190 2024-03-18T15:38:19.569 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/190 2024-03-18T15:38:19.570 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:19.573 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:19.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:19.827 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2024-03-18T15:38:20.038 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:20.042 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:20.043 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:20.043 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:20.043 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:20.393 INFO:teuthology.orchestra.run.smithi152.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:20.398 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/191 2024-03-18T15:38:20.398 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/191 2024-03-18T15:38:20.399 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:20.404 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:20.638 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:20.644 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2024-03-18T15:38:20.889 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:20.892 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:20.893 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:20.894 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:20.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:21.108 INFO:teuthology.orchestra.run.smithi152.stdout:generic/192 [not run] atime not maintained by ceph 2024-03-18T15:38:21.112 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/192 2024-03-18T15:38:21.112 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/192 2024-03-18T15:38:21.112 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:21.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:21.127 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:21.127 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2024-03-18T15:38:21.307 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:21.311 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:21.311 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:21.312 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:21.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:22.277 INFO:teuthology.orchestra.run.smithi152.stdout:generic/193 1s 2024-03-18T15:38:22.282 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/193 2024-03-18T15:38:22.282 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:22.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:22.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:22.339 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2024-03-18T15:38:22.726 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:22.731 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:22.731 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:22.732 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:22.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:23.084 INFO:teuthology.orchestra.run.smithi152.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:23.094 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/194 2024-03-18T15:38:23.094 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/194 2024-03-18T15:38:23.094 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:23.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:23.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:23.247 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2024-03-18T15:38:23.539 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:23.543 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:23.544 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:23.545 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:23.545 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:23.904 INFO:teuthology.orchestra.run.smithi152.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:23.910 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/195 2024-03-18T15:38:23.911 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/195 2024-03-18T15:38:23.911 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:23.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:24.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:24.114 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2024-03-18T15:38:24.376 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:24.380 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:24.381 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:24.382 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:24.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:24.734 INFO:teuthology.orchestra.run.smithi152.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:24.747 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/196 2024-03-18T15:38:24.747 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/196 2024-03-18T15:38:24.747 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:24.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:24.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:24.961 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2024-03-18T15:38:25.210 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:25.214 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:25.214 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:25.215 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:25.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:25.574 INFO:teuthology.orchestra.run.smithi152.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:25.579 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/197 2024-03-18T15:38:25.580 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/197 2024-03-18T15:38:25.580 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:25.583 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:25.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:25.784 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2024-03-18T15:38:26.025 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:26.028 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:26.029 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:26.030 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:26.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:26.666 INFO:teuthology.orchestra.run.smithi152.stdout:generic/198 0s 2024-03-18T15:38:26.671 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/198 2024-03-18T15:38:26.672 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:26.674 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:26.724 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:26.724 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2024-03-18T15:38:27.108 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:27.111 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:27.112 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:27.113 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:27.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:27.494 INFO:teuthology.orchestra.run.smithi152.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:27.500 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/199 2024-03-18T15:38:27.500 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/199 2024-03-18T15:38:27.500 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:27.506 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:27.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:27.818 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2024-03-18T15:38:28.055 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:28.059 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:28.059 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:28.060 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:28.060 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:28.425 INFO:teuthology.orchestra.run.smithi152.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:28.431 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/200 2024-03-18T15:38:28.431 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/200 2024-03-18T15:38:28.431 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:28.439 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:28.616 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:28.616 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2024-03-18T15:38:28.898 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:28.902 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:28.903 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:28.903 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:28.904 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:29.264 INFO:teuthology.orchestra.run.smithi152.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:29.271 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/201 2024-03-18T15:38:29.271 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/201 2024-03-18T15:38:29.271 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:29.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:29.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:29.498 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2024-03-18T15:38:29.734 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:29.737 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:29.738 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:29.739 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:29.739 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:30.099 INFO:teuthology.orchestra.run.smithi152.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:30.107 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/202 2024-03-18T15:38:30.107 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/202 2024-03-18T15:38:30.107 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:30.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:30.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:30.336 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2024-03-18T15:38:30.580 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:30.583 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:30.584 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:30.585 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:30.585 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:30.938 INFO:teuthology.orchestra.run.smithi152.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:30.945 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/203 2024-03-18T15:38:30.946 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/203 2024-03-18T15:38:30.946 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:30.948 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:31.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:31.177 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2024-03-18T15:38:31.426 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:31.428 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:31.429 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:31.429 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:31.430 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:33.262 INFO:teuthology.orchestra.run.smithi152.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:38:33.265 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/204 2024-03-18T15:38:33.265 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/204 2024-03-18T15:38:33.266 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:33.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:33.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:33.284 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2024-03-18T15:38:33.479 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:33.482 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:33.483 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:33.484 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:33.484 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:33.831 INFO:teuthology.orchestra.run.smithi152.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:33.837 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/205 2024-03-18T15:38:33.837 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/205 2024-03-18T15:38:33.837 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:33.840 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:34.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:34.155 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2024-03-18T15:38:34.340 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:34.344 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:34.344 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:34.345 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:34.345 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:34.713 INFO:teuthology.orchestra.run.smithi152.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:38:34.718 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/206 2024-03-18T15:38:34.718 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/206 2024-03-18T15:38:34.718 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:34.722 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:34.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:34.969 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2024-03-18T15:38:35.203 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:35.206 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:35.207 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:35.208 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:35.208 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:43.436 INFO:teuthology.orchestra.run.smithi152.stdout:generic/207 8s 2024-03-18T15:38:43.442 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/207 2024-03-18T15:38:43.442 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:38:43.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:43.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:38:43.484 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2024-03-18T15:38:43.919 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:38:43.922 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:38:43.923 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:38:43.924 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:38:43.924 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:38:48.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:38:48.775 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:39:18.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:39:18.936 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:39:49.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:39:49.008 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:40:19.097 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:40:19.100 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:40:49.253 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:40:49.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:41:19.318 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:41:19.321 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:41:49.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:41:49.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:42:04.304 INFO:teuthology.orchestra.run.smithi152.stdout:generic/208 200s 2024-03-18T15:42:04.308 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/208 2024-03-18T15:42:04.308 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:04.310 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:04.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:04.357 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2024-03-18T15:42:04.762 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:04.766 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:04.766 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:04.767 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:04.767 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:19.555 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:42:19.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:42:40.098 INFO:teuthology.orchestra.run.smithi152.stdout:generic/209 36s 2024-03-18T15:42:40.104 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/209 2024-03-18T15:42:40.104 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:40.107 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:40.148 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:40.148 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2024-03-18T15:42:40.549 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:40.553 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:40.553 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:40.554 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:40.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:40.903 INFO:teuthology.orchestra.run.smithi152.stdout:generic/210 0s 2024-03-18T15:42:40.908 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/210 2024-03-18T15:42:40.908 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:40.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:40.958 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:40.958 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2024-03-18T15:42:41.314 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:41.318 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:41.318 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:41.320 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:41.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:41.745 INFO:teuthology.orchestra.run.smithi152.stdout:generic/211 0s 2024-03-18T15:42:41.751 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/211 2024-03-18T15:42:41.751 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:41.753 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:41.769 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:41.769 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2024-03-18T15:42:41.954 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:41.958 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:41.958 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:41.959 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:41.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:42.268 INFO:teuthology.orchestra.run.smithi152.stdout:generic/212 0s 2024-03-18T15:42:42.273 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/212 2024-03-18T15:42:42.273 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:42.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:42.292 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2024-03-18T15:42:42.475 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:42.478 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:42.479 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:42.479 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:42.710 INFO:teuthology.orchestra.run.smithi152.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:42:42.714 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/213 2024-03-18T15:42:42.714 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/213 2024-03-18T15:42:42.714 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:42.716 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:42.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:42.730 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2024-03-18T15:42:42.902 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:42.906 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:42.906 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:42.907 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:42.908 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:43.143 INFO:teuthology.orchestra.run.smithi152.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:42:43.147 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/214 2024-03-18T15:42:43.147 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/214 2024-03-18T15:42:43.147 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:43.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:43.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:43.163 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2024-03-18T15:42:43.350 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:43.353 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:43.354 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:43.354 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:43.355 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:45.632 INFO:teuthology.orchestra.run.smithi152.stdout:generic/215 2s 2024-03-18T15:42:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/215 2024-03-18T15:42:45.637 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:45.639 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:45.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:45.675 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2024-03-18T15:42:45.859 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:45.863 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:45.863 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:45.864 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:45.865 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:46.218 INFO:teuthology.orchestra.run.smithi152.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:46.225 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/216 2024-03-18T15:42:46.225 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/216 2024-03-18T15:42:46.225 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:46.227 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:46.434 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:46.435 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2024-03-18T15:42:46.689 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:46.694 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:46.694 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:46.695 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:46.695 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:47.055 INFO:teuthology.orchestra.run.smithi152.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:47.062 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/217 2024-03-18T15:42:47.062 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/217 2024-03-18T15:42:47.062 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:47.064 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:47.238 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:47.239 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2024-03-18T15:42:47.509 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:47.513 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:47.513 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:47.514 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:47.514 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:47.872 INFO:teuthology.orchestra.run.smithi152.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:47.880 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/218 2024-03-18T15:42:47.880 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/218 2024-03-18T15:42:47.880 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:47.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:48.067 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:48.067 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2024-03-18T15:42:48.326 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:48.329 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:48.330 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:48.330 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:48.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:48.562 INFO:teuthology.orchestra.run.smithi152.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:48.566 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/219 2024-03-18T15:42:48.566 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/219 2024-03-18T15:42:48.567 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:48.569 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:48.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:48.583 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2024-03-18T15:42:48.763 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:48.766 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:48.767 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:48.768 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:48.768 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:49.143 INFO:teuthology.orchestra.run.smithi152.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:49.148 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/220 2024-03-18T15:42:49.149 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/220 2024-03-18T15:42:49.149 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:49.152 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:49.359 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:49.360 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2024-03-18T15:42:49.613 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:49.617 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:49.617 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:49.618 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:49.618 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:49.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:42:49.913 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:42:50.872 INFO:teuthology.orchestra.run.smithi152.stdout:generic/221 1s 2024-03-18T15:42:50.878 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/221 2024-03-18T15:42:50.878 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:50.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:50.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:50.899 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2024-03-18T15:42:51.093 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:51.097 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:51.097 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:51.098 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:51.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:51.459 INFO:teuthology.orchestra.run.smithi152.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:51.467 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/222 2024-03-18T15:42:51.467 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/222 2024-03-18T15:42:51.467 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:51.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:51.673 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:51.674 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2024-03-18T15:42:51.919 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:51.922 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:51.923 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:51.924 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:51.924 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:52.143 INFO:teuthology.orchestra.run.smithi152.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:42:52.147 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/223 2024-03-18T15:42:52.147 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/223 2024-03-18T15:42:52.147 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:52.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:52.167 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:52.167 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2024-03-18T15:42:52.352 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:52.356 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:52.356 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:52.357 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:52.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:52.574 INFO:teuthology.orchestra.run.smithi152.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:42:52.578 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/224 2024-03-18T15:42:52.578 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/224 2024-03-18T15:42:52.578 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:52.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:52.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:52.595 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2024-03-18T15:42:52.787 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:52.791 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:52.792 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:52.792 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:52.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:53.062 INFO:teuthology.orchestra.run.smithi152.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:42:53.065 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/225 2024-03-18T15:42:53.065 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/225 2024-03-18T15:42:53.065 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:53.068 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:53.113 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:53.113 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2024-03-18T15:42:53.500 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:53.504 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:53.504 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:53.505 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:53.505 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:53.743 INFO:teuthology.orchestra.run.smithi152.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:42:53.747 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/226 2024-03-18T15:42:53.747 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/226 2024-03-18T15:42:53.747 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:53.749 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:53.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:53.767 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2024-03-18T15:42:53.963 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:53.967 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:53.967 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:53.968 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:53.968 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:54.342 INFO:teuthology.orchestra.run.smithi152.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:54.349 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/227 2024-03-18T15:42:54.349 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/227 2024-03-18T15:42:54.349 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:54.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:54.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:54.586 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2024-03-18T15:42:54.826 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:54.830 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:54.830 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:54.831 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:54.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:55.081 INFO:teuthology.orchestra.run.smithi152.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:42:55.085 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/228 2024-03-18T15:42:55.085 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/228 2024-03-18T15:42:55.085 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:55.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:55.102 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:55.102 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2024-03-18T15:42:55.306 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:55.309 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:55.310 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:55.311 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:55.311 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:55.670 INFO:teuthology.orchestra.run.smithi152.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:42:55.676 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/229 2024-03-18T15:42:55.676 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/229 2024-03-18T15:42:55.676 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:55.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:55.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:55.933 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2024-03-18T15:42:56.151 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:56.155 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:56.155 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:56.156 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:56.156 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:56.374 INFO:teuthology.orchestra.run.smithi152.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:56.378 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/230 2024-03-18T15:42:56.378 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/230 2024-03-18T15:42:56.378 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:56.380 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:56.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:56.404 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2024-03-18T15:42:56.591 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:56.595 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:56.596 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:56.596 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:56.597 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:56.803 INFO:teuthology.orchestra.run.smithi152.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:56.807 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/231 2024-03-18T15:42:56.807 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/231 2024-03-18T15:42:56.807 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:56.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:56.825 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:56.825 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2024-03-18T15:42:57.011 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:57.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:57.015 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:57.016 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:57.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:57.222 INFO:teuthology.orchestra.run.smithi152.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:57.226 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/232 2024-03-18T15:42:57.226 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/232 2024-03-18T15:42:57.226 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:57.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:57.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:57.241 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2024-03-18T15:42:57.425 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:57.429 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:57.429 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:57.430 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:57.430 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:57.655 INFO:teuthology.orchestra.run.smithi152.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:57.659 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/233 2024-03-18T15:42:57.659 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/233 2024-03-18T15:42:57.659 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:57.661 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:57.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:57.676 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2024-03-18T15:42:57.872 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:57.876 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:57.876 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:57.877 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:57.877 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:58.090 INFO:teuthology.orchestra.run.smithi152.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:58.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/234 2024-03-18T15:42:58.093 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/234 2024-03-18T15:42:58.094 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:58.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:58.109 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:58.109 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2024-03-18T15:42:58.306 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:58.310 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:58.311 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:58.312 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:58.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:58.528 INFO:teuthology.orchestra.run.smithi152.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:42:58.532 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/235 2024-03-18T15:42:58.532 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/235 2024-03-18T15:42:58.532 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:42:58.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:42:58.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:42:58.556 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2024-03-18T15:42:58.751 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:42:58.755 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:42:58.756 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:42:58.756 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:42:58.756 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:00.051 INFO:teuthology.orchestra.run.smithi152.stdout:generic/236 2s 2024-03-18T15:43:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/236 2024-03-18T15:43:00.056 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:43:00.058 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:00.100 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:43:00.100 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2024-03-18T15:43:00.495 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:43:00.498 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:43:00.499 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:43:00.500 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:43:00.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:00.800 INFO:teuthology.orchestra.run.smithi152.stdout:generic/237 0s 2024-03-18T15:43:00.805 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/237 2024-03-18T15:43:00.805 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:43:00.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:00.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:43:00.864 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2024-03-18T15:43:01.260 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:43:01.263 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:43:01.264 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:43:01.265 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:43:01.265 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:01.621 INFO:teuthology.orchestra.run.smithi152.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:43:01.627 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/238 2024-03-18T15:43:01.627 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/238 2024-03-18T15:43:01.627 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:43:01.632 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:01.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:43:01.871 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2024-03-18T15:43:02.122 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:43:02.126 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:43:02.126 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:43:02.127 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:43:02.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:02.355 INFO:teuthology.orchestra.run.smithi152.stdout:generic/239 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:43:02.358 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/239 2024-03-18T15:43:02.359 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/239 2024-03-18T15:43:02.359 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:43:02.361 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:02.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:43:02.384 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2024-03-18T15:43:02.575 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:43:02.578 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:43:02.579 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:43:02.580 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:43:02.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:02.812 INFO:teuthology.orchestra.run.smithi152.stdout:generic/240 [not run] Sparse files are not supported or do not work as expected 2024-03-18T15:43:02.816 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/240 2024-03-18T15:43:02.816 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/240 2024-03-18T15:43:02.816 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:43:02.818 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:02.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:43:02.844 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2024-03-18T15:43:03.041 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:43:03.045 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:43:03.046 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:43:03.047 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:43:03.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:43:19.986 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:43:19.989 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:43:20.062 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T15:43:20.062+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 260470) UID: 0 2024-03-18T15:43:20.063 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:43:20.063+0000 7f66649ad640 -1 Fail to open '/proc/260470/cmdline' error = (2) No such file or directory 2024-03-18T15:43:20.063 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:43:20.063+0000 7f66649ad640 -1 received signal: Hangup from (PID: 260470) UID: 0 2024-03-18T15:44:16.065 INFO:teuthology.orchestra.run.smithi152.stdout:generic/241 73s 2024-03-18T15:44:16.071 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/241 2024-03-18T15:44:16.071 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:16.075 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:17.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:17.428 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2024-03-18T15:44:17.804 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:17.808 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:17.809 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:17.810 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:17.810 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:18.464 INFO:teuthology.orchestra.run.smithi152.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:18.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/242 2024-03-18T15:44:18.472 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/242 2024-03-18T15:44:18.472 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:18.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:18.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:18.533 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2024-03-18T15:44:18.963 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:18.968 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:18.968 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:18.970 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:18.970 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:19.628 INFO:teuthology.orchestra.run.smithi152.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:19.634 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/243 2024-03-18T15:44:19.634 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/243 2024-03-18T15:44:19.634 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:19.638 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:19.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:19.671 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2024-03-18T15:44:20.040 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:20.047 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:20.048 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:20.049 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:20.049 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:20.397 INFO:teuthology.orchestra.run.smithi152.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:44:20.401 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/244 2024-03-18T15:44:20.401 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/244 2024-03-18T15:44:20.401 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:20.403 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:20.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:20.415 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2024-03-18T15:44:20.603 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:20.607 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:20.607 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:20.608 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:20.608 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:20.888 INFO:teuthology.orchestra.run.smithi152.stdout:generic/245 0s 2024-03-18T15:44:20.894 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/245 2024-03-18T15:44:20.894 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:20.896 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:20.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:20.945 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2024-03-18T15:44:21.392 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:21.398 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:21.398 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:21.399 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:21.399 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:21.692 INFO:teuthology.orchestra.run.smithi152.stdout:generic/246 0s 2024-03-18T15:44:21.697 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/246 2024-03-18T15:44:21.697 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:21.699 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:21.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:21.761 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2024-03-18T15:44:22.209 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:22.213 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:22.213 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:22.215 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:22.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:34.304 INFO:teuthology.orchestra.run.smithi152.stdout:generic/247 12s 2024-03-18T15:44:34.309 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/247 2024-03-18T15:44:34.310 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:34.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:34.320 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:34.320 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2024-03-18T15:44:34.508 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:34.512 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:34.512 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:34.514 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:34.514 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:34.812 INFO:teuthology.orchestra.run.smithi152.stdout:generic/248 0s 2024-03-18T15:44:34.818 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/248 2024-03-18T15:44:34.818 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:34.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:34.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:34.841 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2024-03-18T15:44:35.021 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:35.025 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:35.025 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:35.026 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:35.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:35.445 INFO:teuthology.orchestra.run.smithi152.stdout:generic/249 0s 2024-03-18T15:44:35.451 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/249 2024-03-18T15:44:35.451 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:35.454 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:35.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:35.509 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2024-03-18T15:44:35.911 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:35.921 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:35.922 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:35.923 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:35.923 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:36.245 INFO:teuthology.orchestra.run.smithi152.stdout:generic/250 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:44:36.248 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/250 2024-03-18T15:44:36.249 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/250 2024-03-18T15:44:36.249 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:36.251 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:36.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:36.264 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2024-03-18T15:44:36.445 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:36.449 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:36.449 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:36.450 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:36.451 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:36.727 INFO:teuthology.orchestra.run.smithi152.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/251 2024-03-18T15:44:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/251 2024-03-18T15:44:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:36.737 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:36.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:36.747 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2024-03-18T15:44:36.928 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:36.932 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:36.932 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:36.933 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:36.933 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:37.139 INFO:teuthology.orchestra.run.smithi152.stdout:generic/252 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:44:37.143 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/252 2024-03-18T15:44:37.143 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/252 2024-03-18T15:44:37.143 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:37.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:37.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:37.157 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2024-03-18T15:44:37.349 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:37.352 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:37.353 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:37.354 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:37.354 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:37.696 INFO:teuthology.orchestra.run.smithi152.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:37.702 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/253 2024-03-18T15:44:37.703 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/253 2024-03-18T15:44:37.703 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:37.704 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:37.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:37.767 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2024-03-18T15:44:38.183 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:38.187 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:38.188 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:38.189 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:38.189 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:38.546 INFO:teuthology.orchestra.run.smithi152.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:38.551 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/254 2024-03-18T15:44:38.552 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/254 2024-03-18T15:44:38.552 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:38.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:38.667 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:38.667 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2024-03-18T15:44:39.008 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:39.012 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:39.012 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:39.013 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:39.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:39.336 INFO:teuthology.orchestra.run.smithi152.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:44:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/255 2024-03-18T15:44:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/255 2024-03-18T15:44:39.340 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:39.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:39.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:39.404 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2024-03-18T15:44:39.842 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:39.848 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:39.849 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:39.850 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:39.850 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:40.646 INFO:teuthology.orchestra.run.smithi152.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:44:40.650 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/256 2024-03-18T15:44:40.650 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/256 2024-03-18T15:44:40.650 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:40.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:40.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:40.665 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2024-03-18T15:44:40.843 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:40.846 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:40.847 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:40.848 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:40.848 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:41.799 INFO:teuthology.orchestra.run.smithi152.stdout:generic/257 1s 2024-03-18T15:44:41.805 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/257 2024-03-18T15:44:41.805 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:41.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:41.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:41.880 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2024-03-18T15:44:42.339 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:42.346 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:42.351 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:42.352 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:42.680 INFO:teuthology.orchestra.run.smithi152.stdout:generic/258 [not run] ceph does not support negative timestamps 2024-03-18T15:44:42.684 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/258 2024-03-18T15:44:42.684 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/258 2024-03-18T15:44:42.684 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:42.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:42.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:42.715 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2024-03-18T15:44:42.888 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:42.892 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:42.892 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:42.893 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:42.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:43.223 INFO:teuthology.orchestra.run.smithi152.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:43.231 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/259 2024-03-18T15:44:43.231 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/259 2024-03-18T15:44:43.232 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:43.235 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:43.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:43.469 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2024-03-18T15:44:43.791 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:43.794 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:43.795 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:43.795 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:43.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:44.055 INFO:teuthology.orchestra.run.smithi152.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:44.061 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/260 2024-03-18T15:44:44.061 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/260 2024-03-18T15:44:44.061 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:44.063 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:44.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:44.075 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2024-03-18T15:44:44.267 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:44.271 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:44.271 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:44.272 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:44.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:44.617 INFO:teuthology.orchestra.run.smithi152.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:44.624 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/261 2024-03-18T15:44:44.624 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/261 2024-03-18T15:44:44.624 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:44.626 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:44.872 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:44.872 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2024-03-18T15:44:45.136 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:45.140 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:45.141 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:45.142 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:45.142 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:45.485 INFO:teuthology.orchestra.run.smithi152.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:44:45.492 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/262 2024-03-18T15:44:45.492 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/262 2024-03-18T15:44:45.492 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:44:45.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:44:45.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:44:45.669 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2024-03-18T15:44:45.980 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:44:45.983 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:44:45.984 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:44:45.985 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:44:45.985 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:25.097 INFO:teuthology.orchestra.run.smithi152.stdout:generic/263 39s 2024-03-18T15:45:25.103 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/263 2024-03-18T15:45:25.103 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:25.105 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:25.152 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:25.153 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2024-03-18T15:45:25.617 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:25.623 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:25.624 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:25.624 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:25.624 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:26.004 INFO:teuthology.orchestra.run.smithi152.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:26.011 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/264 2024-03-18T15:45:26.011 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/264 2024-03-18T15:45:26.011 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:26.015 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:26.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:26.197 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2024-03-18T15:45:26.514 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:26.516 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:26.517 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:26.518 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:26.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:26.929 INFO:teuthology.orchestra.run.smithi152.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:26.935 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/265 2024-03-18T15:45:26.937 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/265 2024-03-18T15:45:26.937 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:26.940 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:27.155 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:27.156 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2024-03-18T15:45:27.426 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:27.429 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:27.430 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:27.431 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:27.431 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:27.815 INFO:teuthology.orchestra.run.smithi152.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:27.828 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/266 2024-03-18T15:45:27.828 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/266 2024-03-18T15:45:27.828 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:27.832 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:28.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:28.034 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2024-03-18T15:45:28.332 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:28.335 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:28.335 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:28.336 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:28.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:28.908 INFO:teuthology.orchestra.run.smithi152.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:28.915 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/267 2024-03-18T15:45:28.915 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/267 2024-03-18T15:45:28.915 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:28.918 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:29.068 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:29.068 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2024-03-18T15:45:29.400 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:29.404 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:29.405 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:29.405 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:29.406 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:29.778 INFO:teuthology.orchestra.run.smithi152.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:29.785 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/268 2024-03-18T15:45:29.785 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/268 2024-03-18T15:45:29.785 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:29.787 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:29.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:29.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2024-03-18T15:45:30.274 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:30.278 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:30.278 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:30.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:30.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:30.497 INFO:teuthology.orchestra.run.smithi152.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:45:30.501 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/269 2024-03-18T15:45:30.501 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/269 2024-03-18T15:45:30.501 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:30.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:30.527 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:30.527 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2024-03-18T15:45:30.711 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:30.714 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:30.715 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:30.716 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:30.716 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:30.943 INFO:teuthology.orchestra.run.smithi152.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:45:30.947 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/270 2024-03-18T15:45:30.947 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/270 2024-03-18T15:45:30.947 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:30.949 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:30.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:30.961 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2024-03-18T15:45:31.142 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:31.146 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:31.147 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:31.147 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:31.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:31.528 INFO:teuthology.orchestra.run.smithi152.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:31.533 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/271 2024-03-18T15:45:31.533 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/271 2024-03-18T15:45:31.534 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:31.540 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:31.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:31.726 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2024-03-18T15:45:32.011 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:32.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:32.015 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:32.016 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:32.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:32.389 INFO:teuthology.orchestra.run.smithi152.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:32.399 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/272 2024-03-18T15:45:32.400 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/272 2024-03-18T15:45:32.400 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:32.402 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:32.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:32.666 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2024-03-18T15:45:32.921 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:32.924 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:32.925 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:32.926 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:32.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:33.152 INFO:teuthology.orchestra.run.smithi152.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:45:33.156 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/273 2024-03-18T15:45:33.156 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/273 2024-03-18T15:45:33.157 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:33.159 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:33.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:33.176 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2024-03-18T15:45:33.357 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:33.360 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:33.361 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:33.362 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:33.362 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:33.568 INFO:teuthology.orchestra.run.smithi152.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T15:45:33.572 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/274 2024-03-18T15:45:33.572 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/274 2024-03-18T15:45:33.572 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:33.574 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:33.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:33.591 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2024-03-18T15:45:33.778 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:33.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:33.782 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:33.783 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:33.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:34.005 INFO:teuthology.orchestra.run.smithi152.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:45:34.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/275 2024-03-18T15:45:34.008 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/275 2024-03-18T15:45:34.008 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:34.011 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:34.025 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:34.025 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2024-03-18T15:45:34.207 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:34.211 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:34.211 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:34.212 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:34.212 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:34.607 INFO:teuthology.orchestra.run.smithi152.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:34.614 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/276 2024-03-18T15:45:34.614 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/276 2024-03-18T15:45:34.614 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:34.619 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:34.775 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:34.775 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2024-03-18T15:45:35.078 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:35.082 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:35.083 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:35.083 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:35.084 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:35.480 INFO:teuthology.orchestra.run.smithi152.stdout:generic/277 [not run] file system doesn't support chattr +A 2024-03-18T15:45:35.484 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/277 2024-03-18T15:45:35.484 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/277 2024-03-18T15:45:35.484 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:35.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:35.506 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:35.506 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2024-03-18T15:45:35.683 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:35.686 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:35.687 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:35.688 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:35.688 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:36.120 INFO:teuthology.orchestra.run.smithi152.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:36.128 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/278 2024-03-18T15:45:36.128 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/278 2024-03-18T15:45:36.128 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:36.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:36.268 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:36.268 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2024-03-18T15:45:36.566 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:36.570 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:36.570 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:36.571 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:36.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:36.986 INFO:teuthology.orchestra.run.smithi152.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:36.995 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/279 2024-03-18T15:45:36.996 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/279 2024-03-18T15:45:36.996 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:36.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:37.178 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:37.178 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2024-03-18T15:45:37.603 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:37.608 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:37.609 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:37.610 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:37.610 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:37.898 INFO:teuthology.orchestra.run.smithi152.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:45:37.902 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/280 2024-03-18T15:45:37.902 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/280 2024-03-18T15:45:37.903 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:37.905 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:37.931 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:37.931 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2024-03-18T15:45:38.116 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:38.120 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:38.120 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:38.121 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:38.122 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:38.499 INFO:teuthology.orchestra.run.smithi152.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:38.505 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/281 2024-03-18T15:45:38.505 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/281 2024-03-18T15:45:38.505 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:38.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:38.732 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:38.732 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2024-03-18T15:45:38.985 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:38.989 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:38.990 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:38.991 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:39.369 INFO:teuthology.orchestra.run.smithi152.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:39.378 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/282 2024-03-18T15:45:39.378 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/282 2024-03-18T15:45:39.378 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:39.381 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:39.589 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:39.589 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2024-03-18T15:45:39.843 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:39.847 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:39.848 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:39.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:40.248 INFO:teuthology.orchestra.run.smithi152.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:40.255 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/283 2024-03-18T15:45:40.256 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/283 2024-03-18T15:45:40.256 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:40.261 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:40.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:40.500 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2024-03-18T15:45:40.708 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:40.712 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:40.712 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:40.713 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:40.713 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:41.073 INFO:teuthology.orchestra.run.smithi152.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:41.078 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/284 2024-03-18T15:45:41.079 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/284 2024-03-18T15:45:41.079 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:41.082 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:41.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:41.290 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2024-03-18T15:45:41.544 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:41.547 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:41.548 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:41.549 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:41.549 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:42.667 INFO:teuthology.orchestra.run.smithi152.stdout:generic/285 1s 2024-03-18T15:45:42.673 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/285 2024-03-18T15:45:42.673 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:42.680 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:43.065 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:43.066 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2024-03-18T15:45:43.461 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:43.465 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:43.465 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:43.466 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:43.466 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:43.780 INFO:teuthology.orchestra.run.smithi152.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:45:43.785 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/286 2024-03-18T15:45:43.785 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/286 2024-03-18T15:45:43.785 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:43.788 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:43.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:43.812 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2024-03-18T15:45:44.088 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:44.096 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:44.097 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:44.098 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:44.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:44.549 INFO:teuthology.orchestra.run.smithi152.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:44.556 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/287 2024-03-18T15:45:44.556 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/287 2024-03-18T15:45:44.556 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:44.557 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:44.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:44.774 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2024-03-18T15:45:45.097 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:45.102 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:45.103 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:45.106 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:45.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:45.511 INFO:teuthology.orchestra.run.smithi152.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:45.530 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/288 2024-03-18T15:45:45.530 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/288 2024-03-18T15:45:45.530 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:45.533 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:45.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:45.556 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2024-03-18T15:45:45.839 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:45.845 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:45.845 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:45.848 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:45.848 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:46.303 INFO:teuthology.orchestra.run.smithi152.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:46.310 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/289 2024-03-18T15:45:46.310 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/289 2024-03-18T15:45:46.310 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:46.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:46.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:46.579 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2024-03-18T15:45:46.870 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:46.875 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:46.876 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:46.877 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:46.877 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:47.361 INFO:teuthology.orchestra.run.smithi152.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:47.367 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/290 2024-03-18T15:45:47.367 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/290 2024-03-18T15:45:47.367 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:47.372 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:47.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:47.598 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2024-03-18T15:45:47.917 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:47.924 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:47.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:48.387 INFO:teuthology.orchestra.run.smithi152.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:48.393 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/291 2024-03-18T15:45:48.394 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/291 2024-03-18T15:45:48.394 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:48.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:48.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:48.713 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2024-03-18T15:45:48.996 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:49.002 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:49.002 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:49.003 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:49.003 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:49.432 INFO:teuthology.orchestra.run.smithi152.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:49.439 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/292 2024-03-18T15:45:49.439 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/292 2024-03-18T15:45:49.439 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:49.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:49.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:49.676 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2024-03-18T15:45:49.903 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:49.907 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:49.907 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:49.908 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:49.908 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:50.277 INFO:teuthology.orchestra.run.smithi152.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:50.284 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/293 2024-03-18T15:45:50.284 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/293 2024-03-18T15:45:50.284 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:50.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:50.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:50.582 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2024-03-18T15:45:50.777 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:50.780 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:50.781 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:50.782 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:50.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:51.257 INFO:teuthology.orchestra.run.smithi152.stdout:generic/294 1s 2024-03-18T15:45:51.267 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/294 2024-03-18T15:45:51.267 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:51.270 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:51.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:51.288 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2024-03-18T15:45:51.625 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:51.628 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:51.629 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:51.630 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:51.630 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:52.049 INFO:teuthology.orchestra.run.smithi152.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/295 2024-03-18T15:45:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/295 2024-03-18T15:45:52.055 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:52.058 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:52.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:52.272 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2024-03-18T15:45:52.523 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:52.527 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:52.527 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:52.528 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:52.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:52.903 INFO:teuthology.orchestra.run.smithi152.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:52.914 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/296 2024-03-18T15:45:52.914 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/296 2024-03-18T15:45:52.914 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:52.921 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:53.188 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:53.188 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2024-03-18T15:45:53.417 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:53.421 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:53.421 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:53.422 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:53.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:53.785 INFO:teuthology.orchestra.run.smithi152.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:53.791 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/297 2024-03-18T15:45:53.791 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/297 2024-03-18T15:45:53.791 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:53.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:54.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:54.045 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2024-03-18T15:45:54.277 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:54.280 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:54.281 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:54.282 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:54.282 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:54.636 INFO:teuthology.orchestra.run.smithi152.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:54.642 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/298 2024-03-18T15:45:54.642 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/298 2024-03-18T15:45:54.642 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:54.645 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:54.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:54.908 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2024-03-18T15:45:55.118 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:55.121 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:55.122 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:55.123 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:55.123 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:55.406 INFO:teuthology.orchestra.run.smithi152.stdout:generic/299 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:45:55.410 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/299 2024-03-18T15:45:55.410 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/299 2024-03-18T15:45:55.410 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:55.413 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:55.430 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:55.430 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2024-03-18T15:45:55.631 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:55.635 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:55.635 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:55.636 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:55.636 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:55.892 INFO:teuthology.orchestra.run.smithi152.stdout:generic/300 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:45:55.896 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/300 2024-03-18T15:45:55.896 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/300 2024-03-18T15:45:55.896 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:55.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:55.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:55.914 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2024-03-18T15:45:56.091 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:56.094 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:56.095 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:56.096 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:56.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:56.449 INFO:teuthology.orchestra.run.smithi152.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:56.455 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/301 2024-03-18T15:45:56.455 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/301 2024-03-18T15:45:56.456 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:56.459 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:56.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:56.717 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2024-03-18T15:45:56.945 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:56.948 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:56.949 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:56.950 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:56.950 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:57.316 INFO:teuthology.orchestra.run.smithi152.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/302 2024-03-18T15:45:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/302 2024-03-18T15:45:57.323 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:57.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:57.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:57.634 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2024-03-18T15:45:57.826 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:57.830 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:57.831 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:57.831 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:57.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:58.082 INFO:teuthology.orchestra.run.smithi152.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:45:58.086 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/303 2024-03-18T15:45:58.087 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/303 2024-03-18T15:45:58.087 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:58.088 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:58.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:58.143 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2024-03-18T15:45:58.505 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:58.510 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:58.511 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:58.512 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:58.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:58.779 INFO:teuthology.orchestra.run.smithi152.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:45:58.782 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/304 2024-03-18T15:45:58.783 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/304 2024-03-18T15:45:58.783 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:58.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:58.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:58.850 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2024-03-18T15:45:59.240 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:45:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:45:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:45:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:45:59.246 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:59.607 INFO:teuthology.orchestra.run.smithi152.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:45:59.613 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/305 2024-03-18T15:45:59.613 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/305 2024-03-18T15:45:59.613 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:45:59.620 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:45:59.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:45:59.879 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2024-03-18T15:46:00.098 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:46:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:46:00.102 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:46:00.103 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:46:00.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:00.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/306 0s 2024-03-18T15:46:00.649 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/306 2024-03-18T15:46:00.649 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:46:00.652 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:00.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:46:00.944 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2024-03-18T15:46:01.322 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:46:01.327 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:46:01.327 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:46:01.328 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:46:01.328 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:02.882 INFO:teuthology.orchestra.run.smithi152.stdout:generic/307 1s 2024-03-18T15:46:02.900 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/307 2024-03-18T15:46:02.900 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:46:02.902 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:02.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:46:02.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2024-03-18T15:46:03.094 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:46:03.098 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:46:03.098 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:46:03.099 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:46:03.099 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:03.361 INFO:teuthology.orchestra.run.smithi152.stdout:generic/308 0s 2024-03-18T15:46:03.366 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/308 2024-03-18T15:46:03.366 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:46:03.368 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:03.382 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:46:03.383 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2024-03-18T15:46:03.566 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:46:03.570 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:46:03.570 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:46:03.571 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:46:03.571 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:04.847 INFO:teuthology.orchestra.run.smithi152.stdout:generic/309 1s 2024-03-18T15:46:04.852 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/309 2024-03-18T15:46:04.852 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:46:04.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:04.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:46:04.903 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2024-03-18T15:46:05.288 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:46:05.294 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:46:05.294 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:46:05.296 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:46:05.296 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:46:08.181 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:46:08.183 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:46:38.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:46:38.294 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:47:08.505 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:47:08.509 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:47:21.814 INFO:teuthology.orchestra.run.smithi152.stdout:generic/310 76s 2024-03-18T15:47:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/310 2024-03-18T15:47:21.819 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:21.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:21.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:21.945 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2024-03-18T15:47:22.319 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:22.338 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:22.339 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:22.340 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:22.340 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:22.677 INFO:teuthology.orchestra.run.smithi152.stdout:generic/311 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:47:22.681 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/311 2024-03-18T15:47:22.681 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/311 2024-03-18T15:47:22.681 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:22.684 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:22.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:22.698 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2024-03-18T15:47:22.875 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:22.879 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:22.879 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:22.880 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:22.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:23.097 INFO:teuthology.orchestra.run.smithi152.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:47:23.101 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/312 2024-03-18T15:47:23.101 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/312 2024-03-18T15:47:23.101 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:23.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:23.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:23.119 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2024-03-18T15:47:23.298 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:23.302 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:23.302 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:23.303 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:23.303 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:27.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/313 4s 2024-03-18T15:47:27.570 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/313 2024-03-18T15:47:27.570 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:27.572 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:27.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:27.584 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2024-03-18T15:47:27.769 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:27.773 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:27.773 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:27.774 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:27.774 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:28.353 INFO:teuthology.orchestra.run.smithi152.stdout:generic/314 1s 2024-03-18T15:47:28.358 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/314 2024-03-18T15:47:28.358 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:28.360 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:28.377 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:28.378 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2024-03-18T15:47:28.555 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:28.559 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:28.559 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:28.560 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:28.560 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:28.788 INFO:teuthology.orchestra.run.smithi152.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T15:47:28.792 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/315 2024-03-18T15:47:28.792 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/315 2024-03-18T15:47:28.792 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:28.794 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:28.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:28.809 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2024-03-18T15:47:28.983 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:28.987 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:28.987 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:28.988 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:28.988 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:29.309 INFO:teuthology.orchestra.run.smithi152.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:47:29.313 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/316 2024-03-18T15:47:29.313 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/316 2024-03-18T15:47:29.313 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:29.315 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:29.358 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:29.359 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2024-03-18T15:47:29.777 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:29.782 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:29.783 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:29.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:33.346 INFO:teuthology.orchestra.run.smithi152.stdout:generic/317 4s 2024-03-18T15:47:33.351 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/317 2024-03-18T15:47:33.351 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:33.353 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:33.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:33.362 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2024-03-18T15:47:33.553 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:33.557 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:33.557 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:33.558 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:33.558 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:34.069 INFO:teuthology.orchestra.run.smithi152.stdout:generic/318 1s 2024-03-18T15:47:34.075 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/318 2024-03-18T15:47:34.075 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:34.077 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:34.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:34.086 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2024-03-18T15:47:34.263 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:34.266 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:34.267 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:34.268 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:34.268 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:34.612 INFO:teuthology.orchestra.run.smithi152.stdout:generic/319 0s 2024-03-18T15:47:34.617 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/319 2024-03-18T15:47:34.617 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:34.620 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:34.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:34.629 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2024-03-18T15:47:34.812 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:34.815 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:34.816 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:34.817 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:34.817 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.041 INFO:teuthology.orchestra.run.smithi152.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:47:35.045 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/320 2024-03-18T15:47:35.045 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/320 2024-03-18T15:47:35.045 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:35.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.059 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:35.059 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2024-03-18T15:47:35.231 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:35.234 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:35.235 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:35.236 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:35.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.457 INFO:teuthology.orchestra.run.smithi152.stdout:generic/321 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:47:35.461 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/321 2024-03-18T15:47:35.461 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/321 2024-03-18T15:47:35.462 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:35.464 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:35.478 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2024-03-18T15:47:35.654 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:35.658 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:35.658 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:35.659 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:35.659 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.867 INFO:teuthology.orchestra.run.smithi152.stdout:generic/322 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:47:35.871 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/322 2024-03-18T15:47:35.871 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/322 2024-03-18T15:47:35.871 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:47:35.873 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:35.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:47:35.885 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2024-03-18T15:47:36.072 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:47:36.076 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:47:36.076 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:47:36.077 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:47:36.077 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:47:38.634 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:47:38.636 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:48:08.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:48:08.701 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:48:39.005 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:48:39.008 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:48:42.366 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T15:48:42.365+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46091) UID: 0 2024-03-18T15:48:42.366 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T15:48:42.365+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46091) UID: 0 2024-03-18T15:48:42.367 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T15:48:42.365+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46091) UID: 0 2024-03-18T15:48:42.367 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T15:48:42.365+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 46091) UID: 0 2024-03-18T15:49:36.818 INFO:teuthology.orchestra.run.smithi152.stdout:generic/323 120s 2024-03-18T15:49:36.823 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/323 2024-03-18T15:49:36.823 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:36.825 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:36.862 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:36.863 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2024-03-18T15:49:37.275 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:37.279 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:37.280 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:37.281 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:37.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:37.507 INFO:teuthology.orchestra.run.smithi152.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2024-03-18T15:49:37.511 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/324 2024-03-18T15:49:37.511 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/324 2024-03-18T15:49:37.511 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:37.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:37.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:37.524 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2024-03-18T15:49:37.701 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:37.704 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:37.705 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:37.706 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:37.706 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:37.925 INFO:teuthology.orchestra.run.smithi152.stdout:generic/325 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:49:37.929 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/325 2024-03-18T15:49:37.929 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/325 2024-03-18T15:49:37.929 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:37.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:37.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:37.944 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2024-03-18T15:49:38.132 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:38.135 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:38.136 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:38.137 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:38.137 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:38.491 INFO:teuthology.orchestra.run.smithi152.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:38.498 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/326 2024-03-18T15:49:38.498 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/326 2024-03-18T15:49:38.498 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:38.502 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:38.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:38.755 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2024-03-18T15:49:38.970 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:38.974 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:38.975 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:38.975 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:38.975 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:39.327 INFO:teuthology.orchestra.run.smithi152.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:39.334 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/327 2024-03-18T15:49:39.334 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/327 2024-03-18T15:49:39.334 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:39.337 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:39.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:39.620 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2024-03-18T15:49:39.834 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:39.838 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:39.838 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:39.839 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:39.839 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:40.191 INFO:teuthology.orchestra.run.smithi152.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:40.202 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/328 2024-03-18T15:49:40.202 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/328 2024-03-18T15:49:40.202 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:40.204 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:40.500 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:40.500 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2024-03-18T15:49:40.700 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:40.704 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:40.704 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:40.705 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:40.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:41.077 INFO:teuthology.orchestra.run.smithi152.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:41.084 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/329 2024-03-18T15:49:41.084 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/329 2024-03-18T15:49:41.084 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:41.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:41.194 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:41.194 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2024-03-18T15:49:41.523 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:41.527 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:41.527 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:41.528 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:41.528 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:41.889 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/330 2024-03-18T15:49:41.889 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/330 2024-03-18T15:49:41.889 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:41.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:42.208 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:42.208 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2024-03-18T15:49:42.400 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:42.404 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:42.405 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:42.405 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:42.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:42.770 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/331 2024-03-18T15:49:42.770 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/331 2024-03-18T15:49:42.770 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:42.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:43.016 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:43.016 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2024-03-18T15:49:43.267 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:43.271 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:43.271 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:43.272 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:43.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:43.624 INFO:teuthology.orchestra.run.smithi152.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:43.631 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/332 2024-03-18T15:49:43.631 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/332 2024-03-18T15:49:43.631 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:43.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:43.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:43.936 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2024-03-18T15:49:44.122 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:44.125 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:44.126 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:44.127 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:44.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:44.478 INFO:teuthology.orchestra.run.smithi152.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:44.485 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/333 2024-03-18T15:49:44.485 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/333 2024-03-18T15:49:44.485 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:44.492 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:44.826 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:44.826 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2024-03-18T15:49:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:45.033 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:45.034 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:45.034 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:45.388 INFO:teuthology.orchestra.run.smithi152.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:49:45.394 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/334 2024-03-18T15:49:45.394 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/334 2024-03-18T15:49:45.394 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:45.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:45.637 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:45.638 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2024-03-18T15:49:45.874 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:45.878 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:45.879 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:45.880 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:45.880 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:46.104 INFO:teuthology.orchestra.run.smithi152.stdout:generic/335 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:49:46.108 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/335 2024-03-18T15:49:46.108 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/335 2024-03-18T15:49:46.108 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:46.110 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:46.132 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:46.133 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2024-03-18T15:49:46.313 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:46.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:46.318 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:46.318 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:46.319 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:46.541 INFO:teuthology.orchestra.run.smithi152.stdout:generic/336 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:49:46.545 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/336 2024-03-18T15:49:46.545 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/336 2024-03-18T15:49:46.545 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:46.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:46.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:46.564 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2024-03-18T15:49:46.739 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:46.743 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:46.743 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:46.744 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:46.744 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:47.094 INFO:teuthology.orchestra.run.smithi152.stdout:generic/337 1s 2024-03-18T15:49:47.100 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/337 2024-03-18T15:49:47.100 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:47.102 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:47.111 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:47.111 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2024-03-18T15:49:47.287 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:47.291 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:47.292 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:47.292 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:47.293 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:47.519 INFO:teuthology.orchestra.run.smithi152.stdout:generic/338 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:49:47.523 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/338 2024-03-18T15:49:47.523 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/338 2024-03-18T15:49:47.523 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:49:47.525 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:49:47.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:49:47.539 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2024-03-18T15:49:47.715 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:49:47.719 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:49:47.719 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:49:47.721 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:49:47.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:41.102 INFO:teuthology.orchestra.run.smithi152.stdout:generic/339 53s 2024-03-18T15:50:41.113 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/339 2024-03-18T15:50:41.113 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:41.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:41.131 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:41.131 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2024-03-18T15:50:41.349 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:41.352 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:41.353 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:41.354 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:41.354 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:43.719 INFO:teuthology.orchestra.run.smithi152.stdout:generic/340 2s 2024-03-18T15:50:43.738 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/340 2024-03-18T15:50:43.738 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:43.743 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:43.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:43.756 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2024-03-18T15:50:44.176 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:44.181 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:44.181 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:44.182 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:44.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:44.556 INFO:teuthology.orchestra.run.smithi152.stdout:generic/341 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:50:44.561 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/341 2024-03-18T15:50:44.561 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/341 2024-03-18T15:50:44.561 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:44.564 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:44.585 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:44.585 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2024-03-18T15:50:44.803 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:44.806 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:44.807 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:44.808 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:44.808 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:45.025 INFO:teuthology.orchestra.run.smithi152.stdout:generic/342 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:50:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/342 2024-03-18T15:50:45.028 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/342 2024-03-18T15:50:45.029 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:45.031 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:45.043 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:45.043 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2024-03-18T15:50:45.222 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:45.225 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:45.226 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:45.227 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:45.227 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:45.469 INFO:teuthology.orchestra.run.smithi152.stdout:generic/343 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:50:45.473 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/343 2024-03-18T15:50:45.473 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/343 2024-03-18T15:50:45.473 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:45.475 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:45.491 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:45.491 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2024-03-18T15:50:45.684 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:45.688 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:45.688 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:45.689 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:45.689 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:50.084 INFO:teuthology.orchestra.run.smithi152.stdout:generic/344 5s 2024-03-18T15:50:50.098 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/344 2024-03-18T15:50:50.098 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:50.102 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:50.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:50.119 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2024-03-18T15:50:50.524 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:50.528 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:50.528 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:50.529 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:50.529 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:50.933 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:50:50.937 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:50:55.558 INFO:teuthology.orchestra.run.smithi152.stdout:generic/345 5s 2024-03-18T15:50:55.571 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/345 2024-03-18T15:50:55.571 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:55.574 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:55.586 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:55.586 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2024-03-18T15:50:56.000 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:56.006 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:56.006 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:56.008 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:56.008 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:58.607 INFO:teuthology.orchestra.run.smithi152.stdout:generic/346 2s 2024-03-18T15:50:58.613 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/346 2024-03-18T15:50:58.613 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:58.615 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:58.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:58.631 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2024-03-18T15:50:59.006 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:59.012 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:59.013 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:59.015 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:59.015 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:59.357 INFO:teuthology.orchestra.run.smithi152.stdout:generic/347 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:50:59.362 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/347 2024-03-18T15:50:59.363 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/347 2024-03-18T15:50:59.363 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:59.365 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:59.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:59.387 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2024-03-18T15:50:59.631 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:50:59.635 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:50:59.636 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:50:59.636 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:50:59.637 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:59.877 INFO:teuthology.orchestra.run.smithi152.stdout:generic/348 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:50:59.880 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/348 2024-03-18T15:50:59.880 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/348 2024-03-18T15:50:59.880 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:50:59.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:50:59.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:50:59.900 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2024-03-18T15:51:00.077 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:00.081 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:00.082 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:00.082 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:00.393 INFO:teuthology.orchestra.run.smithi152.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T15:51:00.397 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/349 2024-03-18T15:51:00.398 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/349 2024-03-18T15:51:00.398 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:00.401 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:00.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:00.419 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2024-03-18T15:51:00.607 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:00.611 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:00.611 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:00.612 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:00.612 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:01.255 INFO:teuthology.orchestra.run.smithi152.stdout:generic/350 1s 2024-03-18T15:51:01.260 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/350 2024-03-18T15:51:01.260 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:01.263 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:01.271 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:01.272 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2024-03-18T15:51:01.454 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:01.458 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:01.458 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:01.459 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:01.460 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:01.714 INFO:teuthology.orchestra.run.smithi152.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:51:01.718 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/351 2024-03-18T15:51:01.718 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/351 2024-03-18T15:51:01.718 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:01.721 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:01.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:01.737 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2024-03-18T15:51:01.919 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:01.923 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:01.923 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:01.924 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:01.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:02.282 INFO:teuthology.orchestra.run.smithi152.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:02.289 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/352 2024-03-18T15:51:02.289 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/352 2024-03-18T15:51:02.289 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:02.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:02.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:02.595 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2024-03-18T15:51:02.794 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:02.798 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:02.798 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:02.799 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:02.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:03.142 INFO:teuthology.orchestra.run.smithi152.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:03.147 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/353 2024-03-18T15:51:03.147 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/353 2024-03-18T15:51:03.147 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:03.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:03.420 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:03.420 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2024-03-18T15:51:03.658 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:03.662 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:03.662 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:03.663 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:03.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:07.945 INFO:teuthology.orchestra.run.smithi152.stdout:generic/354 4s 2024-03-18T15:51:07.956 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/354 2024-03-18T15:51:07.956 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:07.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:07.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:07.974 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2024-03-18T15:51:08.325 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:08.330 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:08.331 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:08.332 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:08.333 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:08.945 INFO:teuthology.orchestra.run.smithi152.stdout:generic/355 0s 2024-03-18T15:51:08.952 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/355 2024-03-18T15:51:08.952 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:08.956 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:09.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:09.015 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2024-03-18T15:51:09.430 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:09.438 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:09.439 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:09.442 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:09.442 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:09.941 INFO:teuthology.orchestra.run.smithi152.stdout:generic/356 [not run] swapfiles are not supported 2024-03-18T15:51:09.947 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/356 2024-03-18T15:51:09.947 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/356 2024-03-18T15:51:09.947 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:09.951 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:09.971 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:09.971 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2024-03-18T15:51:10.274 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:10.281 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:10.281 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:10.283 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:10.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:10.662 INFO:teuthology.orchestra.run.smithi152.stdout:generic/357 [not run] swapfiles are not supported 2024-03-18T15:51:10.666 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/357 2024-03-18T15:51:10.666 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/357 2024-03-18T15:51:10.666 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:10.669 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:10.683 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:10.683 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2024-03-18T15:51:10.864 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:10.868 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:10.868 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:10.869 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:10.869 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:11.239 INFO:teuthology.orchestra.run.smithi152.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:11.247 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/358 2024-03-18T15:51:11.247 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/358 2024-03-18T15:51:11.247 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:11.252 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:11.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:11.534 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2024-03-18T15:51:11.829 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:11.833 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:11.833 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:11.834 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:11.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:12.213 INFO:teuthology.orchestra.run.smithi152.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/359 2024-03-18T15:51:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/359 2024-03-18T15:51:12.227 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:12.227 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:12.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:12.452 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2024-03-18T15:51:12.703 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:12.707 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:12.707 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:12.708 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:12.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:12.978 INFO:teuthology.orchestra.run.smithi152.stdout:generic/360 0s 2024-03-18T15:51:12.984 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/360 2024-03-18T15:51:12.984 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:12.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:13.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:13.004 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2024-03-18T15:51:13.181 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:13.185 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:13.185 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:13.186 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:13.186 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:13.409 INFO:teuthology.orchestra.run.smithi152.stdout:generic/361 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:51:13.413 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/361 2024-03-18T15:51:13.413 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/361 2024-03-18T15:51:13.413 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:13.415 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:13.427 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:13.428 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2024-03-18T15:51:13.617 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:13.620 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:13.621 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:13.621 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:13.622 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:13.830 INFO:teuthology.orchestra.run.smithi152.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:13.834 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/362 2024-03-18T15:51:13.834 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/362 2024-03-18T15:51:13.834 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:13.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:13.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:13.850 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2024-03-18T15:51:14.033 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:14.037 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:14.037 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:14.039 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:14.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:14.259 INFO:teuthology.orchestra.run.smithi152.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:14.262 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/363 2024-03-18T15:51:14.263 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/363 2024-03-18T15:51:14.263 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:14.265 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:14.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:14.279 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2024-03-18T15:51:14.458 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:14.461 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:14.462 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:14.463 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:14.463 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:14.686 INFO:teuthology.orchestra.run.smithi152.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:14.690 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/364 2024-03-18T15:51:14.690 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/364 2024-03-18T15:51:14.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:14.692 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:14.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:14.705 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2024-03-18T15:51:14.893 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:14.897 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:14.897 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:14.898 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:14.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:15.117 INFO:teuthology.orchestra.run.smithi152.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:15.121 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/365 2024-03-18T15:51:15.121 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/365 2024-03-18T15:51:15.121 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:15.123 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:15.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:15.147 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2024-03-18T15:51:15.338 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:15.342 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:15.342 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:15.343 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:15.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:15.554 INFO:teuthology.orchestra.run.smithi152.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:15.558 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/366 2024-03-18T15:51:15.558 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/366 2024-03-18T15:51:15.558 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:15.561 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:15.584 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:15.585 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2024-03-18T15:51:15.766 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:15.770 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:15.771 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:15.772 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:15.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:15.981 INFO:teuthology.orchestra.run.smithi152.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:15.985 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/367 2024-03-18T15:51:15.985 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/367 2024-03-18T15:51:15.986 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:15.988 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:16.002 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:16.003 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2024-03-18T15:51:16.180 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:16.183 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:16.184 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:16.185 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:16.185 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:16.386 INFO:teuthology.orchestra.run.smithi152.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:16.390 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/368 2024-03-18T15:51:16.390 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/368 2024-03-18T15:51:16.390 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:16.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:16.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:16.406 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2024-03-18T15:51:16.592 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:16.596 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:16.596 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:16.597 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:16.597 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:16.815 INFO:teuthology.orchestra.run.smithi152.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:16.819 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/369 2024-03-18T15:51:16.819 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/369 2024-03-18T15:51:16.819 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:16.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:16.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:16.835 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2024-03-18T15:51:17.015 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:17.019 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:17.020 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:17.021 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:17.021 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:17.230 INFO:teuthology.orchestra.run.smithi152.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2024-03-18T15:51:17.234 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/370 2024-03-18T15:51:17.234 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/370 2024-03-18T15:51:17.234 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:17.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:17.262 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:17.262 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2024-03-18T15:51:17.447 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:17.451 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:17.451 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:17.452 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:17.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:17.683 INFO:teuthology.orchestra.run.smithi152.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:51:17.687 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/371 2024-03-18T15:51:17.687 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/371 2024-03-18T15:51:17.687 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:17.689 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:17.707 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:17.707 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2024-03-18T15:51:17.889 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:17.893 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:17.893 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:17.894 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:17.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:18.258 INFO:teuthology.orchestra.run.smithi152.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:18.265 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/372 2024-03-18T15:51:18.265 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/372 2024-03-18T15:51:18.265 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:18.267 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:18.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:18.583 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2024-03-18T15:51:18.784 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:18.787 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:18.788 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:18.789 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:18.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:19.166 INFO:teuthology.orchestra.run.smithi152.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:19.172 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/373 2024-03-18T15:51:19.172 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/373 2024-03-18T15:51:19.172 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:19.179 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:19.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:19.428 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2024-03-18T15:51:19.657 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:19.660 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:19.661 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:19.663 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:19.663 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:19.981 INFO:teuthology.orchestra.run.smithi152.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T15:51:20.049 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/374 2024-03-18T15:51:20.049 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/374 2024-03-18T15:51:20.050 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:20.054 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:20.328 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:20.328 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2024-03-18T15:51:20.557 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:20.560 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:20.561 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:20.562 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:20.562 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:20.857 INFO:teuthology.orchestra.run.smithi152.stdout:generic/375 0s 2024-03-18T15:51:20.862 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/375 2024-03-18T15:51:20.862 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:20.864 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:20.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:20.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2024-03-18T15:51:21.047 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:51:21.050 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:51:21.329 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:21.334 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:21.335 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:21.336 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:21.336 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:21.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/376 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:51:21.568 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/376 2024-03-18T15:51:21.568 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/376 2024-03-18T15:51:21.568 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:21.570 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:21.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:21.582 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2024-03-18T15:51:21.762 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:21.766 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:21.766 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:21.767 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:21.767 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:22.120 INFO:teuthology.orchestra.run.smithi152.stdout:generic/377 1s 2024-03-18T15:51:22.125 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/377 2024-03-18T15:51:22.125 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:22.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:22.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:22.136 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2024-03-18T15:51:22.320 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:22.324 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:22.325 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:22.326 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:22.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:22.791 INFO:teuthology.orchestra.run.smithi152.stdout:generic/378 0s 2024-03-18T15:51:22.797 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/378 2024-03-18T15:51:22.797 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:22.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:22.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:22.859 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2024-03-18T15:51:23.273 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:23.277 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:23.278 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:23.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:23.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:23.525 INFO:teuthology.orchestra.run.smithi152.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:23.529 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/379 2024-03-18T15:51:23.529 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/379 2024-03-18T15:51:23.529 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:23.532 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:23.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:23.544 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2024-03-18T15:51:23.735 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:23.738 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:23.739 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:23.740 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:23.740 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:23.937 INFO:teuthology.orchestra.run.smithi152.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:23.941 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/380 2024-03-18T15:51:23.941 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/380 2024-03-18T15:51:23.941 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:23.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:23.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:23.955 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2024-03-18T15:51:24.129 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:24.133 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:24.133 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:24.134 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:24.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:24.337 INFO:teuthology.orchestra.run.smithi152.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:24.341 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/381 2024-03-18T15:51:24.341 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/381 2024-03-18T15:51:24.342 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:24.343 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:24.366 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:24.367 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2024-03-18T15:51:24.553 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:24.557 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:24.557 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:24.558 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:24.558 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:24.781 INFO:teuthology.orchestra.run.smithi152.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:24.785 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/382 2024-03-18T15:51:24.785 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/382 2024-03-18T15:51:24.785 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:24.787 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:24.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:24.801 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2024-03-18T15:51:24.997 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:25.001 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:25.001 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:25.002 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:25.002 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:25.221 INFO:teuthology.orchestra.run.smithi152.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:25.225 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/383 2024-03-18T15:51:25.225 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/383 2024-03-18T15:51:25.225 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:25.227 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:25.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:25.241 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2024-03-18T15:51:25.438 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:25.442 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:25.442 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:25.443 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:25.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:25.669 INFO:teuthology.orchestra.run.smithi152.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:25.673 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/384 2024-03-18T15:51:25.673 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/384 2024-03-18T15:51:25.673 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:25.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:25.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:25.688 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2024-03-18T15:51:25.873 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:25.876 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:25.877 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:25.877 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:25.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:26.089 INFO:teuthology.orchestra.run.smithi152.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:26.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/385 2024-03-18T15:51:26.093 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/385 2024-03-18T15:51:26.093 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:26.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:26.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:26.110 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2024-03-18T15:51:26.290 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:26.294 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:26.294 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:26.295 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:26.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:26.501 INFO:teuthology.orchestra.run.smithi152.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:26.505 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/386 2024-03-18T15:51:26.505 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/386 2024-03-18T15:51:26.505 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:26.508 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:26.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:26.522 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2024-03-18T15:51:26.697 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:26.700 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:26.701 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:26.701 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:26.702 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:27.065 INFO:teuthology.orchestra.run.smithi152.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:27.071 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/387 2024-03-18T15:51:27.071 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/387 2024-03-18T15:51:27.071 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:27.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:27.381 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:27.381 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2024-03-18T15:51:27.587 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:27.590 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:27.591 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:27.592 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:27.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:27.821 INFO:teuthology.orchestra.run.smithi152.stdout:generic/388 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T15:51:27.825 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/388 2024-03-18T15:51:27.825 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/388 2024-03-18T15:51:27.825 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:27.827 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:27.840 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:27.840 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2024-03-18T15:51:28.025 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:28.029 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:28.030 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:28.031 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:28.031 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:28.258 INFO:teuthology.orchestra.run.smithi152.stdout:generic/389 [not run] O_TMPFILE is not supported 2024-03-18T15:51:28.261 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/389 2024-03-18T15:51:28.262 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/389 2024-03-18T15:51:28.262 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:28.264 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:28.277 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:28.278 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2024-03-18T15:51:28.460 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:28.463 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:28.464 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:28.465 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:28.465 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:28.687 INFO:teuthology.orchestra.run.smithi152.stdout:generic/390 [not run] ceph does not support freezing 2024-03-18T15:51:28.690 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/390 2024-03-18T15:51:28.690 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/390 2024-03-18T15:51:28.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:28.693 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:28.706 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:28.706 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2024-03-18T15:51:28.889 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:28.893 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:28.893 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:28.894 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:28.894 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:29.119 INFO:teuthology.orchestra.run.smithi152.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:51:29.123 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/391 2024-03-18T15:51:29.123 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/391 2024-03-18T15:51:29.123 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:29.125 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:29.144 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:29.144 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2024-03-18T15:51:29.325 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:29.329 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:29.329 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:29.330 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:29.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:29.617 INFO:teuthology.orchestra.run.smithi152.stdout:generic/392 [not run] ceph does not support shutdown 2024-03-18T15:51:29.626 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/392 2024-03-18T15:51:29.626 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/392 2024-03-18T15:51:29.626 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:29.628 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:29.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:29.651 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2024-03-18T15:51:29.833 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:29.836 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:29.837 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:29.838 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:29.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:30.479 INFO:teuthology.orchestra.run.smithi152.stdout:generic/393 1s 2024-03-18T15:51:30.484 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/393 2024-03-18T15:51:30.484 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:30.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:30.495 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:30.495 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2024-03-18T15:51:30.679 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:30.683 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:30.683 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:30.684 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:30.684 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:30.936 INFO:teuthology.orchestra.run.smithi152.stdout:generic/394 0s 2024-03-18T15:51:30.941 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/394 2024-03-18T15:51:30.942 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:30.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:30.999 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:30.999 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2024-03-18T15:51:31.371 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:31.380 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:31.381 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:31.382 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:31.382 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:31.732 INFO:teuthology.orchestra.run.smithi152.stdout:generic/395 [not run] kernel does not support ceph encryption 2024-03-18T15:51:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/395 2024-03-18T15:51:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/395 2024-03-18T15:51:31.740 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:31.742 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:31.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:31.770 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2024-03-18T15:51:31.980 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:31.985 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:31.985 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:31.987 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:31.987 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:32.437 INFO:teuthology.orchestra.run.smithi152.stdout:generic/396 [not run] kernel does not support ceph encryption 2024-03-18T15:51:32.450 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/396 2024-03-18T15:51:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/396 2024-03-18T15:51:32.451 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:32.453 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:32.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:32.472 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2024-03-18T15:51:32.719 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:32.724 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:32.725 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:32.728 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:32.728 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:33.207 INFO:teuthology.orchestra.run.smithi152.stdout:generic/397 [not run] kernel does not support ceph encryption 2024-03-18T15:51:33.217 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/397 2024-03-18T15:51:33.217 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/397 2024-03-18T15:51:33.218 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:33.220 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:33.232 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:33.232 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2024-03-18T15:51:33.423 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:33.427 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:33.427 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:33.428 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:33.428 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:33.751 INFO:teuthology.orchestra.run.smithi152.stdout:generic/398 [not run] kernel does not support ceph encryption 2024-03-18T15:51:33.760 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/398 2024-03-18T15:51:33.760 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/398 2024-03-18T15:51:33.760 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:33.763 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:33.791 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:33.791 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2024-03-18T15:51:33.968 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:33.972 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:33.972 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:33.973 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:33.973 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:34.309 INFO:teuthology.orchestra.run.smithi152.stdout:generic/399 [not run] kernel does not support ceph encryption 2024-03-18T15:51:34.317 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/399 2024-03-18T15:51:34.317 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/399 2024-03-18T15:51:34.317 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:34.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:34.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:34.332 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2024-03-18T15:51:34.518 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:34.522 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:34.522 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:34.523 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:34.523 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:34.741 INFO:teuthology.orchestra.run.smithi152.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T15:51:34.745 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/400 2024-03-18T15:51:34.745 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/400 2024-03-18T15:51:34.745 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:34.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:34.761 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:34.761 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2024-03-18T15:51:34.938 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:34.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:34.942 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:34.943 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:34.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:35.383 INFO:teuthology.orchestra.run.smithi152.stdout:generic/401 0s 2024-03-18T15:51:35.391 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/401 2024-03-18T15:51:35.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:35.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:35.406 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:35.407 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2024-03-18T15:51:35.790 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:35.794 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:35.795 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:35.796 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:35.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:36.113 INFO:teuthology.orchestra.run.smithi152.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2024-03-18T15:51:36.120 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/402 2024-03-18T15:51:36.121 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/402 2024-03-18T15:51:36.121 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:36.123 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:36.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:36.135 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2024-03-18T15:51:36.317 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:36.320 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:36.321 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:36.322 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:36.322 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:36.820 INFO:teuthology.orchestra.run.smithi152.stdout:generic/403 0s 2024-03-18T15:51:36.825 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/403 2024-03-18T15:51:36.825 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:36.828 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:36.836 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:36.836 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2024-03-18T15:51:37.030 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:37.034 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:37.035 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:37.035 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:37.035 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:37.275 INFO:teuthology.orchestra.run.smithi152.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:51:37.279 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/404 2024-03-18T15:51:37.279 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/404 2024-03-18T15:51:37.279 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:37.282 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:37.300 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:37.300 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2024-03-18T15:51:37.481 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:37.485 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:37.485 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:37.486 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:37.486 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:37.727 INFO:teuthology.orchestra.run.smithi152.stdout:generic/405 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:51:37.731 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/405 2024-03-18T15:51:37.731 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/405 2024-03-18T15:51:37.731 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:37.733 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:37.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:37.746 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2024-03-18T15:51:37.932 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:37.936 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:37.936 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:37.937 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:37.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:39.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/406 1s 2024-03-18T15:51:39.510 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/406 2024-03-18T15:51:39.511 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:39.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:39.522 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:39.522 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2024-03-18T15:51:39.708 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:39.712 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:39.712 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:39.714 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:39.714 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:40.032 INFO:teuthology.orchestra.run.smithi152.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:51:40.036 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/407 2024-03-18T15:51:40.036 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/407 2024-03-18T15:51:40.036 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:40.038 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:40.076 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:40.076 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2024-03-18T15:51:40.495 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:40.501 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:40.501 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:40.503 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:40.503 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:40.800 INFO:teuthology.orchestra.run.smithi152.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T15:51:40.804 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/408 2024-03-18T15:51:40.804 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/408 2024-03-18T15:51:40.804 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:40.806 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:40.864 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:40.864 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2024-03-18T15:51:41.346 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:41.350 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:41.351 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:41.353 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:41.353 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:41.594 INFO:teuthology.orchestra.run.smithi152.stdout:generic/409 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T15:51:41.597 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/409 2024-03-18T15:51:41.598 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/409 2024-03-18T15:51:41.598 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:41.599 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:41.613 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:41.613 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2024-03-18T15:51:41.796 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:41.800 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:41.800 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:41.801 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:41.801 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:42.020 INFO:teuthology.orchestra.run.smithi152.stdout:generic/410 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T15:51:42.024 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/410 2024-03-18T15:51:42.024 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/410 2024-03-18T15:51:42.024 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:42.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:42.039 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:42.039 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2024-03-18T15:51:42.229 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:42.233 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:42.234 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:42.235 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:42.445 INFO:teuthology.orchestra.run.smithi152.stdout:generic/411 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T15:51:42.450 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/411 2024-03-18T15:51:42.450 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/411 2024-03-18T15:51:42.450 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:42.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:42.466 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2024-03-18T15:51:42.657 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:42.661 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:42.661 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:42.662 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:42.662 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:43.114 INFO:teuthology.orchestra.run.smithi152.stdout:generic/412 1s 2024-03-18T15:51:43.119 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/412 2024-03-18T15:51:43.119 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:43.121 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:43.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:43.130 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2024-03-18T15:51:43.320 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:43.323 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:43.324 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:43.325 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:43.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:43.616 INFO:teuthology.orchestra.run.smithi152.stdout:generic/413 [not run] mount 172.21.15.152:6789:/scratch with dax failed 2024-03-18T15:51:43.620 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/413 2024-03-18T15:51:43.620 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/413 2024-03-18T15:51:43.620 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:43.622 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:43.635 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:43.636 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2024-03-18T15:51:43.826 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:43.830 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:43.830 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:43.831 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:43.831 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:44.180 INFO:teuthology.orchestra.run.smithi152.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:44.184 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/414 2024-03-18T15:51:44.184 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/414 2024-03-18T15:51:44.184 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:44.187 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:44.473 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:44.473 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2024-03-18T15:51:44.703 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:44.707 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:44.707 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:44.708 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:44.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:45.085 INFO:teuthology.orchestra.run.smithi152.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:51:45.091 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/415 2024-03-18T15:51:45.091 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/415 2024-03-18T15:51:45.092 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:45.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:45.369 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:45.369 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2024-03-18T15:51:45.599 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:45.603 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:45.603 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:45.604 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:45.604 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:45.817 INFO:teuthology.orchestra.run.smithi152.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:51:45.820 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/416 2024-03-18T15:51:45.821 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/416 2024-03-18T15:51:45.821 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:45.823 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:45.847 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:45.847 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2024-03-18T15:51:46.024 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:46.028 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:46.028 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:46.029 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:46.029 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:46.341 INFO:teuthology.orchestra.run.smithi152.stdout:generic/417 [not run] ceph does not support shutdown 2024-03-18T15:51:46.349 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/417 2024-03-18T15:51:46.349 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/417 2024-03-18T15:51:46.349 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:46.351 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:46.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:46.364 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2024-03-18T15:51:46.555 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:46.559 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:46.559 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:46.560 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:46.560 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:46.807 INFO:teuthology.orchestra.run.smithi152.stdout:generic/418 [not run] require 172.21.15.152:6789:/test to be valid block disk 2024-03-18T15:51:46.810 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/418 2024-03-18T15:51:46.811 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/418 2024-03-18T15:51:46.811 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:46.813 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:46.841 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:46.842 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2024-03-18T15:51:47.021 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:47.025 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:47.025 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:47.026 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:47.026 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:47.347 INFO:teuthology.orchestra.run.smithi152.stdout:generic/419 [not run] kernel does not support ceph encryption 2024-03-18T15:51:47.355 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/419 2024-03-18T15:51:47.355 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/419 2024-03-18T15:51:47.355 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:47.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:47.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:47.380 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2024-03-18T15:51:47.553 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:47.558 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:47.558 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:47.559 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:47.559 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:47.898 INFO:teuthology.orchestra.run.smithi152.stdout:generic/420 0s 2024-03-18T15:51:47.904 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/420 2024-03-18T15:51:47.904 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:47.907 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:47.973 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:47.973 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2024-03-18T15:51:48.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:48.377 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:48.377 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:48.378 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:48.722 INFO:teuthology.orchestra.run.smithi152.stdout:generic/421 [not run] kernel does not support ceph encryption 2024-03-18T15:51:48.730 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/421 2024-03-18T15:51:48.730 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/421 2024-03-18T15:51:48.730 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:48.732 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:48.744 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:48.744 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2024-03-18T15:51:48.934 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:48.937 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:48.938 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:48.938 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:48.938 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:49.178 INFO:teuthology.orchestra.run.smithi152.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T15:51:49.182 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/422 2024-03-18T15:51:49.182 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/422 2024-03-18T15:51:49.182 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:49.184 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:49.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:49.201 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2024-03-18T15:51:49.380 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:49.384 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:49.385 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:49.385 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:49.702 INFO:teuthology.orchestra.run.smithi152.stdout:generic/423 0s 2024-03-18T15:51:49.707 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/423 2024-03-18T15:51:49.707 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:49.710 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:49.779 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:49.779 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2024-03-18T15:51:50.162 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:50.167 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:50.167 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:50.168 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:50.168 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:50.399 INFO:teuthology.orchestra.run.smithi152.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2024-03-18T15:51:50.403 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/424 2024-03-18T15:51:50.403 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/424 2024-03-18T15:51:50.403 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:50.405 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:50.435 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:50.436 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2024-03-18T15:51:50.617 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:50.621 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:50.621 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:50.623 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:50.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:50.877 INFO:teuthology.orchestra.run.smithi152.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2024-03-18T15:51:50.881 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/425 2024-03-18T15:51:50.881 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/425 2024-03-18T15:51:50.881 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:51:50.883 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:51:50.944 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:51:50.944 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2024-03-18T15:51:51.138 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:51:51.143 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:51:51.358 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:51:51.362 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:51:51.363 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:51:51.364 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:51:51.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:21.246 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:52:21.249 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:52:23.272 INFO:teuthology.orchestra.run.smithi152.stdout:generic/426 32s 2024-03-18T15:52:23.415 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/426 2024-03-18T15:52:23.415 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:23.418 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:23.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:23.602 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2024-03-18T15:52:24.363 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:24.367 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:24.367 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:24.368 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:24.368 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:24.703 INFO:teuthology.orchestra.run.smithi152.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:52:24.707 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/427 2024-03-18T15:52:24.707 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/427 2024-03-18T15:52:24.707 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:24.709 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:24.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:24.728 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2024-03-18T15:52:24.913 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:24.917 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:24.917 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:24.918 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:24.918 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:25.184 INFO:teuthology.orchestra.run.smithi152.stdout:generic/428 0s 2024-03-18T15:52:25.190 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/428 2024-03-18T15:52:25.190 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:25.192 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:25.211 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:25.211 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2024-03-18T15:52:25.399 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:25.403 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:25.403 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:25.404 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:25.404 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:25.748 INFO:teuthology.orchestra.run.smithi152.stdout:generic/429 [not run] kernel does not support ceph encryption 2024-03-18T15:52:25.757 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/429 2024-03-18T15:52:25.757 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/429 2024-03-18T15:52:25.757 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:25.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:25.772 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:25.773 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2024-03-18T15:52:25.956 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:25.960 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:25.961 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:25.962 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:25.962 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:26.299 INFO:teuthology.orchestra.run.smithi152.stdout:generic/430 0s 2024-03-18T15:52:26.305 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/430 2024-03-18T15:52:26.305 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:26.307 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:26.385 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:26.386 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2024-03-18T15:52:26.770 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:26.776 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:26.777 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:26.778 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:26.778 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:27.076 INFO:teuthology.orchestra.run.smithi152.stdout:generic/431 1s 2024-03-18T15:52:27.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/431 2024-03-18T15:52:27.093 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:27.094 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:27.192 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:27.192 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2024-03-18T15:52:27.595 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:27.599 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:27.599 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:27.600 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:27.600 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:27.903 INFO:teuthology.orchestra.run.smithi152.stdout:generic/432 0s 2024-03-18T15:52:27.908 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/432 2024-03-18T15:52:27.909 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:27.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:27.978 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:27.979 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2024-03-18T15:52:28.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:28.377 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:28.378 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:28.379 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:28.379 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:28.679 INFO:teuthology.orchestra.run.smithi152.stdout:generic/433 0s 2024-03-18T15:52:28.685 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/433 2024-03-18T15:52:28.685 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:28.687 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:28.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:28.738 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2024-03-18T15:52:29.129 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:29.136 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:29.136 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:29.137 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:29.138 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:29.432 INFO:teuthology.orchestra.run.smithi152.stdout:generic/434 0s 2024-03-18T15:52:29.437 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/434 2024-03-18T15:52:29.437 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:29.439 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:29.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:29.503 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2024-03-18T15:52:29.894 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:29.900 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:29.901 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:29.903 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:29.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:30.255 INFO:teuthology.orchestra.run.smithi152.stdout:generic/435 [not run] kernel does not support ceph encryption 2024-03-18T15:52:30.263 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/435 2024-03-18T15:52:30.263 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/435 2024-03-18T15:52:30.263 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:30.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:30.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:30.278 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2024-03-18T15:52:30.453 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:30.457 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:30.458 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:30.459 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:30.459 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:31.004 INFO:teuthology.orchestra.run.smithi152.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:52:31.008 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/436 2024-03-18T15:52:31.008 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/436 2024-03-18T15:52:31.008 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:31.010 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:31.045 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:31.045 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2024-03-18T15:52:31.465 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:31.470 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:31.470 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:31.471 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:31.471 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:32.312 INFO:teuthology.orchestra.run.smithi152.stdout:generic/437 1s 2024-03-18T15:52:32.317 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/437 2024-03-18T15:52:32.318 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:52:32.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:32.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:52:32.341 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2024-03-18T15:52:32.526 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:52:32.530 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:52:32.530 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:52:32.531 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:52:32.531 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:52:53.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:52:53.604 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:53:24.144 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:53:24.147 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:53:45.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/438 73s 2024-03-18T15:53:45.647 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/438 2024-03-18T15:53:45.647 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:45.650 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:45.664 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:45.664 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2024-03-18T15:53:45.840 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:45.844 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:45.844 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:45.846 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:45.846 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:46.740 INFO:teuthology.orchestra.run.smithi152.stdout:generic/439 1s 2024-03-18T15:53:46.746 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/439 2024-03-18T15:53:46.746 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:46.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:46.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:46.760 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2024-03-18T15:53:46.939 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:46.943 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:46.943 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:46.945 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:46.945 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:47.268 INFO:teuthology.orchestra.run.smithi152.stdout:generic/440 [not run] kernel does not support ceph encryption 2024-03-18T15:53:47.274 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/440 2024-03-18T15:53:47.274 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/440 2024-03-18T15:53:47.275 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:47.277 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:47.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:47.287 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2024-03-18T15:53:47.463 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:47.467 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:47.467 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:47.468 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:47.468 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:47.755 INFO:teuthology.orchestra.run.smithi152.stdout:generic/441 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:53:47.759 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/441 2024-03-18T15:53:47.759 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/441 2024-03-18T15:53:47.759 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:47.762 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:47.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:47.773 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2024-03-18T15:53:47.962 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:47.966 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:47.967 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:47.968 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:47.968 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:48.203 INFO:teuthology.orchestra.run.smithi152.stdout:generic/442 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:53:48.207 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/442 2024-03-18T15:53:48.207 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/442 2024-03-18T15:53:48.207 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:48.209 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:48.222 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:48.222 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2024-03-18T15:53:48.403 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:48.407 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:48.407 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:48.408 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:48.408 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:48.659 INFO:teuthology.orchestra.run.smithi152.stdout:generic/443 0s 2024-03-18T15:53:48.664 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/443 2024-03-18T15:53:48.664 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:48.666 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:48.684 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:48.685 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2024-03-18T15:53:48.869 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:48.873 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:48.873 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:48.874 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:48.874 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:49.159 INFO:teuthology.orchestra.run.smithi152.stdout:generic/444 1s 2024-03-18T15:53:49.165 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/444 2024-03-18T15:53:49.165 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:49.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:49.183 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:49.183 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2024-03-18T15:53:49.359 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:49.363 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:49.364 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:49.365 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:49.815 INFO:teuthology.orchestra.run.smithi152.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:53:49.819 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/445 2024-03-18T15:53:49.819 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/445 2024-03-18T15:53:49.819 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:53:49.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:49.875 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:53:49.875 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2024-03-18T15:53:50.269 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:53:50.273 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:53:50.274 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:53:50.275 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:53:50.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:53:54.201 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:53:54.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:54:05.308 INFO:teuthology.orchestra.run.smithi152.stdout:generic/446 15s 2024-03-18T15:54:05.316 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/446 2024-03-18T15:54:05.316 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:05.322 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:05.335 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:05.335 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2024-03-18T15:54:05.693 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:05.697 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:05.697 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:05.698 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:05.698 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:06.050 INFO:teuthology.orchestra.run.smithi152.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:54:06.056 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/447 2024-03-18T15:54:06.056 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/447 2024-03-18T15:54:06.056 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:06.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:06.216 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:06.216 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2024-03-18T15:54:06.519 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:06.523 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:06.523 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:06.524 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:06.524 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:07.335 INFO:teuthology.orchestra.run.smithi152.stdout:generic/448 1s 2024-03-18T15:54:07.340 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/448 2024-03-18T15:54:07.340 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:07.342 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:07.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:07.402 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2024-03-18T15:54:07.755 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:07.759 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:07.760 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:07.761 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:07.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:08.016 INFO:teuthology.orchestra.run.smithi152.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T15:54:08.020 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/449 2024-03-18T15:54:08.020 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/449 2024-03-18T15:54:08.020 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:08.022 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:08.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:08.062 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2024-03-18T15:54:08.461 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:08.466 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:08.466 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:08.467 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:08.467 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:09.067 INFO:teuthology.orchestra.run.smithi152.stdout:generic/450 1s 2024-03-18T15:54:09.072 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/450 2024-03-18T15:54:09.072 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:09.074 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:09.122 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:09.123 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2024-03-18T15:54:09.517 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:09.520 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:09.521 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:09.522 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:09.522 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:24.291 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:54:24.293 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:54:39.851 INFO:teuthology.orchestra.run.smithi152.stdout:generic/451 30s 2024-03-18T15:54:39.856 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/451 2024-03-18T15:54:39.856 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:39.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:39.913 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:39.913 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2024-03-18T15:54:40.303 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:40.307 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:40.307 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:40.308 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:40.308 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:40.658 INFO:teuthology.orchestra.run.smithi152.stdout:generic/452 0s 2024-03-18T15:54:40.664 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/452 2024-03-18T15:54:40.664 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:40.666 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:40.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:40.675 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2024-03-18T15:54:40.863 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:40.867 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:40.867 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:40.868 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:40.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:41.089 INFO:teuthology.orchestra.run.smithi152.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2024-03-18T15:54:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/453 2024-03-18T15:54:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/453 2024-03-18T15:54:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:41.095 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:41.107 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:41.107 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2024-03-18T15:54:41.290 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:41.294 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:41.295 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:41.296 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:41.296 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:41.533 INFO:teuthology.orchestra.run.smithi152.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2024-03-18T15:54:41.537 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/454 2024-03-18T15:54:41.537 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/454 2024-03-18T15:54:41.537 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:41.539 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:41.556 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:41.556 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2024-03-18T15:54:41.739 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:41.743 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:41.743 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:41.744 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:41.744 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:42.027 INFO:teuthology.orchestra.run.smithi152.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T15:54:42.031 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/455 2024-03-18T15:54:42.031 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/455 2024-03-18T15:54:42.031 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:42.034 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:42.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:42.046 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2024-03-18T15:54:42.230 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:42.233 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:42.234 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:42.235 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:42.467 INFO:teuthology.orchestra.run.smithi152.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T15:54:42.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/456 2024-03-18T15:54:42.472 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/456 2024-03-18T15:54:42.472 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:42.489 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:42.489 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2024-03-18T15:54:42.676 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:42.682 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:42.682 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:42.682 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:42.682 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:43.115 INFO:teuthology.orchestra.run.smithi152.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:54:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/457 2024-03-18T15:54:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/457 2024-03-18T15:54:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:43.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:43.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:43.240 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2024-03-18T15:54:43.513 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:43.517 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:43.517 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:43.518 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:43.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:43.858 INFO:teuthology.orchestra.run.smithi152.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T15:54:43.865 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/458 2024-03-18T15:54:43.865 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/458 2024-03-18T15:54:43.865 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:43.868 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:43.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:43.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2024-03-18T15:54:44.309 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:44.314 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:44.314 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:44.314 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:44.314 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:44.753 INFO:teuthology.orchestra.run.smithi152.stdout:generic/459 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:54:44.757 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/459 2024-03-18T15:54:44.757 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/459 2024-03-18T15:54:44.757 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:44.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:44.770 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:44.771 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2024-03-18T15:54:44.958 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:44.962 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:44.963 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:44.964 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:44.964 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:46.815 INFO:teuthology.orchestra.run.smithi152.stdout:generic/460 1s 2024-03-18T15:54:46.821 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/460 2024-03-18T15:54:46.822 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:46.824 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:46.832 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:46.832 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2024-03-18T15:54:47.009 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:47.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:47.014 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:47.015 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:47.015 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:47.321 INFO:teuthology.orchestra.run.smithi152.stdout:generic/461 [not run] ceph does not support shutdown 2024-03-18T15:54:47.327 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/461 2024-03-18T15:54:47.327 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/461 2024-03-18T15:54:47.327 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:47.330 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:47.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:47.357 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2024-03-18T15:54:47.619 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:47.622 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:47.623 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:47.624 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:47.624 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:47.897 INFO:teuthology.orchestra.run.smithi152.stdout:generic/462 [not run] mount 172.21.15.152:6789:/scratch with dax failed 2024-03-18T15:54:47.901 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/462 2024-03-18T15:54:47.901 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/462 2024-03-18T15:54:47.901 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:47.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:47.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:47.915 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2024-03-18T15:54:48.098 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:48.102 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:48.102 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:48.103 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:48.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:48.350 INFO:teuthology.orchestra.run.smithi152.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T15:54:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/463 2024-03-18T15:54:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/463 2024-03-18T15:54:48.354 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:54:48.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:48.404 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:54:48.405 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2024-03-18T15:54:48.810 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:54:48.815 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:54:48.816 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:54:48.817 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:54:48.817 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:54:54.356 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:54:54.359 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:55:24.452 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:55:24.458 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:55:44.974 INFO:teuthology.orchestra.run.smithi152.stdout:generic/464 56s 2024-03-18T15:55:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/464 2024-03-18T15:55:44.979 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:44.982 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:44.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:44.991 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2024-03-18T15:55:45.176 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:45.179 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:45.180 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:45.181 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:45.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:49.259 INFO:teuthology.orchestra.run.smithi152.stdout:generic/465 4s 2024-03-18T15:55:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/465 2024-03-18T15:55:49.266 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:49.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:49.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:49.286 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2024-03-18T15:55:49.742 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:49.746 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:49.747 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:49.748 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:49.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:49.948 INFO:teuthology.orchestra.run.smithi152.stdout:generic/466 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:55:49.952 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/466 2024-03-18T15:55:49.953 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/466 2024-03-18T15:55:49.953 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:49.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:49.966 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:49.967 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2024-03-18T15:55:50.142 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:50.146 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:50.146 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:50.147 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:50.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:54.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:55:54.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:55:57.629 INFO:teuthology.orchestra.run.smithi152.stdout:generic/467 7s 2024-03-18T15:55:57.700 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/467 2024-03-18T15:55:57.700 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:57.703 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:57.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:57.777 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2024-03-18T15:55:58.912 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:58.969 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:58.969 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:58.969 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:58.969 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:59.239 INFO:teuthology.orchestra.run.smithi152.stdout:generic/468 [not run] ceph does not support shutdown 2024-03-18T15:55:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/468 2024-03-18T15:55:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/468 2024-03-18T15:55:59.246 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:59.248 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:59.259 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:59.259 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2024-03-18T15:55:59.435 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:59.439 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:59.440 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:59.441 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:59.441 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:59.649 INFO:teuthology.orchestra.run.smithi152.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T15:55:59.653 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/469 2024-03-18T15:55:59.653 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/469 2024-03-18T15:55:59.653 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:55:59.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:55:59.670 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:55:59.670 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2024-03-18T15:55:59.856 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:55:59.859 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:55:59.860 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:55:59.861 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:55:59.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:00.124 INFO:teuthology.orchestra.run.smithi152.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T15:56:00.127 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/470 2024-03-18T15:56:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/470 2024-03-18T15:56:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:00.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:00.141 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:00.141 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2024-03-18T15:56:00.324 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:00.327 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:00.328 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:00.329 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:00.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:27.421 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:56:27.425 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T15:56:27.650 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T15:56:27.649+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 554761) UID: 0 2024-03-18T15:56:27.651 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:56:27.650+0000 7f66649ad640 -1 Fail to open '/proc/554761/cmdline' error = (2) No such file or directory 2024-03-18T15:56:27.651 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T15:56:27.650+0000 7f66649ad640 -1 received signal: Hangup from (PID: 554761) UID: 0 2024-03-18T15:56:50.032 INFO:teuthology.orchestra.run.smithi152.stdout:generic/471 50s 2024-03-18T15:56:50.044 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/471 2024-03-18T15:56:50.044 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:50.047 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:50.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:50.171 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2024-03-18T15:56:50.860 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:50.870 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:50.870 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:50.871 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:50.871 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:51.680 INFO:teuthology.orchestra.run.smithi152.stdout:generic/472 [not run] swapfiles are not supported 2024-03-18T15:56:51.685 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/472 2024-03-18T15:56:51.685 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/472 2024-03-18T15:56:51.685 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:51.690 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:51.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:51.714 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2024-03-18T15:56:51.914 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:51.918 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:51.919 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:51.919 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:51.920 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:52.178 INFO:teuthology.orchestra.run.smithi152.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T15:56:52.183 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/473 2024-03-18T15:56:52.183 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/473 2024-03-18T15:56:52.183 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:52.184 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:52.199 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:52.199 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2024-03-18T15:56:52.373 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:52.377 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:52.377 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:52.378 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:52.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:52.653 INFO:teuthology.orchestra.run.smithi152.stdout:generic/474 [not run] ceph does not support shutdown 2024-03-18T15:56:52.660 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/474 2024-03-18T15:56:52.660 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/474 2024-03-18T15:56:52.660 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:52.662 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:52.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:52.674 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2024-03-18T15:56:52.852 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:52.855 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:52.856 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:52.857 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:52.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:53.096 INFO:teuthology.orchestra.run.smithi152.stdout:generic/475 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T15:56:53.100 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/475 2024-03-18T15:56:53.100 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/475 2024-03-18T15:56:53.100 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T15:56:53.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T15:56:53.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T15:56:53.114 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2024-03-18T15:56:53.299 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T15:56:53.303 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T15:56:53.303 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T15:56:53.304 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T15:56:53.304 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T16:01:54.691 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:01:54.695 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:02:24.842 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:02:24.846 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:02:55.120 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:02:55.123 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:03:25.615 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:03:25.620 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:03:55.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:03:55.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:04:26.088 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:04:26.091 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:04:26.310 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T16:04:26.308+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557687) UID: 0 2024-03-18T16:04:26.311 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T16:04:26.308+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557687) UID: 0 2024-03-18T16:04:26.311 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T16:04:26.308+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557687) UID: 0 2024-03-18T16:04:26.311 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T16:04:26.308+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557687) UID: 0 2024-03-18T16:08:58.231 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:08:58.237 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:08:58.298 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T16:08:58.296+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48346) UID: 0 2024-03-18T16:08:58.299 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T16:08:58.293+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48346) UID: 0 2024-03-18T16:08:58.313 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T16:08:58.297+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48346) UID: 0 2024-03-18T16:08:58.313 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T16:08:58.299+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48346) UID: 0 2024-03-18T16:12:07.942 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:12:07.945 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:12:08.278 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T16:12:08.276+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557778) UID: 0 2024-03-18T16:12:08.279 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T16:12:08.277+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557778) UID: 0 2024-03-18T16:17:16.501 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T16:17:16.499+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557812) UID: 0 2024-03-18T16:17:16.502 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T16:17:16.499+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557812) UID: 0 2024-03-18T16:17:16.502 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T16:17:16.499+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557812) UID: 0 2024-03-18T16:17:16.503 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T16:17:16.499+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 557812) UID: 0 2024-03-18T16:22:22.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:22:22.468 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:22:22.630 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T16:22:22.626+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48511) UID: 0 2024-03-18T16:22:22.644 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T16:22:22.641+0000 7f5475636640 -1 Fail to open '/proc/48511/cmdline' error = (2) No such file or directory 2024-03-18T16:22:22.644 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T16:22:22.641+0000 7f5475636640 -1 received signal: Hangup from (PID: 48511) UID: 0 2024-03-18T16:22:22.646 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T16:22:22.643+0000 7efef7dba640 -1 Fail to open '/proc/48511/cmdline' error = (2) No such file or directory 2024-03-18T16:22:22.646 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T16:22:22.643+0000 7efef7dba640 -1 received signal: Hangup from (PID: 48511) UID: 0 2024-03-18T16:22:22.652 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T16:22:22.644+0000 7f68834e1640 -1 Fail to open '/proc/48511/cmdline' error = (2) No such file or directory 2024-03-18T16:22:22.652 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T16:22:22.644+0000 7f68834e1640 -1 received signal: Hangup from (PID: 48511) UID: 0 2024-03-18T16:24:57.585 INFO:teuthology.orchestra.run.smithi186.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2024-03-18T16:24:57.585 INFO:teuthology.orchestra.run.smithi186.stderr:gzip: stdin: file size changed while zipping 2024-03-18T16:28:34.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:28:34.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:28:34.117 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T16:28:34.116+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557991) UID: 0 2024-03-18T16:28:34.126 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T16:28:34.116+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 557991) UID: 0 2024-03-18T16:35:49.758 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T16:35:49.756+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558052) UID: 0 2024-03-18T16:35:49.761 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T16:35:49.756+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558052) UID: 0 2024-03-18T16:35:49.764 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T16:35:49.760+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558052) UID: 0 2024-03-18T16:35:49.764 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T16:35:49.761+0000 7f91da83c640 -1 Fail to open '/proc/558052/cmdline' error = (2) No such file or directory 2024-03-18T16:35:49.764 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T16:35:49.761+0000 7f91da83c640 -1 received signal: Hangup from (PID: 558052) UID: 0 2024-03-18T16:40:35.595 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:40:35.598 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:40:35.655 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T16:40:35.653+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558110) UID: 0 2024-03-18T16:40:35.658 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T16:40:35.653+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558110) UID: 0 2024-03-18T16:40:35.663 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T16:40:35.662+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48747) UID: 0 2024-03-18T16:40:35.667 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T16:40:35.666+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48747) UID: 0 2024-03-18T16:40:35.669 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T16:40:35.663+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48747) UID: 0 2024-03-18T16:40:35.683 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T16:40:35.666+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48747) UID: 0 2024-03-18T16:46:04.634 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T16:46:04.632+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558166) UID: 0 2024-03-18T16:46:04.635 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T16:46:04.633+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558166) UID: 0 2024-03-18T16:46:04.636 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T16:46:04.633+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558166) UID: 0 2024-03-18T16:46:04.636 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T16:46:04.633+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558166) UID: 0 2024-03-18T16:55:11.106 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:55:11.110 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T16:55:11.172 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T16:55:11.170+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558245) UID: 0 2024-03-18T16:55:11.172 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T16:55:11.171+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558245) UID: 0 2024-03-18T16:55:11.508 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T16:55:11.506+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48947) UID: 0 2024-03-18T16:55:11.508 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T16:55:11.506+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48947) UID: 0 2024-03-18T16:55:11.509 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T16:55:11.506+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48947) UID: 0 2024-03-18T16:55:11.509 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T16:55:11.506+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 48947) UID: 0 2024-03-18T17:02:37.864 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:02:37.867 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:02:37.922 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T17:02:37.921+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558301) UID: 0 2024-03-18T17:02:37.922 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T17:02:37.921+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558301) UID: 0 2024-03-18T17:02:37.922 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T17:02:37.921+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558301) UID: 0 2024-03-18T17:02:37.923 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T17:02:37.921+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 558301) UID: 0 2024-03-18T17:07:10.706 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:07:10.711 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:07:10.751 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T17:07:10.751+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49164) UID: 0 2024-03-18T17:07:10.752 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T17:07:10.751+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49164) UID: 0 2024-03-18T17:07:10.754 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T17:07:10.751+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49164) UID: 0 2024-03-18T17:07:10.754 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T17:07:10.751+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49164) UID: 0 2024-03-18T17:07:10.848 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T17:07:10.846+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558431) UID: 0 2024-03-18T17:07:10.849 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T17:07:10.848+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558431) UID: 0 2024-03-18T17:13:24.102 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:13:24.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:13:54.521 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:13:54.525 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:13:54.555 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T17:13:54.555+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49290) UID: 0 2024-03-18T17:13:54.556 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T17:13:54.555+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49290) UID: 0 2024-03-18T17:13:54.556 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T17:13:54.555+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49290) UID: 0 2024-03-18T17:13:54.556 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T17:13:54.555+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49290) UID: 0 2024-03-18T17:16:41.352 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:16:41.356 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:16:41.412 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T17:16:41.412+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558662) UID: 0 2024-03-18T17:16:41.412 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T17:16:41.412+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558662) UID: 0 2024-03-18T17:16:47.532 INFO:teuthology.orchestra.run.smithi152.stdout:generic/476 4794s 2024-03-18T17:16:47.577 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/476 2024-03-18T17:16:47.577 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:16:47.580 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:16:47.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:16:47.593 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2024-03-18T17:16:53.658 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:16:53.663 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:16:53.664 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:16:53.665 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:16:53.665 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:22:33.915 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:22:33.921 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:22:34.124 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T17:22:34.124+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558958) UID: 0 2024-03-18T17:22:34.127 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T17:22:34.127+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 558958) UID: 0 2024-03-18T17:24:26.627 INFO:teuthology.orchestra.run.smithi152.stdout:generic/477 26s 2024-03-18T17:24:26.853 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/477 2024-03-18T17:24:26.853 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:26.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:27.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:27.069 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2024-03-18T17:24:29.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:29.783 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:29.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:41.092 INFO:teuthology.orchestra.run.smithi152.stdout:generic/478 12s 2024-03-18T17:24:41.099 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/478 2024-03-18T17:24:41.099 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:41.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:41.136 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:41.137 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2024-03-18T17:24:41.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:41.481 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:41.482 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:41.483 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:41.484 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:42.050 INFO:teuthology.orchestra.run.smithi152.stdout:generic/479 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:42.055 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/479 2024-03-18T17:24:42.055 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/479 2024-03-18T17:24:42.055 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:42.059 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:42.099 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:42.099 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2024-03-18T17:24:42.427 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:42.436 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:42.437 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:42.438 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:42.843 INFO:teuthology.orchestra.run.smithi152.stdout:generic/480 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:42.848 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/480 2024-03-18T17:24:42.848 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/480 2024-03-18T17:24:42.848 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:42.852 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:42.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:42.893 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2024-03-18T17:24:43.223 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:43.230 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:43.231 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:43.233 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:43.233 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:43.622 INFO:teuthology.orchestra.run.smithi152.stdout:generic/481 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:43.627 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/481 2024-03-18T17:24:43.628 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/481 2024-03-18T17:24:43.628 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:43.631 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:43.651 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:43.651 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2024-03-18T17:24:43.968 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:43.976 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:43.977 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:43.979 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:43.979 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:44.410 INFO:teuthology.orchestra.run.smithi152.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2024-03-18T17:24:44.415 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/482 2024-03-18T17:24:44.415 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/482 2024-03-18T17:24:44.415 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:44.418 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:44.445 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:44.446 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2024-03-18T17:24:44.756 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:44.765 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:44.766 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:44.766 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:44.766 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:45.127 INFO:teuthology.orchestra.run.smithi152.stdout:generic/483 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:45.133 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/483 2024-03-18T17:24:45.133 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/483 2024-03-18T17:24:45.133 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:45.137 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:45.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:45.162 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2024-03-18T17:24:45.463 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:45.467 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:45.468 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:45.469 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:45.469 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:45.950 INFO:teuthology.orchestra.run.smithi152.stdout:generic/484 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:45.956 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/484 2024-03-18T17:24:45.956 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/484 2024-03-18T17:24:45.956 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:45.961 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:45.982 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:45.982 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2024-03-18T17:24:46.370 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:46.375 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:46.376 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:46.376 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:46.376 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:46.763 INFO:teuthology.orchestra.run.smithi152.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T17:24:46.768 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/485 2024-03-18T17:24:46.768 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/485 2024-03-18T17:24:46.768 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:46.773 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:46.808 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:46.808 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2024-03-18T17:24:47.106 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:47.114 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:47.115 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:47.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:47.767 INFO:teuthology.orchestra.run.smithi152.stdout:generic/486 0s 2024-03-18T17:24:47.778 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/486 2024-03-18T17:24:47.778 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:47.782 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:47.794 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:47.795 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2024-03-18T17:24:48.095 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:48.104 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:48.105 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:48.106 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:48.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:48.465 INFO:teuthology.orchestra.run.smithi152.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2024-03-18T17:24:48.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/487 2024-03-18T17:24:48.471 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/487 2024-03-18T17:24:48.471 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:48.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:48.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:48.494 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2024-03-18T17:24:48.773 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:48.778 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:48.779 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:48.780 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:48.780 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:49.113 INFO:teuthology.orchestra.run.smithi152.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T17:24:49.119 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/488 2024-03-18T17:24:49.119 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/488 2024-03-18T17:24:49.119 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:49.161 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:49.161 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2024-03-18T17:24:49.487 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:49.491 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:49.492 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:49.494 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:49.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:49.852 INFO:teuthology.orchestra.run.smithi152.stdout:generic/489 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:49.858 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/489 2024-03-18T17:24:49.858 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/489 2024-03-18T17:24:49.858 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:49.861 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:49.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:49.884 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2024-03-18T17:24:50.194 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:50.199 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:50.200 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:50.201 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:50.201 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:52.097 INFO:teuthology.orchestra.run.smithi152.stdout:generic/490 2s 2024-03-18T17:24:52.112 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/490 2024-03-18T17:24:52.112 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:52.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:52.197 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:52.198 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2024-03-18T17:24:52.635 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:52.640 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:52.641 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:52.647 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:52.647 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:53.966 INFO:teuthology.orchestra.run.smithi152.stdout:generic/491 [not run] ceph does not support freezing 2024-03-18T17:24:53.971 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/491 2024-03-18T17:24:53.972 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/491 2024-03-18T17:24:53.972 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:53.975 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:54.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:54.006 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2024-03-18T17:24:54.311 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:54.318 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:54.318 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:54.319 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:54.319 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:54.671 INFO:teuthology.orchestra.run.smithi152.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2024-03-18T17:24:54.677 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/492 2024-03-18T17:24:54.677 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/492 2024-03-18T17:24:54.677 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:54.683 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:54.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:54.701 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2024-03-18T17:24:54.978 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:54.982 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:54.982 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:54.984 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:54.984 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:55.588 INFO:teuthology.orchestra.run.smithi152.stdout:generic/493 [not run] swapfiles are not supported 2024-03-18T17:24:55.594 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/493 2024-03-18T17:24:55.594 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/493 2024-03-18T17:24:55.594 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:55.597 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:55.624 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:55.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2024-03-18T17:24:55.923 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:55.928 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:55.929 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:55.931 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:55.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:56.476 INFO:teuthology.orchestra.run.smithi152.stdout:generic/494 [not run] swapfiles are not supported 2024-03-18T17:24:56.482 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/494 2024-03-18T17:24:56.482 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/494 2024-03-18T17:24:56.482 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:56.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:56.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:56.514 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2024-03-18T17:24:56.804 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:56.813 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:56.813 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:56.814 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:56.814 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:57.364 INFO:teuthology.orchestra.run.smithi152.stdout:generic/495 [not run] swapfiles are not supported 2024-03-18T17:24:57.369 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/495 2024-03-18T17:24:57.369 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/495 2024-03-18T17:24:57.369 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:57.372 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:57.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:57.408 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2024-03-18T17:24:57.697 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:57.702 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:57.703 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:57.704 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:57.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:58.211 INFO:teuthology.orchestra.run.smithi152.stdout:generic/496 [not run] swapfiles are not supported 2024-03-18T17:24:58.216 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/496 2024-03-18T17:24:58.217 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/496 2024-03-18T17:24:58.217 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:58.220 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:58.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:58.245 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2024-03-18T17:24:58.548 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:58.553 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:58.553 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:58.555 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:58.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:59.054 INFO:teuthology.orchestra.run.smithi152.stdout:generic/497 [not run] swapfiles are not supported 2024-03-18T17:24:59.060 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/497 2024-03-18T17:24:59.060 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/497 2024-03-18T17:24:59.060 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:59.064 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:59.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:59.096 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2024-03-18T17:24:59.386 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:24:59.390 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:24:59.391 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:24:59.393 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:24:59.393 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:59.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/498 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:24:59.776 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/498 2024-03-18T17:24:59.776 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/498 2024-03-18T17:24:59.776 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:24:59.779 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:24:59.811 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:24:59.812 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2024-03-18T17:25:00.101 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:00.106 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:00.107 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:00.107 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:00.438 INFO:teuthology.orchestra.run.smithi152.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T17:25:00.445 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/499 2024-03-18T17:25:00.445 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/499 2024-03-18T17:25:00.445 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:00.448 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:00.483 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:00.483 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2024-03-18T17:25:00.764 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:00.768 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:00.770 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:00.771 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:00.772 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:01.138 INFO:teuthology.orchestra.run.smithi152.stdout:generic/500 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:25:01.143 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/500 2024-03-18T17:25:01.144 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/500 2024-03-18T17:25:01.144 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:01.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:01.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:01.166 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2024-03-18T17:25:01.475 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:01.480 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:01.481 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:01.482 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:01.482 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:02.043 INFO:teuthology.orchestra.run.smithi152.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T17:25:02.050 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/501 2024-03-18T17:25:02.050 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/501 2024-03-18T17:25:02.050 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:02.052 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:02.316 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:02.317 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2024-03-18T17:25:02.697 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:02.703 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:02.703 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:02.705 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:02.705 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:03.090 INFO:teuthology.orchestra.run.smithi152.stdout:generic/502 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:25:03.094 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/502 2024-03-18T17:25:03.094 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/502 2024-03-18T17:25:03.094 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:03.097 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:03.130 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:03.130 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2024-03-18T17:25:03.401 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:03.405 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:03.406 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:03.407 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:03.407 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:03.755 INFO:teuthology.orchestra.run.smithi152.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T17:25:03.760 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/503 2024-03-18T17:25:03.761 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/503 2024-03-18T17:25:03.761 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:03.765 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:03.795 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:03.795 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2024-03-18T17:25:04.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:04.099 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:04.099 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:04.100 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:04.101 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:04.546 INFO:teuthology.orchestra.run.smithi152.stdout:generic/504 0s 2024-03-18T17:25:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/504 2024-03-18T17:25:04.556 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:04.559 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:04.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:04.590 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2024-03-18T17:25:04.868 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:04.873 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:04.873 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:04.874 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:04.874 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:05.301 INFO:teuthology.orchestra.run.smithi152.stdout:generic/505 [not run] ceph does not support shutdown 2024-03-18T17:25:05.324 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/505 2024-03-18T17:25:05.324 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/505 2024-03-18T17:25:05.324 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:05.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:05.353 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:05.354 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2024-03-18T17:25:05.638 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:05.644 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:05.645 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:05.646 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:05.646 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:05.957 INFO:teuthology.orchestra.run.smithi152.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T17:25:05.962 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/506 2024-03-18T17:25:05.962 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/506 2024-03-18T17:25:05.962 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:05.966 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:05.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:05.991 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2024-03-18T17:25:06.299 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:06.305 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:06.305 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:06.306 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:06.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:06.667 INFO:teuthology.orchestra.run.smithi152.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2024-03-18T17:25:06.673 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/507 2024-03-18T17:25:06.673 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/507 2024-03-18T17:25:06.673 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:06.675 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:06.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:06.714 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2024-03-18T17:25:06.989 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:06.995 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:06.996 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:06.998 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:06.998 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:07.317 INFO:teuthology.orchestra.run.smithi152.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2024-03-18T17:25:07.322 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/508 2024-03-18T17:25:07.322 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/508 2024-03-18T17:25:07.322 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:07.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:07.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:07.356 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2024-03-18T17:25:07.659 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:07.665 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:07.665 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:07.667 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:07.667 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:07.990 INFO:teuthology.orchestra.run.smithi152.stdout:generic/509 [not run] O_TMPFILE is not supported 2024-03-18T17:25:07.997 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/509 2024-03-18T17:25:07.997 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/509 2024-03-18T17:25:07.997 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:08.001 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:08.023 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:08.023 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2024-03-18T17:25:08.310 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:08.316 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:08.316 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:08.318 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:08.318 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:08.650 INFO:teuthology.orchestra.run.smithi152.stdout:generic/510 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:25:08.655 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/510 2024-03-18T17:25:08.655 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/510 2024-03-18T17:25:08.655 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:08.658 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:08.678 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:08.678 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2024-03-18T17:25:08.966 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:08.971 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:08.972 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:08.973 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:08.973 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:09.309 INFO:teuthology.orchestra.run.smithi152.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2024-03-18T17:25:09.315 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/511 2024-03-18T17:25:09.315 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/511 2024-03-18T17:25:09.315 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:09.318 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:09.347 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:09.348 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2024-03-18T17:25:09.636 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:09.641 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:09.641 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:09.642 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:09.642 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:09.983 INFO:teuthology.orchestra.run.smithi152.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T17:25:09.989 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/512 2024-03-18T17:25:09.989 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/512 2024-03-18T17:25:09.989 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:09.993 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:10.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:10.024 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2024-03-18T17:25:10.322 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:10.327 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:10.328 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:10.329 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:10.329 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:10.881 INFO:teuthology.orchestra.run.smithi152.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T17:25:10.887 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/513 2024-03-18T17:25:10.887 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/513 2024-03-18T17:25:10.887 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:10.890 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:11.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:11.121 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2024-03-18T17:25:11.519 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:11.528 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:11.529 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:11.531 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:11.531 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:12.075 INFO:teuthology.orchestra.run.smithi152.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T17:25:12.081 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/514 2024-03-18T17:25:12.081 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/514 2024-03-18T17:25:12.081 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:12.085 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:12.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:12.302 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2024-03-18T17:25:12.678 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:12.683 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:12.683 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:12.686 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:12.686 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:13.227 INFO:teuthology.orchestra.run.smithi152.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T17:25:13.234 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/515 2024-03-18T17:25:13.235 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/515 2024-03-18T17:25:13.235 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:13.240 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:13.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:13.484 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2024-03-18T17:25:13.853 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:13.864 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:13.864 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:13.865 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:13.865 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:14.281 INFO:teuthology.orchestra.run.smithi152.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2024-03-18T17:25:14.285 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/516 2024-03-18T17:25:14.285 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/516 2024-03-18T17:25:14.285 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:14.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:14.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:14.365 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2024-03-18T17:25:14.812 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:14.828 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:14.829 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:14.835 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:14.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:15.312 INFO:teuthology.orchestra.run.smithi152.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T17:25:15.365 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/517 2024-03-18T17:25:15.365 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/517 2024-03-18T17:25:15.365 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:15.368 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:15.668 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:15.669 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2024-03-18T17:25:15.987 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:15.992 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:15.993 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:15.994 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:16.544 INFO:teuthology.orchestra.run.smithi152.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T17:25:16.549 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/518 2024-03-18T17:25:16.549 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/518 2024-03-18T17:25:16.549 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:16.555 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:16.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:16.840 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2024-03-18T17:25:17.244 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:17.249 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:17.250 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:17.251 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:17.251 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:17.684 INFO:teuthology.orchestra.run.smithi152.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2024-03-18T17:25:17.689 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/519 2024-03-18T17:25:17.690 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/519 2024-03-18T17:25:17.690 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:17.693 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:17.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:17.766 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2024-03-18T17:25:18.160 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:18.171 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:18.171 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:18.172 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:18.172 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:18.564 INFO:teuthology.orchestra.run.smithi152.stdout:generic/520 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T17:25:18.570 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/520 2024-03-18T17:25:18.570 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/520 2024-03-18T17:25:18.570 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T17:25:18.573 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:25:18.600 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T17:25:18.600 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2024-03-18T17:25:18.906 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T17:25:18.911 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T17:25:18.911 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T17:25:18.912 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T17:25:18.912 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T17:27:50.972 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:27:50.976 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:28:21.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:28:21.245 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:28:51.531 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:28:51.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:29:21.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:29:21.601 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:29:51.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:29:51.672 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:30:21.790 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:30:21.794 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:30:51.887 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:30:51.890 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:30:51.938 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T17:30:51.938+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580543) UID: 0 2024-03-18T17:30:51.938 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T17:30:51.938+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580543) UID: 0 2024-03-18T17:30:51.939 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T17:30:51.938+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580543) UID: 0 2024-03-18T17:30:51.939 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T17:30:51.938+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580543) UID: 0 2024-03-18T17:34:17.243 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:34:17.248 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:34:47.355 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:34:47.358 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:34:47.402 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T17:34:47.401+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580584) UID: 0 2024-03-18T17:34:47.403 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T17:34:47.401+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580584) UID: 0 2024-03-18T17:34:47.403 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T17:34:47.402+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580584) UID: 0 2024-03-18T17:34:47.404 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T17:34:47.402+0000 7fcb8fbc4640 -1 received signal: Hangup from (PID: 580584) UID: 0 2024-03-18T17:38:09.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:38:09.577 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:38:39.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:38:39.944 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:39:10.009 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:39:10.013 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:39:40.119 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:39:40.123 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:40:10.242 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:40:10.250 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:40:40.627 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:40:40.631 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:41:10.701 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:41:10.704 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:41:40.794 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:41:40.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:42:10.876 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:42:10.879 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:42:40.996 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:42:41.000 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:43:11.102 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:43:11.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:43:41.217 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:43:41.220 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:44:11.350 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:44:11.354 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:44:41.432 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:44:41.435 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:45:11.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:45:11.512 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:45:41.874 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:45:41.877 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:46:12.023 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:46:12.027 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:46:42.098 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:46:42.102 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:47:12.185 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:47:12.188 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:47:12.322 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T17:47:12.321+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49880) UID: 0 2024-03-18T17:47:12.323 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T17:47:12.321+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49880) UID: 0 2024-03-18T17:47:12.323 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T17:47:12.322+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49880) UID: 0 2024-03-18T17:47:12.354 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T17:47:12.322+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 49880) UID: 0 2024-03-18T17:50:16.151 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:50:16.156 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:50:46.489 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:50:46.492 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:50:46.550 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T17:50:46.548+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580973) UID: 0 2024-03-18T17:50:46.550 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T17:50:46.548+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580973) UID: 0 2024-03-18T17:50:46.551 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T17:50:46.548+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 580973) UID: 0 2024-03-18T17:50:46.551 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T17:50:46.549+0000 7fcb8fbc4640 -1 Fail to open '/proc/580973/cmdline' error = (2) No such file or directory 2024-03-18T17:50:46.551 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T17:50:46.549+0000 7fcb8fbc4640 -1 received signal: Hangup from (PID: 580973) UID: 0 2024-03-18T17:54:09.329 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:54:09.332 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:54:39.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:54:39.411 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:55:09.799 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:55:09.802 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:55:40.177 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:55:40.180 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:56:10.259 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:56:10.263 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:56:40.338 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:56:40.341 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:56:40.378 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T17:56:40.377+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50032) UID: 0 2024-03-18T17:56:40.378 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T17:56:40.377+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50032) UID: 0 2024-03-18T17:56:40.379 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T17:56:40.377+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50032) UID: 0 2024-03-18T17:56:40.379 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T17:56:40.377+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50032) UID: 0 2024-03-18T17:59:37.046 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:59:37.049 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T17:59:37.088 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T17:59:37.086+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50055) UID: 0 2024-03-18T17:59:37.088 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T17:59:37.086+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50055) UID: 0 2024-03-18T17:59:37.089 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T17:59:37.086+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50055) UID: 0 2024-03-18T17:59:37.089 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T17:59:37.087+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50055) UID: 0 2024-03-18T18:05:16.621 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:05:16.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:05:46.718 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:05:46.721 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:06:16.992 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:06:16.995 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:06:17.041 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T18:06:17.039+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581188) UID: 0 2024-03-18T18:06:17.041 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T18:06:17.039+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581188) UID: 0 2024-03-18T18:06:17.041 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T18:06:17.039+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581188) UID: 0 2024-03-18T18:06:17.042 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T18:06:17.039+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581188) UID: 0 2024-03-18T18:09:36.136 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:09:36.140 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:09:36.405 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T18:09:36.405+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581211) UID: 0 2024-03-18T18:09:36.405 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T18:09:36.405+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581211) UID: 0 2024-03-18T18:09:36.406 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T18:09:36.405+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581211) UID: 0 2024-03-18T18:09:36.406 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T18:09:36.405+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581211) UID: 0 2024-03-18T18:13:11.389 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:11.392 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:13:11.463 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T18:13:11.463+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 581235) UID: 0 2024-03-18T18:13:11.463 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T18:13:11.463+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 581235) UID: 0 2024-03-18T18:16:20.275 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T18:16:20.276+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581240) UID: 0 2024-03-18T18:16:20.276 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T18:16:20.277+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581240) UID: 0 2024-03-18T18:16:20.277 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T18:16:20.277+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581240) UID: 0 2024-03-18T18:16:20.277 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T18:16:20.277+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581240) UID: 0 2024-03-18T18:19:39.429 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:19:39.434 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:09.555 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:09.558 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:39.694 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:20:39.697 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:09.859 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:09.862 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:39.925 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:21:39.928 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:10.007 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:10.010 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:40.104 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:22:40.106 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:23:10.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:23:10.263 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:23:40.559 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:23:40.562 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:24:10.632 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:24:10.635 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:24:40.760 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:24:40.764 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:10.858 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:10.862 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:40.947 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:25:40.950 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:11.089 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:11.092 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:41.227 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:26:41.229 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:11.316 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:11.319 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:41.422 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:27:41.425 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:28:11.527 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:28:11.530 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:28:41.592 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:28:41.596 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:29:11.873 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:29:11.876 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:29:42.194 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:29:42.196 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:30:12.511 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:30:12.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:30:42.583 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:30:42.586 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:31:12.713 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:31:12.716 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:31:42.795 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:31:42.798 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:32:13.094 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:32:13.097 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:32:43.374 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:32:43.377 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:33:13.469 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:33:13.472 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:33:43.561 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:33:43.564 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:34:13.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:34:13.668 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:34:43.981 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:34:43.986 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:35:14.062 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:35:14.064 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:35:14.153 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T18:35:14.156+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50764) UID: 0 2024-03-18T18:35:14.153 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T18:35:14.156+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50764) UID: 0 2024-03-18T18:35:14.153 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T18:35:14.156+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50764) UID: 0 2024-03-18T18:35:14.159 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T18:35:14.156+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50764) UID: 0 2024-03-18T18:38:13.669 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:38:13.673 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:38:13.713 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T18:38:13.716+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50785) UID: 0 2024-03-18T18:38:13.714 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T18:38:13.717+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50785) UID: 0 2024-03-18T18:38:13.714 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T18:38:13.717+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50785) UID: 0 2024-03-18T18:38:13.714 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T18:38:13.717+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50785) UID: 0 2024-03-18T18:38:13.735 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T18:38:13.738+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581850) UID: 0 2024-03-18T18:38:13.735 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T18:38:13.738+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581850) UID: 0 2024-03-18T18:38:13.735 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T18:38:13.738+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581850) UID: 0 2024-03-18T18:38:13.738 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T18:38:13.738+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581850) UID: 0 2024-03-18T18:44:25.775 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:44:25.781 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:44:45.645 INFO:teuthology.orchestra.run.smithi152.stdout:generic/521 4766s 2024-03-18T18:44:45.683 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/521 2024-03-18T18:44:45.684 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T18:44:45.692 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T18:44:45.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T18:44:45.743 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2024-03-18T18:44:46.313 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T18:44:46.317 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T18:44:46.317 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T18:44:46.318 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T18:44:46.318 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T18:44:56.432 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:44:56.435 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:45:26.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:45:26.537 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:45:56.624 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:45:56.630 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:46:27.002 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:46:27.009 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:46:57.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:46:57.103 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:47:27.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:47:27.195 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:47:27.235 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T18:47:27.239+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50924) UID: 0 2024-03-18T18:47:27.236 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T18:47:27.239+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50924) UID: 0 2024-03-18T18:47:27.236 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T18:47:27.239+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50924) UID: 0 2024-03-18T18:47:27.237 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T18:47:27.239+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 50924) UID: 0 2024-03-18T18:50:23.749 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:50:23.753 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:50:54.072 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:50:54.076 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:51:24.377 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:51:24.381 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:51:54.769 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:51:54.772 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:52:24.850 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:52:24.857 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:52:54.945 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:52:54.948 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:53:25.044 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:53:25.047 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:53:55.109 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:53:55.114 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:54:25.340 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:54:25.343 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:54:55.455 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:54:55.458 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:55:25.550 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:55:25.553 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:55:55.656 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:55:55.659 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:56:25.740 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:56:25.743 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:56:56.057 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:56:56.060 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:57:26.128 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:57:26.130 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:57:56.493 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:57:56.496 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:58:26.635 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:58:26.638 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T18:58:26.686 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T18:58:26.689+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582778) UID: 0 2024-03-18T18:58:26.687 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T18:58:26.689+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582778) UID: 0 2024-03-18T18:58:26.687 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T18:58:26.689+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582778) UID: 0 2024-03-18T18:58:26.687 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T18:58:26.689+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 582778) UID: 0 2024-03-18T19:01:41.190 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:01:41.193 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:01:41.419 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:01:41.423+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51271) UID: 0 2024-03-18T19:01:41.420 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T19:01:41.423+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51271) UID: 0 2024-03-18T19:01:41.420 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:01:41.423+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51271) UID: 0 2024-03-18T19:01:41.420 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:01:41.423+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51271) UID: 0 2024-03-18T19:04:59.535 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:04:59.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:05:29.977 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:05:29.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:06:00.060 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:06:00.063 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:06:30.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:06:30.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:07:00.261 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:07:00.264 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:07:30.332 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:07:30.335 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:08:00.458 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:08:00.461 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:08:30.536 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:08:30.540 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:09:00.959 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:09:00.963 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:09:31.048 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:09:31.051 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:10:01.141 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:10:01.144 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:10:31.260 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:10:31.265 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:11:01.440 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:11:01.444 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:11:31.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:11:31.525 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:12:01.598 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:12:01.601 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:12:31.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:12:31.725 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:13:01.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:13:01.839 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:13:31.909 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:13:31.912 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:13:32.033 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T19:13:32.037+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 583146) UID: 0 2024-03-18T19:13:32.033 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T19:13:32.037+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 583146) UID: 0 2024-03-18T19:16:59.546 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:16:59.550 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:17:30.192 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:17:30.195 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:18:00.269 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:18:00.272 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:18:00.306 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:18:00.307+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51665) UID: 0 2024-03-18T19:18:00.307 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:18:00.307+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51665) UID: 0 2024-03-18T19:18:00.307 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T19:18:00.307+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51665) UID: 0 2024-03-18T19:18:00.307 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:18:00.307+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51665) UID: 0 2024-03-18T19:21:08.884 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:21:08.887 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:21:39.040 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:21:39.043 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:22:09.129 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:22:09.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:22:39.204 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:22:39.208 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:22:39.248 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T19:22:39.246+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51744) UID: 0 2024-03-18T19:22:39.249 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:22:39.248+0000 7f5475636640 -1 Fail to open '/proc/51744/cmdline' error = (2) No such file or directory 2024-03-18T19:22:39.249 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:22:39.248+0000 7f5475636640 -1 received signal: Hangup from (PID: 51744) UID: 0 2024-03-18T19:22:39.250 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:22:39.248+0000 7efef7dba640 -1 Fail to open '/proc/51744/cmdline' error = (2) No such file or directory 2024-03-18T19:22:39.250 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:22:39.248+0000 7efef7dba640 -1 received signal: Hangup from (PID: 51744) UID: 0 2024-03-18T19:22:39.250 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:22:39.249+0000 7f695b7f9640 -1 Fail to open '/proc/51744/cmdline' error = (2) No such file or directory 2024-03-18T19:22:39.250 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:22:39.249+0000 7f695b7f9640 -1 received signal: Hangup from (PID: 51744) UID: 0 2024-03-18T19:25:51.724 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:25:51.728 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:26:21.809 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:26:21.812 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:26:21.860 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T19:26:21.856+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583316) UID: 0 2024-03-18T19:26:21.860 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T19:26:21.857+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583316) UID: 0 2024-03-18T19:26:21.861 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T19:26:21.857+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583316) UID: 0 2024-03-18T19:26:21.861 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T19:26:21.857+0000 7f91da83c640 -1 Fail to open '/proc/583316/cmdline' error = (2) No such file or directory 2024-03-18T19:26:21.861 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T19:26:21.857+0000 7f91da83c640 -1 received signal: Hangup from (PID: 583316) UID: 0 2024-03-18T19:29:39.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:29:39.852 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:29:39.912 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T19:29:39.908+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583339) UID: 0 2024-03-18T19:29:39.913 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T19:29:39.908+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583339) UID: 0 2024-03-18T19:29:39.913 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T19:29:39.908+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583339) UID: 0 2024-03-18T19:29:39.913 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T19:29:39.908+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583339) UID: 0 2024-03-18T19:33:03.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:33:03.081 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:33:33.220 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:33:33.225 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:33:33.257 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T19:33:33.252+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583380) UID: 0 2024-03-18T19:33:33.257 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T19:33:33.252+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583380) UID: 0 2024-03-18T19:33:33.258 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T19:33:33.252+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583380) UID: 0 2024-03-18T19:33:33.259 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T19:33:33.253+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 583380) UID: 0 2024-03-18T19:33:33.265 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:33:33.261+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51847) UID: 0 2024-03-18T19:33:33.266 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:33:33.261+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51847) UID: 0 2024-03-18T19:33:33.266 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T19:33:33.261+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 51847) UID: 0 2024-03-18T19:33:33.267 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:33:33.262+0000 7f695b7f9640 -1 Fail to open '/proc/51847/cmdline' error = (2) No such file or directory 2024-03-18T19:33:33.267 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:33:33.262+0000 7f695b7f9640 -1 received signal: Hangup from (PID: 51847) UID: 0 2024-03-18T19:36:47.394 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:36:47.397 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:37:17.684 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:37:17.688 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:37:42.289 INFO:teuthology.orchestra.run.smithi152.stdout:generic/522 3176s 2024-03-18T19:37:42.328 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/522 2024-03-18T19:37:42.328 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:42.469 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:42.469 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2024-03-18T19:37:43.112 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:43.118 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:43.118 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:43.119 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:43.119 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:43.716 INFO:teuthology.orchestra.run.smithi152.stdout:generic/523 0s 2024-03-18T19:37:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/523 2024-03-18T19:37:43.725 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:43.728 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:43.737 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:43.738 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2024-03-18T19:37:43.988 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:43.993 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:43.993 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:43.995 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:43.995 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:47.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:37:47.825 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:37:48.364 INFO:teuthology.orchestra.run.smithi152.stdout:generic/524 4s 2024-03-18T19:37:48.374 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/524 2024-03-18T19:37:48.374 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:48.378 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:48.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:48.389 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2024-03-18T19:37:48.677 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:48.683 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:48.683 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:48.684 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:48.685 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:49.132 INFO:teuthology.orchestra.run.smithi152.stdout:generic/525 [not run] filesystem does not support huge file size 2024-03-18T19:37:49.147 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/525 2024-03-18T19:37:49.147 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/525 2024-03-18T19:37:49.147 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:49.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:49.176 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:49.176 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2024-03-18T19:37:49.437 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:49.441 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:49.442 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:49.443 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:49.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:49.812 INFO:teuthology.orchestra.run.smithi152.stdout:generic/526 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T19:37:49.818 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/526 2024-03-18T19:37:49.818 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/526 2024-03-18T19:37:49.818 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:49.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:49.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:49.850 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2024-03-18T19:37:50.128 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:50.132 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:50.132 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:50.133 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:50.133 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:50.469 INFO:teuthology.orchestra.run.smithi152.stdout:generic/527 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T19:37:50.474 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/527 2024-03-18T19:37:50.474 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/527 2024-03-18T19:37:50.474 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:50.477 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:50.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:50.513 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2024-03-18T19:37:50.787 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:50.796 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:50.796 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:50.797 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:50.797 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:51.204 INFO:teuthology.orchestra.run.smithi152.stdout:generic/528 1s 2024-03-18T19:37:51.214 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/528 2024-03-18T19:37:51.214 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:51.217 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:51.263 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:51.263 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2024-03-18T19:37:51.668 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:51.677 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:51.677 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:51.678 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:51.679 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:52.262 INFO:teuthology.orchestra.run.smithi152.stdout:generic/529 1s 2024-03-18T19:37:52.270 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/529 2024-03-18T19:37:52.270 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:52.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:52.284 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:52.284 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2024-03-18T19:37:52.536 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:52.541 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:52.541 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:52.542 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:52.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:52.966 INFO:teuthology.orchestra.run.smithi152.stdout:generic/530 [not run] ceph does not support shutdown 2024-03-18T19:37:52.980 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/530 2024-03-18T19:37:52.980 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/530 2024-03-18T19:37:52.980 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:52.983 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:53.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:53.007 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2024-03-18T19:37:53.271 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:53.279 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:53.280 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:53.281 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:53.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:53.579 INFO:teuthology.orchestra.run.smithi152.stdout:generic/531 [not run] O_TMPFILE is not supported 2024-03-18T19:37:53.584 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/531 2024-03-18T19:37:53.584 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/531 2024-03-18T19:37:53.584 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:53.587 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:53.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:53.616 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2024-03-18T19:37:53.889 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:53.897 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:53.898 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:53.899 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:53.900 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:54.271 INFO:teuthology.orchestra.run.smithi152.stdout:generic/532 0s 2024-03-18T19:37:54.280 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/532 2024-03-18T19:37:54.280 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:54.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:54.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:54.312 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2024-03-18T19:37:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:54.605 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:54.606 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:54.607 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:54.607 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:55.604 INFO:teuthology.orchestra.run.smithi152.stdout:generic/533 1s 2024-03-18T19:37:55.612 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/533 2024-03-18T19:37:55.612 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:55.615 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:55.636 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:55.636 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2024-03-18T19:37:55.894 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:55.899 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:55.901 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:55.901 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:55.901 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:56.226 INFO:teuthology.orchestra.run.smithi152.stdout:generic/534 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T19:37:56.231 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/534 2024-03-18T19:37:56.231 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/534 2024-03-18T19:37:56.231 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:56.234 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:56.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:56.254 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2024-03-18T19:37:56.536 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:56.542 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:56.543 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:56.544 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:56.544 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:56.858 INFO:teuthology.orchestra.run.smithi152.stdout:generic/535 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T19:37:56.862 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/535 2024-03-18T19:37:56.862 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/535 2024-03-18T19:37:56.863 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:56.865 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:56.892 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:56.892 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2024-03-18T19:37:57.170 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:57.175 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:57.175 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:57.176 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:57.176 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:57.581 INFO:teuthology.orchestra.run.smithi152.stdout:generic/536 [not run] ceph does not support shutdown 2024-03-18T19:37:57.595 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/536 2024-03-18T19:37:57.595 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/536 2024-03-18T19:37:57.595 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:57.598 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:57.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:57.621 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2024-03-18T19:37:57.917 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:57.922 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:57.923 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:57.925 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:57.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:58.340 INFO:teuthology.orchestra.run.smithi152.stdout:generic/537 [not run] FSTRIM not supported 2024-03-18T19:37:58.355 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/537 2024-03-18T19:37:58.355 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/537 2024-03-18T19:37:58.355 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:37:58.359 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:37:58.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:37:58.387 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2024-03-18T19:37:58.654 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:37:58.659 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:37:58.659 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:37:58.660 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:37:58.660 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:38:17.890 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:38:17.893 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:38:47.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:38:47.997 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:39:18.100 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:39:18.103 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:39:48.460 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:39:48.465 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:40:18.539 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:40:18.544 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:40:48.651 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:40:48.656 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:41:18.745 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:41:18.748 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:41:18.799 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T19:41:18.793+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594209) UID: 0 2024-03-18T19:41:18.799 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T19:41:18.793+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594209) UID: 0 2024-03-18T19:41:18.800 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T19:41:18.793+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594209) UID: 0 2024-03-18T19:41:18.800 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T19:41:18.793+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 594209) UID: 0 2024-03-18T19:44:35.956 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:44:35.960 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:45:06.134 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:45:06.136 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:45:36.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:45:36.384 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:45:55.645 INFO:teuthology.orchestra.run.smithi152.stdout:generic/538 477s 2024-03-18T19:45:55.651 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/538 2024-03-18T19:45:55.652 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:45:55.655 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:45:55.690 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:45:55.690 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2024-03-18T19:45:56.220 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:45:56.225 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:45:56.225 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:45:56.226 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:45:56.226 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:45:58.318 INFO:teuthology.orchestra.run.smithi152.stdout:generic/539 2s 2024-03-18T19:45:58.326 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/539 2024-03-18T19:45:58.326 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:45:58.328 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:45:58.401 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:45:58.401 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2024-03-18T19:45:58.808 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:45:58.820 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:45:58.820 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:45:58.821 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:45:58.821 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:45:59.414 INFO:teuthology.orchestra.run.smithi152.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T19:45:59.423 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/540 2024-03-18T19:45:59.423 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/540 2024-03-18T19:45:59.423 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:45:59.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:45:59.747 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:45:59.748 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2024-03-18T19:46:00.128 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:00.134 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:00.135 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:00.136 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:00.136 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:00.711 INFO:teuthology.orchestra.run.smithi152.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T19:46:00.717 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/541 2024-03-18T19:46:00.717 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/541 2024-03-18T19:46:00.717 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:00.720 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:01.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:01.048 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2024-03-18T19:46:01.392 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:01.398 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:01.398 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:01.399 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:01.399 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:01.919 INFO:teuthology.orchestra.run.smithi152.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T19:46:01.926 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/542 2024-03-18T19:46:01.926 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/542 2024-03-18T19:46:01.926 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:01.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:02.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:02.225 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2024-03-18T19:46:02.536 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:02.540 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:02.541 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:02.542 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:02.542 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:03.087 INFO:teuthology.orchestra.run.smithi152.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T19:46:03.093 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/543 2024-03-18T19:46:03.093 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/543 2024-03-18T19:46:03.094 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:03.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:03.437 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:03.438 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2024-03-18T19:46:03.742 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:03.759 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:03.759 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:03.761 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:03.761 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:04.277 INFO:teuthology.orchestra.run.smithi152.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T19:46:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/544 2024-03-18T19:46:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/544 2024-03-18T19:46:04.285 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:04.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:04.622 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:04.622 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2024-03-18T19:46:04.946 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:04.951 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:04.952 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:04.953 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:04.954 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:05.376 INFO:teuthology.orchestra.run.smithi152.stdout:generic/545 [not run] file system doesn't support chattr +i 2024-03-18T19:46:05.381 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/545 2024-03-18T19:46:05.381 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/545 2024-03-18T19:46:05.381 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:05.384 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:05.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:05.444 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2024-03-18T19:46:05.731 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:05.738 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:05.738 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:06.081 INFO:teuthology.orchestra.run.smithi152.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T19:46:06.086 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/546 2024-03-18T19:46:06.086 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/546 2024-03-18T19:46:06.087 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:06.089 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:06.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:06.129 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2024-03-18T19:46:06.386 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:06.390 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:06.391 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:06.392 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:06.392 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:06.454 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:46:06.457 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:46:06.490 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T19:46:06.484+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52154) UID: 0 2024-03-18T19:46:06.490 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T19:46:06.484+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52154) UID: 0 2024-03-18T19:46:06.491 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T19:46:06.484+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52154) UID: 0 2024-03-18T19:46:06.491 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T19:46:06.484+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 52154) UID: 0 2024-03-18T19:46:06.717 INFO:teuthology.orchestra.run.smithi152.stdout:generic/547 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T19:46:06.723 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/547 2024-03-18T19:46:06.723 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/547 2024-03-18T19:46:06.723 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:06.727 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:06.748 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:06.748 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2024-03-18T19:46:07.020 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:07.026 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:07.026 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:07.027 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:07.027 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:07.500 INFO:teuthology.orchestra.run.smithi152.stdout:generic/548 [not run] kernel does not support ceph encryption 2024-03-18T19:46:07.515 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/548 2024-03-18T19:46:07.515 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/548 2024-03-18T19:46:07.515 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:07.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:07.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:07.537 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2024-03-18T19:46:07.805 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:07.809 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:07.810 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:07.811 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:07.811 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:08.329 INFO:teuthology.orchestra.run.smithi152.stdout:generic/549 [not run] kernel does not support ceph encryption 2024-03-18T19:46:08.355 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/549 2024-03-18T19:46:08.355 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/549 2024-03-18T19:46:08.355 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:08.357 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:08.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:08.386 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2024-03-18T19:46:08.633 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:08.639 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:08.639 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:08.641 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:08.641 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:09.117 INFO:teuthology.orchestra.run.smithi152.stdout:generic/550 [not run] kernel does not support ceph encryption 2024-03-18T19:46:09.131 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/550 2024-03-18T19:46:09.131 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/550 2024-03-18T19:46:09.131 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T19:46:09.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:46:09.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T19:46:09.160 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2024-03-18T19:46:09.434 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T19:46:09.440 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T19:46:09.440 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T19:46:09.441 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T19:46:09.441 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T19:49:13.681 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:49:13.685 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:49:44.058 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:49:44.061 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:50:14.146 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:50:14.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:50:44.308 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:50:44.311 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:51:14.574 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:51:14.578 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:51:44.838 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:51:44.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:52:14.911 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:52:14.914 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:52:45.125 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:52:45.130 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:53:15.248 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:53:15.251 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:53:45.344 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:53:45.350 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:54:15.425 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:54:15.429 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:54:45.564 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:54:45.568 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:55:15.662 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:55:15.665 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:55:45.741 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:55:45.744 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:56:15.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:56:15.912 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:56:46.013 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:56:46.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:57:17.314 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:57:17.318 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:57:47.538 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:57:47.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:58:17.622 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:58:17.625 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:58:47.735 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:58:47.738 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:59:17.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:59:17.855 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:59:48.189 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T19:59:48.194 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:00:01.304 INFO:teuthology.orchestra.run.smithi152.stdout:generic/551 832s 2024-03-18T20:00:01.345 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/551 2024-03-18T20:00:01.345 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:01.348 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:01.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:01.368 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/552) 2024-03-18T20:00:01.829 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:01.834 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:01.834 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:01.835 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:01.835 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:02.306 INFO:teuthology.orchestra.run.smithi152.stdout:generic/552 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:00:02.312 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/552 2024-03-18T20:00:02.313 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/552 2024-03-18T20:00:02.313 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:02.315 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:02.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:02.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/553) 2024-03-18T20:00:02.611 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:02.621 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:02.621 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:02.622 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:02.623 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:03.001 INFO:teuthology.orchestra.run.smithi152.stdout:generic/553 [not run] xfs_io chattr +i failed (old kernel/wrong fs?) 2024-03-18T20:00:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/553 2024-03-18T20:00:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/553 2024-03-18T20:00:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:03.008 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:03.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:03.058 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/554) 2024-03-18T20:00:03.585 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:03.590 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:03.591 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:03.594 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:03.594 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:04.152 INFO:teuthology.orchestra.run.smithi152.stdout:generic/554 [not run] swapfiles are not supported 2024-03-18T20:00:04.157 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/554 2024-03-18T20:00:04.157 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/554 2024-03-18T20:00:04.157 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:04.160 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:04.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:04.204 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/555) 2024-03-18T20:00:04.640 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:04.650 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:04.651 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:04.654 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:04.654 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:05.073 INFO:teuthology.orchestra.run.smithi152.stdout:generic/555 [not run] xfs_io chattr +ia failed (old kernel/wrong fs?) 2024-03-18T20:00:05.079 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/555 2024-03-18T20:00:05.079 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/555 2024-03-18T20:00:05.080 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:05.083 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:05.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:05.125 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/556) 2024-03-18T20:00:05.568 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:05.578 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:05.584 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:05.588 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:05.588 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:05.934 INFO:teuthology.orchestra.run.smithi152.stdout:generic/556 [not run] ceph does not support casefold feature 2024-03-18T20:00:05.942 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/556 2024-03-18T20:00:05.943 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/556 2024-03-18T20:00:05.943 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:05.946 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:05.965 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:05.966 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/557) 2024-03-18T20:00:06.222 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:06.227 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:06.228 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:06.229 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:06.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:06.539 INFO:teuthology.orchestra.run.smithi152.stdout:generic/557 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:00:06.544 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/557 2024-03-18T20:00:06.544 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/557 2024-03-18T20:00:06.544 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:06.548 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:06.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:06.570 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/558) 2024-03-18T20:00:06.843 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:06.848 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:06.849 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:06.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:07.325 INFO:teuthology.orchestra.run.smithi152.stdout:generic/558 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2024-03-18T20:00:07.333 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/558 2024-03-18T20:00:07.333 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/558 2024-03-18T20:00:07.333 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:07.337 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:07.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:07.357 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/559) 2024-03-18T20:00:07.610 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:07.614 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:07.614 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:07.616 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:07.616 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:08.188 INFO:teuthology.orchestra.run.smithi152.stdout:generic/559 [not run] duperemove utility required, skipped this test 2024-03-18T20:00:08.194 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/559 2024-03-18T20:00:08.194 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/559 2024-03-18T20:00:08.194 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:08.198 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:08.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:08.221 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/560) 2024-03-18T20:00:08.488 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:08.492 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:08.493 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:08.494 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:08.494 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:08.879 INFO:teuthology.orchestra.run.smithi152.stdout:generic/560 [not run] duperemove utility required, skipped this test 2024-03-18T20:00:08.889 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/560 2024-03-18T20:00:08.889 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/560 2024-03-18T20:00:08.889 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:08.892 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:08.915 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:08.915 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/561) 2024-03-18T20:00:09.193 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:09.197 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:09.198 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:09.199 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:09.199 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:09.505 INFO:teuthology.orchestra.run.smithi152.stdout:generic/561 [not run] duperemove utility required, skipped this test 2024-03-18T20:00:09.512 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/561 2024-03-18T20:00:09.512 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/561 2024-03-18T20:00:09.512 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:09.518 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:09.534 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:09.534 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/562) 2024-03-18T20:00:09.789 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:09.793 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:09.794 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:09.796 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:09.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:10.311 INFO:teuthology.orchestra.run.smithi152.stdout:generic/562 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T20:00:10.316 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/562 2024-03-18T20:00:10.317 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/562 2024-03-18T20:00:10.317 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:10.322 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:10.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:10.613 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/563) 2024-03-18T20:00:10.929 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:10.935 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:10.935 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:10.936 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:10.937 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:11.286 INFO:teuthology.orchestra.run.smithi152.stdout:generic/563 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:00:11.291 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/563 2024-03-18T20:00:11.292 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/563 2024-03-18T20:00:11.292 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:11.295 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:11.314 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:11.314 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/564) 2024-03-18T20:00:11.578 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:11.583 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:11.583 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:11.585 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:11.585 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:12.145 INFO:teuthology.orchestra.run.smithi152.stdout:generic/564 1s 2024-03-18T20:00:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/564 2024-03-18T20:00:12.151 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:12.154 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:12.241 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:12.242 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/565) 2024-03-18T20:00:12.697 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:12.707 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:12.708 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:12.712 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:12.712 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:13.313 INFO:teuthology.orchestra.run.smithi152.stdout:generic/565 1s 2024-03-18T20:00:13.321 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/565 2024-03-18T20:00:13.321 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:13.325 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:13.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:13.394 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/566) 2024-03-18T20:00:13.827 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:13.846 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:13.846 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:13.847 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:13.847 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:14.169 INFO:teuthology.orchestra.run.smithi152.stdout:generic/566 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:14.174 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/566 2024-03-18T20:00:14.174 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/566 2024-03-18T20:00:14.174 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:14.177 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:14.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:14.202 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/567) 2024-03-18T20:00:14.462 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:14.466 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:14.466 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:14.467 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:14.467 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:15.190 INFO:teuthology.orchestra.run.smithi152.stdout:generic/567 1s 2024-03-18T20:00:15.198 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/567 2024-03-18T20:00:15.198 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:15.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:15.213 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:15.213 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/568) 2024-03-18T20:00:15.480 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:15.484 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:15.485 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:15.486 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:15.486 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:15.801 INFO:teuthology.orchestra.run.smithi152.stdout:generic/568 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T20:00:15.806 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/568 2024-03-18T20:00:15.807 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/568 2024-03-18T20:00:15.807 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:15.809 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:15.839 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:15.840 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/569) 2024-03-18T20:00:16.110 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:16.116 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:16.116 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:16.117 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:16.117 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:16.446 INFO:teuthology.orchestra.run.smithi152.stdout:generic/569 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T20:00:16.451 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/569 2024-03-18T20:00:16.452 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/569 2024-03-18T20:00:16.452 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:16.457 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:16.486 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:16.486 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/570) 2024-03-18T20:00:16.753 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:16.757 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:16.758 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:16.759 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:16.759 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:17.091 INFO:teuthology.orchestra.run.smithi152.stdout:generic/570 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:00:17.096 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/570 2024-03-18T20:00:17.096 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/570 2024-03-18T20:00:17.096 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:17.098 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:17.119 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:17.120 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/571) 2024-03-18T20:00:17.389 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:17.394 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:17.395 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:17.396 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:17.396 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:17.720 INFO:teuthology.orchestra.run.smithi152.stdout:generic/571 [not run] Require fcntl setlease support 2024-03-18T20:00:17.725 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/571 2024-03-18T20:00:17.725 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/571 2024-03-18T20:00:17.725 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:17.729 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:17.760 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:17.760 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/572) 2024-03-18T20:00:18.037 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:18.043 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:18.043 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:18.045 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:18.045 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:18.294 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:00:18.297 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:00:18.349 INFO:teuthology.orchestra.run.smithi152.stdout:generic/572 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:18.353 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/572 2024-03-18T20:00:18.353 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/572 2024-03-18T20:00:18.354 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:18.356 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:18.376 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:18.376 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/573) 2024-03-18T20:00:18.635 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:18.640 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:18.640 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:18.641 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:18.641 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:18.949 INFO:teuthology.orchestra.run.smithi152.stdout:generic/573 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:18.954 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/573 2024-03-18T20:00:18.955 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/573 2024-03-18T20:00:18.955 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:18.957 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:18.975 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:19.017 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/574) 2024-03-18T20:00:19.281 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:19.286 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:19.287 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:19.288 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:19.288 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:19.622 INFO:teuthology.orchestra.run.smithi152.stdout:generic/574 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:19.627 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/574 2024-03-18T20:00:19.627 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/574 2024-03-18T20:00:19.627 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:19.631 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:19.656 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:19.656 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/575) 2024-03-18T20:00:19.908 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:19.912 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:19.913 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:19.913 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:19.914 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:20.220 INFO:teuthology.orchestra.run.smithi152.stdout:generic/575 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:20.224 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/575 2024-03-18T20:00:20.225 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/575 2024-03-18T20:00:20.225 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:20.228 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:20.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:20.247 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/576) 2024-03-18T20:00:20.518 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:20.522 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:20.523 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:20.524 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:20.524 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:20.864 INFO:teuthology.orchestra.run.smithi152.stdout:generic/576 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:20.869 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/576 2024-03-18T20:00:20.869 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/576 2024-03-18T20:00:20.869 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:20.872 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:20.900 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:20.900 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/577) 2024-03-18T20:00:21.160 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:21.166 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:21.166 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:21.167 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:21.167 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:21.464 INFO:teuthology.orchestra.run.smithi152.stdout:generic/577 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:21.469 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/577 2024-03-18T20:00:21.469 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/577 2024-03-18T20:00:21.469 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:21.472 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:21.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:21.497 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/578) 2024-03-18T20:00:21.756 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:21.761 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:21.761 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:21.763 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:21.763 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:22.115 INFO:teuthology.orchestra.run.smithi152.stdout:generic/578 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2024-03-18T20:00:22.120 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/578 2024-03-18T20:00:22.120 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/578 2024-03-18T20:00:22.120 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:22.123 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:22.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:22.153 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/579) 2024-03-18T20:00:22.416 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:22.424 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:22.424 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:22.426 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:22.426 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:22.761 INFO:teuthology.orchestra.run.smithi152.stdout:generic/579 [not run] fsverity utility required, skipped this test 2024-03-18T20:00:22.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/579 2024-03-18T20:00:22.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/579 2024-03-18T20:00:22.766 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:22.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:22.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:22.796 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/580) 2024-03-18T20:00:23.067 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:23.072 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:23.073 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:23.073 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:23.073 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:23.529 INFO:teuthology.orchestra.run.smithi152.stdout:generic/580 [not run] kernel does not support ceph encryption 2024-03-18T20:00:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/580 2024-03-18T20:00:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/580 2024-03-18T20:00:23.549 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:23.552 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:23.572 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:23.572 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/581) 2024-03-18T20:00:23.827 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:23.831 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:23.832 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:23.833 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:23.833 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:25.132 INFO:teuthology.orchestra.run.smithi152.stdout:generic/581 [not run] kernel does not support ceph encryption 2024-03-18T20:00:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/581 2024-03-18T20:00:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/581 2024-03-18T20:00:25.146 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:25.149 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:25.171 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:25.171 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/582) 2024-03-18T20:00:25.429 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:25.433 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:25.433 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:25.435 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:25.435 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:25.958 INFO:teuthology.orchestra.run.smithi152.stdout:generic/582 [not run] kernel does not support ceph encryption 2024-03-18T20:00:25.980 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/582 2024-03-18T20:00:25.980 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/582 2024-03-18T20:00:25.980 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:25.983 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:26.005 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:26.005 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/583) 2024-03-18T20:00:26.272 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:26.278 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:26.278 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:26.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:26.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:26.772 INFO:teuthology.orchestra.run.smithi152.stdout:generic/583 [not run] kernel does not support ceph encryption 2024-03-18T20:00:26.793 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/583 2024-03-18T20:00:26.793 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/583 2024-03-18T20:00:26.793 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:26.796 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:26.815 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:26.815 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/584) 2024-03-18T20:00:27.080 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:27.085 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:27.086 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:27.087 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:27.087 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:27.593 INFO:teuthology.orchestra.run.smithi152.stdout:generic/584 [not run] kernel does not support ceph encryption 2024-03-18T20:00:27.611 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/584 2024-03-18T20:00:27.611 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/584 2024-03-18T20:00:27.611 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:27.614 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:27.633 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:27.633 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/585) 2024-03-18T20:00:27.891 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:27.896 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:27.896 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:27.897 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:27.898 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:28.276 INFO:teuthology.orchestra.run.smithi152.stdout:generic/585 [not run] kernel doesn't support renameat2 syscall 2024-03-18T20:00:28.281 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/585 2024-03-18T20:00:28.281 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/585 2024-03-18T20:00:28.282 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:28.285 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:28.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:28.326 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/586) 2024-03-18T20:00:28.780 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:28.787 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:28.787 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:28.791 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:28.793 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:29.222 INFO:teuthology.orchestra.run.smithi152.stdout:generic/586 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T20:00:29.227 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/586 2024-03-18T20:00:29.227 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/586 2024-03-18T20:00:29.227 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:29.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:29.272 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:29.272 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/587) 2024-03-18T20:00:29.775 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:29.781 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:29.783 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:29.783 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:30.125 INFO:teuthology.orchestra.run.smithi152.stdout:generic/587 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:30.130 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/587 2024-03-18T20:00:30.130 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/587 2024-03-18T20:00:30.130 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:30.134 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:30.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:30.154 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/588) 2024-03-18T20:00:30.428 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:30.433 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:30.438 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:30.439 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:30.439 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:30.936 INFO:teuthology.orchestra.run.smithi152.stdout:generic/588 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T20:00:30.942 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/588 2024-03-18T20:00:30.942 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/588 2024-03-18T20:00:30.942 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:30.945 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:31.221 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:31.221 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/589) 2024-03-18T20:00:31.563 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:31.567 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:31.567 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:31.568 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:31.569 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:31.908 INFO:teuthology.orchestra.run.smithi152.stdout:generic/589 [not run] require 172.21.15.152:6789:/scratch to be local device 2024-03-18T20:00:31.913 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/589 2024-03-18T20:00:31.913 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/589 2024-03-18T20:00:31.913 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:31.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:31.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:31.937 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/590) 2024-03-18T20:00:32.210 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:32.214 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:32.215 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:32.216 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:32.216 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:32.538 INFO:teuthology.orchestra.run.smithi152.stdout:generic/590 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T20:00:32.544 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/590 2024-03-18T20:00:32.544 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/590 2024-03-18T20:00:32.544 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:32.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:32.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:32.579 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/591) 2024-03-18T20:00:32.848 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:32.855 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:32.855 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:32.856 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:32.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:33.403 INFO:teuthology.orchestra.run.smithi152.stdout:generic/591 1s 2024-03-18T20:00:33.411 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/591 2024-03-18T20:00:33.411 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:33.414 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:33.461 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:33.462 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/592) 2024-03-18T20:00:33.964 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:33.973 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:33.974 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:33.975 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:33.975 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:34.480 INFO:teuthology.orchestra.run.smithi152.stdout:generic/592 [not run] kernel does not support ceph encryption 2024-03-18T20:00:34.504 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/592 2024-03-18T20:00:34.504 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/592 2024-03-18T20:00:34.504 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:34.507 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:34.525 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:34.525 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/593) 2024-03-18T20:00:34.851 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:34.856 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:34.857 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:34.857 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:34.857 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:35.422 INFO:teuthology.orchestra.run.smithi152.stdout:generic/593 [not run] kernel does not support ceph encryption 2024-03-18T20:00:35.446 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/593 2024-03-18T20:00:35.446 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/593 2024-03-18T20:00:35.447 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:35.450 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:35.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:35.473 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/594) 2024-03-18T20:00:35.771 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:35.779 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:35.781 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:35.781 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:36.135 INFO:teuthology.orchestra.run.smithi152.stdout:generic/594 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:36.145 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/594 2024-03-18T20:00:36.145 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/594 2024-03-18T20:00:36.145 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:36.148 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:36.169 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:36.169 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/595) 2024-03-18T20:00:36.444 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:36.449 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:36.449 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:36.450 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:36.450 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:36.942 INFO:teuthology.orchestra.run.smithi152.stdout:generic/595 [not run] kernel does not support ceph encryption 2024-03-18T20:00:36.957 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/595 2024-03-18T20:00:36.957 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/595 2024-03-18T20:00:36.957 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:36.961 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:36.983 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:36.984 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/596) 2024-03-18T20:00:37.239 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:37.243 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:37.244 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:37.245 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:37.245 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:37.646 INFO:teuthology.orchestra.run.smithi152.stdout:generic/596 [not run] file system doesn't support chattr +S 2024-03-18T20:00:37.650 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/596 2024-03-18T20:00:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/596 2024-03-18T20:00:37.651 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:37.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:37.694 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:37.694 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/597) 2024-03-18T20:00:37.980 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:37.984 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:37.985 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:37.986 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:37.986 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:39.208 INFO:teuthology.orchestra.run.smithi152.stdout:generic/597 1s 2024-03-18T20:00:39.215 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/597 2024-03-18T20:00:39.215 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:39.218 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:39.290 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:39.291 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/598) 2024-03-18T20:00:39.751 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:39.763 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:39.765 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:39.768 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:39.768 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:40.734 INFO:teuthology.orchestra.run.smithi152.stdout:generic/598 1s 2024-03-18T20:00:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/598 2024-03-18T20:00:40.744 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:40.746 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:40.822 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:40.822 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/599) 2024-03-18T20:00:41.248 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:41.255 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:41.256 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:41.257 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:41.257 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:41.703 INFO:teuthology.orchestra.run.smithi152.stdout:generic/599 [not run] ceph does not support shutdown 2024-03-18T20:00:41.731 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/599 2024-03-18T20:00:41.732 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/599 2024-03-18T20:00:41.732 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:41.735 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:41.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:41.752 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/600) 2024-03-18T20:00:42.016 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:42.021 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:42.022 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:42.023 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:42.023 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:42.312 INFO:teuthology.orchestra.run.smithi152.stdout:generic/600 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:42.317 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/600 2024-03-18T20:00:42.317 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/600 2024-03-18T20:00:42.317 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:42.355 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:42.356 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/601) 2024-03-18T20:00:42.624 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:42.630 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:42.631 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:42.632 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:42.633 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:42.939 INFO:teuthology.orchestra.run.smithi152.stdout:generic/601 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:42.944 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/601 2024-03-18T20:00:42.944 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/601 2024-03-18T20:00:42.944 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:42.946 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:42.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:42.980 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/602) 2024-03-18T20:00:43.274 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:43.278 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:43.278 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:43.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:43.280 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:43.783 INFO:teuthology.orchestra.run.smithi152.stdout:generic/602 [not run] kernel does not support ceph encryption 2024-03-18T20:00:43.800 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/602 2024-03-18T20:00:43.800 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/602 2024-03-18T20:00:43.800 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:43.803 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:43.823 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:43.823 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/603) 2024-03-18T20:00:44.082 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:44.089 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:44.089 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:44.090 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:44.090 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:44.479 INFO:teuthology.orchestra.run.smithi152.stdout:generic/603 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T20:00:44.484 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/603 2024-03-18T20:00:44.484 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/603 2024-03-18T20:00:44.484 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:44.487 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:44.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:44.509 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/604) 2024-03-18T20:00:44.778 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:44.783 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:44.783 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:44.785 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:44.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:48.380 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:00:48.383 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:00:49.591 INFO:teuthology.orchestra.run.smithi152.stdout:generic/604 5s 2024-03-18T20:00:49.601 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/604 2024-03-18T20:00:49.601 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:49.604 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:49.618 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:49.618 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/605) 2024-03-18T20:00:49.937 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:49.942 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:49.943 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:49.944 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:49.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:generic/605 [not run] mount 172.21.15.152:6789:/scratch with dax=always failed 2024-03-18T20:00:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/605 2024-03-18T20:00:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/605 2024-03-18T20:00:52.058 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:52.061 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:52.083 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:52.083 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/606) 2024-03-18T20:00:52.353 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:52.356 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:52.357 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:52.358 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:52.358 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:52.752 INFO:teuthology.orchestra.run.smithi152.stdout:generic/606 [not run] mount 172.21.15.152:6789:/scratch with dax=always failed 2024-03-18T20:00:52.758 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/606 2024-03-18T20:00:52.758 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/606 2024-03-18T20:00:52.758 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:52.760 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:52.778 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:52.778 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/607) 2024-03-18T20:00:53.046 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:53.051 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:53.052 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:53.053 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:53.053 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:53.386 INFO:teuthology.orchestra.run.smithi152.stdout:generic/607 [not run] xfs_io chattr +x failed (old kernel/wrong fs?) 2024-03-18T20:00:53.391 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/607 2024-03-18T20:00:53.392 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/607 2024-03-18T20:00:53.392 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:53.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:53.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:53.453 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/608) 2024-03-18T20:00:53.950 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:53.956 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:53.956 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:53.959 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:53.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:54.333 INFO:teuthology.orchestra.run.smithi152.stdout:generic/608 [not run] mount 172.21.15.152:6789:/scratch with dax=always failed 2024-03-18T20:00:54.338 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/608 2024-03-18T20:00:54.338 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/608 2024-03-18T20:00:54.338 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:54.341 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:54.360 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:54.360 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/609) 2024-03-18T20:00:54.624 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:54.630 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:54.631 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:54.632 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:54.632 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:55.243 INFO:teuthology.orchestra.run.smithi152.stdout:generic/609 1s 2024-03-18T20:00:55.250 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/609 2024-03-18T20:00:55.251 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:55.254 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:55.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:55.308 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/610) 2024-03-18T20:00:55.878 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:55.883 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:55.883 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:55.885 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:55.885 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:56.300 INFO:teuthology.orchestra.run.smithi152.stdout:generic/610 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T20:00:56.306 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/610 2024-03-18T20:00:56.306 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/610 2024-03-18T20:00:56.306 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:56.309 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:56.337 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:56.338 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/611) 2024-03-18T20:00:56.604 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:56.608 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:56.609 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:56.610 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:56.610 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:57.247 INFO:teuthology.orchestra.run.smithi152.stdout:generic/611 1s 2024-03-18T20:00:57.254 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/611 2024-03-18T20:00:57.254 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:57.257 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:57.269 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:57.270 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/612) 2024-03-18T20:00:57.527 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:57.532 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:57.532 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:57.534 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:57.534 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:57.923 INFO:teuthology.orchestra.run.smithi152.stdout:generic/612 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T20:00:57.928 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/612 2024-03-18T20:00:57.928 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/612 2024-03-18T20:00:57.928 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:57.932 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:57.989 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:57.989 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/613) 2024-03-18T20:00:58.537 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:58.542 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:58.542 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:58.544 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:58.544 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:59.044 INFO:teuthology.orchestra.run.smithi152.stdout:generic/613 [not run] kernel does not support ceph encryption 2024-03-18T20:00:59.076 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/613 2024-03-18T20:00:59.076 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/613 2024-03-18T20:00:59.076 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:59.079 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:59.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:59.105 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/614) 2024-03-18T20:00:59.388 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:00:59.393 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:00:59.393 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:00:59.394 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:00:59.394 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:59.839 INFO:teuthology.orchestra.run.smithi152.stdout:generic/614 [not run] test requires delayed allocation buffered writes 2024-03-18T20:00:59.869 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/614 2024-03-18T20:00:59.870 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/614 2024-03-18T20:00:59.870 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:00:59.873 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:00:59.906 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:00:59.907 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/615) 2024-03-18T20:01:00.178 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:01:00.182 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:01:00.182 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:01:00.183 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:01:00.183 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:01:18.478 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:01:18.482 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:01:48.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:01:48.783 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:01:59.599 INFO:teuthology.orchestra.run.smithi152.stdout:generic/615 59s 2024-03-18T20:01:59.609 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/615 2024-03-18T20:01:59.609 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:01:59.612 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:01:59.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:01:59.625 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/616) 2024-03-18T20:01:59.910 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:01:59.914 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:01:59.915 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:01:59.916 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:01:59.916 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:00.204 INFO:teuthology.orchestra.run.smithi152.stdout:generic/616 [not run] kernel does not support IO_URING 2024-03-18T20:02:00.211 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/616 2024-03-18T20:02:00.211 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/616 2024-03-18T20:02:00.211 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:00.215 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:00.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:00.236 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/617) 2024-03-18T20:02:00.502 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:00.508 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:00.512 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:00.512 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:00.512 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:00.898 INFO:teuthology.orchestra.run.smithi152.stdout:generic/617 [not run] kernel does not support IO_URING 2024-03-18T20:02:00.903 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/617 2024-03-18T20:02:00.904 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/617 2024-03-18T20:02:00.904 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:00.907 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:00.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:00.926 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/618) 2024-03-18T20:02:01.195 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:01.199 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:01.200 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:01.201 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:01.202 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:01.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/618 0s 2024-03-18T20:02:01.832 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/618 2024-03-18T20:02:01.832 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:01.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:01.852 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:01.852 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/619) 2024-03-18T20:02:02.113 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:02.118 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:02.119 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:02.120 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:02.120 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:02.465 INFO:teuthology.orchestra.run.smithi152.stdout:generic/619 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T20:02:02.471 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/619 2024-03-18T20:02:02.471 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/619 2024-03-18T20:02:02.471 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:02.474 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:02.503 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:02.503 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/620) 2024-03-18T20:02:02.769 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:02.773 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:02.774 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:02.775 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:02.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:03.128 INFO:teuthology.orchestra.run.smithi152.stdout:generic/620 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:02:03.133 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/620 2024-03-18T20:02:03.133 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/620 2024-03-18T20:02:03.133 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:03.136 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:03.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:03.157 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/621) 2024-03-18T20:02:03.417 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:03.425 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:03.426 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:03.427 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:03.427 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:03.908 INFO:teuthology.orchestra.run.smithi152.stdout:generic/621 [not run] kernel does not support ceph encryption 2024-03-18T20:02:03.922 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/621 2024-03-18T20:02:03.922 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/621 2024-03-18T20:02:03.922 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:03.925 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:03.945 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:03.946 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/622) 2024-03-18T20:02:04.197 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:04.203 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:04.204 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:04.208 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:04.208 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:04.638 INFO:teuthology.orchestra.run.smithi152.stdout:generic/622 [not run] ceph does not support shutdown 2024-03-18T20:02:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/622 2024-03-18T20:02:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/622 2024-03-18T20:02:04.653 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:04.656 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:04.675 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:04.675 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/623) 2024-03-18T20:02:04.931 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:04.935 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:04.935 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:04.936 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:04.936 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:05.344 INFO:teuthology.orchestra.run.smithi152.stdout:generic/623 [not run] ceph does not support shutdown 2024-03-18T20:02:05.358 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/623 2024-03-18T20:02:05.358 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/623 2024-03-18T20:02:05.359 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:05.362 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:05.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:05.379 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/624) 2024-03-18T20:02:05.639 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:05.647 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:05.647 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:05.648 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:05.648 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:05.936 INFO:teuthology.orchestra.run.smithi152.stdout:generic/624 [not run] fsverity utility required, skipped this test 2024-03-18T20:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/624 2024-03-18T20:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/624 2024-03-18T20:02:05.941 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:05.944 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:05.963 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:05.963 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/625) 2024-03-18T20:02:06.222 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:06.227 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:06.228 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:06.229 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:06.229 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:06.542 INFO:teuthology.orchestra.run.smithi152.stdout:generic/625 [not run] fsverity utility required, skipped this test 2024-03-18T20:02:06.547 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/625 2024-03-18T20:02:06.547 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/625 2024-03-18T20:02:06.547 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:06.550 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:06.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:06.574 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/626) 2024-03-18T20:02:06.847 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:06.852 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:06.853 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:06.854 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:06.854 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:07.185 INFO:teuthology.orchestra.run.smithi152.stdout:generic/626 [not run] kernel doesn't support renameat2 syscall 2024-03-18T20:02:07.190 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/626 2024-03-18T20:02:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/626 2024-03-18T20:02:07.191 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:07.194 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:07.242 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:07.242 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/627) 2024-03-18T20:02:07.641 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:07.647 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:07.647 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:07.649 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:07.649 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:08.062 INFO:teuthology.orchestra.run.smithi152.stdout:generic/627 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:02:08.067 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/627 2024-03-18T20:02:08.067 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/627 2024-03-18T20:02:08.067 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:08.070 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:08.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:08.089 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/628) 2024-03-18T20:02:08.360 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:08.365 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:08.365 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:08.367 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:08.367 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:08.884 INFO:teuthology.orchestra.run.smithi152.stdout:generic/628 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T20:02:08.890 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/628 2024-03-18T20:02:08.890 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/628 2024-03-18T20:02:08.890 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:08.893 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:09.118 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:09.118 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/629) 2024-03-18T20:02:09.490 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:09.495 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:09.496 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:09.498 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:09.498 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:09.818 INFO:teuthology.orchestra.run.smithi152.stdout:generic/629 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:02:09.823 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/629 2024-03-18T20:02:09.823 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/629 2024-03-18T20:02:09.823 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:09.826 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:09.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:09.851 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/630) 2024-03-18T20:02:10.102 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:10.107 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:10.108 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:10.112 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:10.113 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:10.561 INFO:teuthology.orchestra.run.smithi152.stdout:generic/630 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T20:02:10.614 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/630 2024-03-18T20:02:10.614 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/630 2024-03-18T20:02:10.614 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:10.618 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:10.912 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:10.912 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/631) 2024-03-18T20:02:11.236 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:11.240 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:11.241 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:11.242 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:11.242 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:19.095 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:02:19.098 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:02:42.210 INFO:teuthology.orchestra.run.smithi152.stdout:generic/631 - output mismatch (see /tmp/tmp.YntrTC91Q1xfstests-dev/results//generic/631.out.bad) 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/631.out 2024-03-18 15:01:56.585592240 +0000 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.YntrTC91Q1xfstests-dev/results//generic/631.out.bad 2024-03-18 20:02:42.183716721 +0000 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,2 +1,4034 @@ 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 631 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.225 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.226 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.227 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.228 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.229 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.230 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.231 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.232 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.233 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.234 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.235 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.236 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.237 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.238 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.239 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.240 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.241 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.242 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.243 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.244 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.245 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.246 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.247 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.248 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.249 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.250 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.251 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.252 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.253 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.254 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.255 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.256 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.257 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.258 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.259 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.260 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.261 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.262 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.263 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.264 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.265 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.266 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.267 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.268 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf'cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.269 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.270 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.271 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.272 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.273 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.274 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.275 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.276 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.277 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.278 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.279 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.280 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.281 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.282 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.283 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.284 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.285 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.286 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.287 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.288 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.289 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.290 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.291 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.292 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.293 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +: No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.294 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.295 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.296 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.297 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.298 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.299 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.300 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf'umount: : No such file or directory/tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.301 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.302 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.303 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.304 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.305 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.306 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.307 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.308 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.309 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: umount: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf'/tmp/tmp.KIGoX27qplscratch/merged0: not mounted.: No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.310 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.311 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.312 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.313 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.314 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.315 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.316 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted./tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.317 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.318 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.319 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.320 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.321 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.322 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.323 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.324 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.325 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.326 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.327 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.328 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.329 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.330 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.331 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.332 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.333 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.334 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.335 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.336 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.337 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.338 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.339 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.340 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.341 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.342 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.343 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.344 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.345 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.346 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.347 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.348 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.349 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.350 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.351 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.352 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.353 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.354 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.355 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.356 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.357 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.358 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory: No such file or directory: No such file or directory 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.359 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.360 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.361 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.362 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directorytouch: 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.363 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.364 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.365 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.366 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.367 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.368 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.369 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.370 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.371 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.372 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.373 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.374 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.375 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.376 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.377 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.378 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.379 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.380 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.381 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.382 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.383 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.384 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.385 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.386 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.387 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.387 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.387 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.387 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.388 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.389 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.390 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.391 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.392 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.393 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.394 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.395 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.396 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.397 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.398 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.399 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.400 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.401 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directorytouch: 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.402 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.403 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.404 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.405 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.406 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.407 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.408 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.409 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.410 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.411 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.412 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.413 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.414 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.415 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.416 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.417 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directorymv: 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.418 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.419 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.420 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.421 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.422 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.423 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.424 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.425 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.426 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.427 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.428 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.429 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.430 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.431 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.432 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.433 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.434 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.435 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf'cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.436 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.437 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.438 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.439 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.440 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.441 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.442 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.443 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.444 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.446 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.447 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.448 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.449 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.450 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.451 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.452 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.453 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.454 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.455 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.456 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.457 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.458 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.459 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.460 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.461 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.462 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.463 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.464 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.465 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.466 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.467 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.468 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.469 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.470 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.471 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.472 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.473 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.474 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.475 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.476 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.477 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted./tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.478 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directorytouch: 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.479 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.480 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.481 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.482 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.483 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mount: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf'/tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.: No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.484 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.485 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.486 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.486 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.486 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.486 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.486 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.487 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.488 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.489 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.490 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.491 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.492 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.493 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.494 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.494 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.494 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.494 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.494 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.495 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.496 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.497 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.498 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.499 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.500 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.501 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.502 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.503 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.504 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.505 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.506 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.507 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.508 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.509 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.510 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.511 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.512 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.513 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.514 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.515 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.516 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.517 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.518 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.519 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.520 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.521 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.522 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.523 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.525 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.525 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.525 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.526 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.527 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.528 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.529 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.530 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.531 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.532 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.533 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.534 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: touch: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted.cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf' 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +: No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.535 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.536 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.537 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.538 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.539 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.540 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.541 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.542 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.543 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.544 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.545 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.546 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.547 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.548 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.549 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.550 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.551 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.552 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.553 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.554 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.555 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.556 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.557 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.558 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.559 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.560 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error./tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.561 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.562 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error.mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +/tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.563 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.564 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.565 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.566 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: umount: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf'/tmp/tmp.KIGoX27qplscratch/merged3: not mounted.: No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.567 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.568 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.569 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf'cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory: No such file or directory 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.570 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.571 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted. 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.572 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged0: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged0/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged3: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged2: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged0: not mounted. 2024-03-18T20:02:42.573 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged2/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged3/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: umount: /tmp/tmp.KIGoX27qplscratch/merged3: not mounted./tmp/tmp.KIGoX27qplscratch/merged2: not mounted. 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: + 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged4: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged1: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.574 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged4/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged4: not mounted. 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +mount: /tmp/tmp.KIGoX27qplscratch/merged5: wrong fs type, bad option, bad superblock on overlay, missing codepage or helper program, or other error. 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +mv: cannot stat '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged1/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +touch: cannot touch '/tmp/tmp.KIGoX27qplscratch/merged5/etc/access.conf': No such file or directory 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged1: not mounted. 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: +umount: /tmp/tmp.KIGoX27qplscratch/merged5: not mounted. 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: Silence is golden. 2024-03-18T20:02:42.575 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout:HINT: You _MAY_ be missing kernel fix: 2024-03-18T20:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: 6da1b4b1ab36 xfs: fix an ABBA deadlock in xfs_rename 2024-03-18T20:02:42.576 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:42.577 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T20:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/631 2024-03-18T20:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/631 2024-03-18T20:02:42.577 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-03-18T20:02:42.578 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:42.578 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-18T20:02:42.578 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-18T20:02:42.578 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/632) 2024-03-18T20:02:42.847 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:42.851 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:42.852 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:42.853 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:44.006 INFO:teuthology.orchestra.run.smithi152.stdout:generic/632 0s 2024-03-18T20:02:44.014 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/632 2024-03-18T20:02:44.014 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:44.016 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:44.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:44.052 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/633) 2024-03-18T20:02:44.326 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:44.331 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:44.331 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:44.332 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:44.332 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:45.381 INFO:teuthology.orchestra.run.smithi152.stdout:generic/633 1s 2024-03-18T20:02:45.394 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/633 2024-03-18T20:02:45.394 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:45.397 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:45.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:45.484 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/634) 2024-03-18T20:02:45.967 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:45.973 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:45.973 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:45.974 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:45.975 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:47.210 INFO:teuthology.orchestra.run.smithi152.stdout:generic/634 1s 2024-03-18T20:02:47.221 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/634 2024-03-18T20:02:47.221 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:47.224 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:47.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:47.236 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/635) 2024-03-18T20:02:47.504 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:47.508 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:47.509 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:47.510 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:47.510 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:47.940 INFO:teuthology.orchestra.run.smithi152.stdout:generic/635 [not run] ceph does not support shutdown 2024-03-18T20:02:47.955 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/635 2024-03-18T20:02:47.956 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/635 2024-03-18T20:02:47.956 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:47.959 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:47.977 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:47.977 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/636) 2024-03-18T20:02:48.265 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:48.270 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:48.270 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:48.272 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:48.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:48.816 INFO:teuthology.orchestra.run.smithi152.stdout:generic/636 [not run] swapfiles are not supported 2024-03-18T20:02:48.820 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/636 2024-03-18T20:02:48.820 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/636 2024-03-18T20:02:48.820 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:48.822 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:48.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:48.852 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/637) 2024-03-18T20:02:49.116 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:49.121 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:49.121 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:49.124 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:49.124 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:49.172 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:02:49.175 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:02:51.358 INFO:teuthology.orchestra.run.smithi152.stdout:generic/637 2s 2024-03-18T20:02:51.366 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/637 2024-03-18T20:02:51.367 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:51.370 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:51.612 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:51.612 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/638) 2024-03-18T20:02:52.062 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:52.067 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:52.067 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:52.068 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:52.068 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:52.456 INFO:teuthology.orchestra.run.smithi152.stdout:generic/638 0s 2024-03-18T20:02:52.464 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/638 2024-03-18T20:02:52.464 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:52.467 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:52.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:52.498 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/639) 2024-03-18T20:02:52.781 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:52.786 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:52.787 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:52.788 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:52.789 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:53.270 INFO:teuthology.orchestra.run.smithi152.stdout:generic/639 1s 2024-03-18T20:02:53.277 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/639 2024-03-18T20:02:53.277 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:53.281 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:53.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:53.318 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/640) 2024-03-18T20:02:53.578 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:53.583 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:53.584 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:53.585 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:53.585 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:53.897 INFO:teuthology.orchestra.run.smithi152.stdout:generic/640 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T20:02:53.903 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/640 2024-03-18T20:02:53.903 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/640 2024-03-18T20:02:53.903 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:53.911 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:53.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:53.934 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/641) 2024-03-18T20:02:54.208 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:54.216 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:54.217 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:54.219 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:54.219 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:54.784 INFO:teuthology.orchestra.run.smithi152.stdout:generic/641 [not run] swapfiles are not supported 2024-03-18T20:02:54.789 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/641 2024-03-18T20:02:54.789 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/641 2024-03-18T20:02:54.789 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:02:54.792 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:02:54.829 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:02:54.829 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/642) 2024-03-18T20:02:55.098 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:02:55.103 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:02:55.104 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:02:55.105 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:02:55.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:03:19.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:03:19.268 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:03:49.522 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:03:49.525 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:04:19.921 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:04:19.926 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:04:19.974 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T20:04:19.970+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 700667) UID: 0 2024-03-18T20:04:19.975 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T20:04:19.970+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 700667) UID: 0 2024-03-18T20:08:41.542 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:08:41.549 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:08:41.590 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T20:08:41.585+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53024) UID: 0 2024-03-18T20:08:41.591 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T20:08:41.585+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53024) UID: 0 2024-03-18T20:08:41.591 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T20:08:41.585+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53024) UID: 0 2024-03-18T20:08:41.591 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T20:08:41.585+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53024) UID: 0 2024-03-18T20:11:42.387 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:11:42.391 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:11:42.896 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T20:11:42.891+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 700711) UID: 0 2024-03-18T20:11:42.896 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T20:11:42.891+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 700711) UID: 0 2024-03-18T20:15:59.885 INFO:teuthology.orchestra.run.smithi152.stdout:generic/642 784s 2024-03-18T20:15:59.953 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/642 2024-03-18T20:15:59.953 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:15:59.955 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:16:00.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:16:00.332 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/643) 2024-03-18T20:16:02.671 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:16:02.675 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:16:02.676 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:16:02.677 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:16:02.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:16:32.230 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:16:32.449 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:16:32.484 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T20:16:32.480+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53071) UID: 0 2024-03-18T20:16:32.485 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T20:16:32.480+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53071) UID: 0 2024-03-18T20:16:32.485 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T20:16:32.480+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53071) UID: 0 2024-03-18T20:16:32.485 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T20:16:32.480+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53071) UID: 0 2024-03-18T20:19:36.529 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:19:36.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:19:36.809 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T20:19:36.804+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 701032) UID: 0 2024-03-18T20:19:36.809 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T20:19:36.805+0000 7f66649ad640 -1 Fail to open '/proc/701032/cmdline' error = (2) No such file or directory 2024-03-18T20:19:36.809 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T20:19:36.805+0000 7f66649ad640 -1 received signal: Hangup from (PID: 701032) UID: 0 2024-03-18T20:20:39.182 INFO:teuthology.orchestra.run.smithi152.stdout:generic/643 [not run] swapfiles are not supported 2024-03-18T20:20:39.184 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/643 2024-03-18T20:20:39.184 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/643 2024-03-18T20:20:39.184 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:39.188 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:39.220 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:39.220 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/644) 2024-03-18T20:20:39.549 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:39.554 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:39.555 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:39.556 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:39.556 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:39.940 INFO:teuthology.orchestra.run.smithi152.stdout:generic/644 [not run] vfstest not support by ceph 2024-03-18T20:20:39.949 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/644 2024-03-18T20:20:39.949 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/644 2024-03-18T20:20:39.949 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:39.952 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:40.001 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:40.001 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/645) 2024-03-18T20:20:40.323 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:40.331 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:40.332 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:40.333 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:40.334 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:40.661 INFO:teuthology.orchestra.run.smithi152.stdout:generic/645 [not run] vfstest not support by ceph 2024-03-18T20:20:40.666 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/645 2024-03-18T20:20:40.668 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/645 2024-03-18T20:20:40.668 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:40.671 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:40.701 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:40.702 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/646) 2024-03-18T20:20:40.997 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:41.009 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:41.010 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:41.011 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:41.011 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:41.437 INFO:teuthology.orchestra.run.smithi152.stdout:generic/646 [not run] ceph does not support shutdown 2024-03-18T20:20:41.454 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/646 2024-03-18T20:20:41.454 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/646 2024-03-18T20:20:41.454 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:41.458 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:41.478 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:41.478 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/647) 2024-03-18T20:20:41.773 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:41.780 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:41.782 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:41.785 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:41.785 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:42.592 INFO:teuthology.orchestra.run.smithi152.stdout:generic/647 1s 2024-03-18T20:20:42.608 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/647 2024-03-18T20:20:42.608 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:42.611 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:42.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:42.657 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/648) 2024-03-18T20:20:43.109 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:43.125 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:43.125 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:43.126 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:43.127 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:43.918 INFO:teuthology.orchestra.run.smithi152.stdout:generic/648 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T20:20:43.924 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/648 2024-03-18T20:20:43.924 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/648 2024-03-18T20:20:43.924 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:43.926 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:44.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:44.157 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/649) 2024-03-18T20:20:44.540 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:44.545 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:44.546 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:44.547 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:44.547 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:44.978 INFO:teuthology.orchestra.run.smithi152.stdout:generic/649 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T20:20:44.987 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/649 2024-03-18T20:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/649 2024-03-18T20:20:44.988 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T20:20:44.989 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:20:45.070 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T20:20:45.071 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/650) 2024-03-18T20:20:45.575 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T20:20:45.580 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T20:20:45.580 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T20:20:45.581 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T20:20:45.582 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T20:25:02.159 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T20:25:02.154+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705007) UID: 0 2024-03-18T20:25:02.160 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T20:25:02.155+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705007) UID: 0 2024-03-18T20:25:02.160 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T20:25:02.154+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 705007) UID: 0 2024-03-18T20:25:02.173 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T20:25:02.165+0000 7f91da83c640 -1 Fail to open '/proc/705007/cmdline' error = (2) No such file or directory 2024-03-18T20:25:02.173 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T20:25:02.165+0000 7f91da83c640 -1 received signal: Hangup from (PID: 705007) UID: 0 2024-03-18T20:30:02.910 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:30:02.915 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:30:02.945 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T20:30:02.942+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53122) UID: 0 2024-03-18T20:30:02.946 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T20:30:02.942+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53122) UID: 0 2024-03-18T20:30:02.946 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T20:30:02.942+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53122) UID: 0 2024-03-18T20:30:02.946 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T20:30:02.942+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 53122) UID: 0 2024-03-18T20:32:40.320 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:32:40.325 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:33:10.481 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:33:10.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:33:40.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:33:40.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:34:10.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:34:10.818 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:34:40.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:34:40.939 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:35:11.226 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:35:11.231 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:35:41.492 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:35:41.496 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:36:11.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:36:11.826 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:36:41.974 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:36:41.979 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:37:12.265 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:37:12.276 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:37:42.431 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:37:42.440 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:38:12.554 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:38:12.557 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:38:42.672 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:38:42.675 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:39:13.173 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:39:13.177 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:39:13.258 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T20:39:13.255+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 707131) UID: 0 2024-03-18T20:39:13.258 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T20:39:13.255+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 707131) UID: 0 2024-03-18T20:39:13.258 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T20:39:13.256+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 707131) UID: 0 2024-03-18T20:39:13.291 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T20:39:13.258+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 707131) UID: 0 2024-03-18T20:44:19.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:44:19.412 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:44:49.801 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:44:49.809 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:45:19.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:45:19.966 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:45:50.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:45:50.136 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:46:20.228 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:46:20.232 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:46:50.411 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:46:50.419 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:47:20.597 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:47:20.601 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:47:50.761 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:47:50.765 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:48:20.941 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:48:20.945 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:48:51.101 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:48:51.105 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:49:21.293 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:49:21.296 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:49:51.463 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:49:51.467 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:50:21.724 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:50:21.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:50:51.893 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:50:51.897 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:51:22.075 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:51:22.079 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:51:52.368 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:51:52.372 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:52:22.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:52:22.576 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:52:52.766 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:52:52.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:53:22.914 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:53:22.918 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:53:53.086 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:53:53.093 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:54:23.408 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:54:23.415 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:54:53.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:54:53.576 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:55:23.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:55:23.674 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:55:53.822 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:55:53.827 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:56:24.142 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:56:24.146 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:56:54.319 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:56:54.324 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:57:24.433 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:57:24.436 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:57:54.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:57:54.822 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:58:25.001 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:58:25.006 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:58:55.138 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:58:55.142 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:59:25.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:59:25.292 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:59:55.428 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T20:59:55.432 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:00:25.571 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:00:25.574 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:00:55.698 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:00:55.703 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:01:25.815 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:01:25.822 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:01:55.994 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:01:55.999 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:02:26.241 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:02:26.246 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:02:26.445 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T21:02:26.443+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 710821) UID: 0 2024-03-18T21:02:26.445 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T21:02:26.443+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 710821) UID: 0 2024-03-18T21:02:26.445 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T21:02:26.443+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 710821) UID: 0 2024-03-18T21:02:26.447 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T21:02:26.446+0000 7f91da83c640 -1 received signal: Hangup from (PID: 710821) UID: 0 2024-03-18T21:07:00.936 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:07:00.942 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:07:01.302 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T21:07:01.300+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 711437) UID: 0 2024-03-18T21:07:01.303 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T21:07:01.301+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 711437) UID: 0 2024-03-18T21:11:54.524 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:11:54.528 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:12:24.680 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:12:24.684 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:12:55.197 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:12:55.204 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:13:25.339 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:13:25.343 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:13:55.477 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:13:55.486 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:14:25.608 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:14:25.612 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:14:55.722 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:14:55.730 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:15:25.849 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:15:25.852 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:15:55.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:15:55.975 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:16:26.200 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:16:26.205 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:16:56.353 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:16:56.356 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:17:26.619 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:17:26.622 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:17:56.836 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:17:56.841 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:18:26.984 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:18:26.990 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:18:57.096 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:18:57.149 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:19:27.255 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:19:27.259 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:19:57.602 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:19:57.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:20:27.725 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:20:27.729 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:20:57.839 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:20:57.849 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:21:27.983 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:21:27.988 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:21:58.171 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:21:58.175 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:22:24.177 INFO:teuthology.orchestra.run.smithi152.stdout:generic/650 3699s 2024-03-18T21:22:24.225 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/650 2024-03-18T21:22:24.225 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:24.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:24.308 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:24.308 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/651) 2024-03-18T21:22:25.023 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:25.033 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:25.035 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:25.038 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:25.039 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:26.076 INFO:teuthology.orchestra.run.smithi152.stdout:generic/651 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:26.091 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/651 2024-03-18T21:22:26.091 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/651 2024-03-18T21:22:26.091 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:26.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:26.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:26.258 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/652) 2024-03-18T21:22:26.984 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:27.004 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:27.005 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:27.007 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:27.007 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:28.086 INFO:teuthology.orchestra.run.smithi152.stdout:generic/652 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:28.101 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/652 2024-03-18T21:22:28.101 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/652 2024-03-18T21:22:28.101 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:28.114 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:28.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:22:28.281 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:22:28.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:28.395 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/653) 2024-03-18T21:22:29.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:29.106 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:29.108 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:29.112 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:29.112 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:30.266 INFO:teuthology.orchestra.run.smithi152.stdout:generic/653 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:30.274 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/653 2024-03-18T21:22:30.275 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/653 2024-03-18T21:22:30.275 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:30.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:30.395 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:30.396 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/654) 2024-03-18T21:22:31.232 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:31.247 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:31.248 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:31.252 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:31.252 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:32.354 INFO:teuthology.orchestra.run.smithi152.stdout:generic/654 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:32.369 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/654 2024-03-18T21:22:32.369 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/654 2024-03-18T21:22:32.369 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:32.373 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:32.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:32.567 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/655) 2024-03-18T21:22:33.309 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:33.322 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:33.323 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:33.326 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:33.326 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:34.298 INFO:teuthology.orchestra.run.smithi152.stdout:generic/655 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:34.306 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/655 2024-03-18T21:22:34.306 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/655 2024-03-18T21:22:34.306 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:34.308 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:34.524 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:34.525 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/656) 2024-03-18T21:22:35.266 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:35.280 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:35.281 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:35.284 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:35.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:36.493 INFO:teuthology.orchestra.run.smithi152.stdout:generic/656 [not run] vfstest not support by ceph 2024-03-18T21:22:36.499 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/656 2024-03-18T21:22:36.499 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/656 2024-03-18T21:22:36.499 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:36.505 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:36.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:36.539 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/657) 2024-03-18T21:22:37.092 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:37.099 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:37.101 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:37.103 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:37.103 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:38.237 INFO:teuthology.orchestra.run.smithi152.stdout:generic/657 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:38.252 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/657 2024-03-18T21:22:38.253 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/657 2024-03-18T21:22:38.253 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:38.266 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:38.508 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:38.508 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/658) 2024-03-18T21:22:39.255 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:39.259 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:39.260 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:39.262 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:39.263 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:40.326 INFO:teuthology.orchestra.run.smithi152.stdout:generic/658 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:40.341 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/658 2024-03-18T21:22:40.341 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/658 2024-03-18T21:22:40.341 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:40.365 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:40.546 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:40.546 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/659) 2024-03-18T21:22:41.259 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:41.274 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:41.276 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:41.278 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:41.278 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:42.422 INFO:teuthology.orchestra.run.smithi152.stdout:generic/659 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:42.434 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/659 2024-03-18T21:22:42.435 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/659 2024-03-18T21:22:42.435 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:42.445 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:42.568 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:42.568 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/660) 2024-03-18T21:22:43.218 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:43.234 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:43.236 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:43.236 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:43.236 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:44.259 INFO:teuthology.orchestra.run.smithi152.stdout:generic/660 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:44.273 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/660 2024-03-18T21:22:44.274 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/660 2024-03-18T21:22:44.274 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:44.283 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:44.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:44.532 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/661) 2024-03-18T21:22:45.261 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:45.269 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:45.270 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:45.272 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:45.272 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:46.302 INFO:teuthology.orchestra.run.smithi152.stdout:generic/661 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:46.308 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/661 2024-03-18T21:22:46.308 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/661 2024-03-18T21:22:46.309 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:46.312 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:46.579 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:46.579 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/662) 2024-03-18T21:22:47.437 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:47.450 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:47.451 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:47.454 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:47.454 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:48.530 INFO:teuthology.orchestra.run.smithi152.stdout:generic/662 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:48.546 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/662 2024-03-18T21:22:48.546 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/662 2024-03-18T21:22:48.547 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:48.559 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:48.680 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:48.681 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/663) 2024-03-18T21:22:49.461 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:49.474 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:49.476 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:49.480 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:49.480 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:50.512 INFO:teuthology.orchestra.run.smithi152.stdout:generic/663 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:50.520 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/663 2024-03-18T21:22:50.520 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/663 2024-03-18T21:22:50.520 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:50.522 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:50.691 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:50.691 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/664) 2024-03-18T21:22:51.497 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:51.513 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:51.513 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:51.515 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:51.515 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:52.516 INFO:teuthology.orchestra.run.smithi152.stdout:generic/664 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:52.532 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/664 2024-03-18T21:22:52.533 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/664 2024-03-18T21:22:52.533 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:52.548 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:52.725 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:52.725 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/665) 2024-03-18T21:22:53.402 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:53.417 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:53.419 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:53.422 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:53.422 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:54.601 INFO:teuthology.orchestra.run.smithi152.stdout:generic/665 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:54.618 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/665 2024-03-18T21:22:54.619 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/665 2024-03-18T21:22:54.619 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:54.629 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:54.834 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:54.834 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/666) 2024-03-18T21:22:55.523 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:55.538 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:55.538 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:55.541 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:55.541 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:56.500 INFO:teuthology.orchestra.run.smithi152.stdout:generic/666 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:56.515 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/666 2024-03-18T21:22:56.515 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/666 2024-03-18T21:22:56.515 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:56.531 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:56.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:56.704 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/667) 2024-03-18T21:22:57.421 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:57.432 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:57.432 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:57.433 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:57.433 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:58.450 INFO:teuthology.orchestra.run.smithi152.stdout:generic/667 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:22:58.466 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/667 2024-03-18T21:22:58.467 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/667 2024-03-18T21:22:58.467 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:22:58.481 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:22:58.490 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:22:58.498 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:22:58.639 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:22:58.639 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/668) 2024-03-18T21:22:59.346 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:22:59.361 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:22:59.362 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:22:59.364 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:22:59.364 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:00.321 INFO:teuthology.orchestra.run.smithi152.stdout:generic/668 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:00.335 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/668 2024-03-18T21:23:00.335 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/668 2024-03-18T21:23:00.335 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:00.348 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:00.542 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:00.543 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/669) 2024-03-18T21:23:01.234 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:01.247 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:01.248 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:01.252 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:01.252 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:02.259 INFO:teuthology.orchestra.run.smithi152.stdout:generic/669 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:02.266 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/669 2024-03-18T21:23:02.266 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/669 2024-03-18T21:23:02.266 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:02.269 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:02.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:02.453 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/670) 2024-03-18T21:23:03.166 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:03.177 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:03.178 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:03.182 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:03.182 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:04.163 INFO:teuthology.orchestra.run.smithi152.stdout:generic/670 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:04.175 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/670 2024-03-18T21:23:04.175 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/670 2024-03-18T21:23:04.175 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:04.189 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:04.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:04.397 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/671) 2024-03-18T21:23:05.172 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:05.187 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:05.188 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:05.191 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:05.191 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:06.162 INFO:teuthology.orchestra.run.smithi152.stdout:generic/671 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:06.190 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/671 2024-03-18T21:23:06.190 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/671 2024-03-18T21:23:06.191 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:06.200 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:06.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:06.414 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/672) 2024-03-18T21:23:07.133 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:07.142 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:07.145 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:07.147 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:07.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:08.118 INFO:teuthology.orchestra.run.smithi152.stdout:generic/672 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:08.131 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/672 2024-03-18T21:23:08.131 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/672 2024-03-18T21:23:08.131 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:08.147 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:08.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:08.311 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/673) 2024-03-18T21:23:09.076 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:09.085 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:09.085 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:09.086 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:09.086 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:10.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/673 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:10.789 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/673 2024-03-18T21:23:10.789 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/673 2024-03-18T21:23:10.789 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:10.804 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:11.046 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:11.047 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/674) 2024-03-18T21:23:11.769 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:11.783 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:11.785 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:11.788 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:11.788 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:12.689 INFO:teuthology.orchestra.run.smithi152.stdout:generic/674 [not run] Dedupe not supported by scratch filesystem type: ceph 2024-03-18T21:23:12.764 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/674 2024-03-18T21:23:12.765 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/674 2024-03-18T21:23:12.765 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:12.784 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:13.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:13.017 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/675) 2024-03-18T21:23:13.704 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:13.716 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:13.717 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:13.719 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:13.719 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:14.821 INFO:teuthology.orchestra.run.smithi152.stdout:generic/675 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:23:14.868 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/675 2024-03-18T21:23:14.868 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/675 2024-03-18T21:23:14.868 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:23:14.878 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:15.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:23:15.077 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/676) 2024-03-18T21:23:15.744 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:23:15.755 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:23:15.756 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:23:15.775 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:23:15.775 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:23:28.644 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:23:28.649 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:23:58.971 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:23:58.977 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:24:29.236 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:24:29.239 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:24:29.420 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T21:24:29.419+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725731) UID: 0 2024-03-18T21:24:29.421 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T21:24:29.419+0000 7fcb8fbc4640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725731) UID: 0 2024-03-18T21:24:29.421 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T21:24:29.419+0000 7ff58bb55640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725731) UID: 0 2024-03-18T21:24:29.421 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T21:24:29.419+0000 7f91da83c640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 725731) UID: 0 2024-03-18T21:32:58.503 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:32:58.513 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:32:58.879 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T21:32:58.874+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 725755) UID: 0 2024-03-18T21:32:58.880 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T21:32:58.874+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 725755) UID: 0 2024-03-18T21:47:23.278 INFO:teuthology.orchestra.run.smithi152.stdout:generic/676 1447s 2024-03-18T21:47:23.381 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/676 2024-03-18T21:47:23.381 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:23.386 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:23.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:23.740 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/677) 2024-03-18T21:47:25.400 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:25.414 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:25.417 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:25.421 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:25.421 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:26.438 INFO:teuthology.orchestra.run.smithi152.stdout:generic/677 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T21:47:26.446 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/677 2024-03-18T21:47:26.446 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/677 2024-03-18T21:47:26.446 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:26.450 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:26.493 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:26.493 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/678) 2024-03-18T21:47:27.145 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:27.161 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:27.161 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:27.164 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:27.164 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:28.091 INFO:teuthology.orchestra.run.smithi152.stdout:generic/678 [not run] kernel does not support IO_URING 2024-03-18T21:47:28.099 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/678 2024-03-18T21:47:28.099 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/678 2024-03-18T21:47:28.099 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:28.109 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:28.150 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:28.150 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/679) 2024-03-18T21:47:28.781 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:28.796 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:28.798 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:28.799 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:28.799 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:29.606 INFO:teuthology.orchestra.run.smithi152.stdout:generic/679 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T21:47:29.618 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/679 2024-03-18T21:47:29.618 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/679 2024-03-18T21:47:29.618 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:29.627 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:29.672 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:29.672 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/680) 2024-03-18T21:47:30.326 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:30.341 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:30.342 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:30.346 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:30.346 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:32.642 INFO:teuthology.orchestra.run.smithi152.stdout:generic/680 2s 2024-03-18T21:47:32.665 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/680 2024-03-18T21:47:32.665 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:32.677 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:32.846 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:32.846 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/681) 2024-03-18T21:47:33.894 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:33.912 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:33.912 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:33.914 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:33.915 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:34.725 INFO:teuthology.orchestra.run.smithi152.stdout:generic/681 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T21:47:34.739 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/681 2024-03-18T21:47:34.739 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/681 2024-03-18T21:47:34.739 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:34.747 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:34.810 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:34.810 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/682) 2024-03-18T21:47:35.534 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:35.551 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:35.553 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:35.556 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:35.557 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:36.334 INFO:teuthology.orchestra.run.smithi152.stdout:generic/682 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T21:47:36.347 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/682 2024-03-18T21:47:36.348 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/682 2024-03-18T21:47:36.348 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:36.353 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:36.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:36.403 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/683) 2024-03-18T21:47:37.098 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:37.107 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:37.108 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:37.116 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:37.116 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:37.911 INFO:teuthology.orchestra.run.smithi152.stdout:generic/683 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T21:47:37.937 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/683 2024-03-18T21:47:37.938 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/683 2024-03-18T21:47:37.938 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:37.948 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:38.029 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:38.029 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/684) 2024-03-18T21:47:38.624 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:38.629 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:38.631 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:38.635 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:38.635 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:47.141 INFO:teuthology.orchestra.run.smithi152.stdout:generic/684 - output mismatch (see /tmp/tmp.YntrTC91Q1xfstests-dev/results//generic/684.out.bad) 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: --- tests/generic/684.out 2024-03-18 15:01:56.589592193 +0000 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: +++ /tmp/tmp.YntrTC91Q1xfstests-dev/results//generic/684.out.bad 2024-03-18 21:47:47.108937116 +0000 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -1,7 +1,7 @@ 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: QA output created by 684 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: Test 1 - qa_user, non-exec file fpunch 2024-03-18T21:47:47.149 INFO:teuthology.orchestra.run.smithi152.stdout: 6666 -rwSrwSrw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: -666 -rw-rw-rw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: +2666 -rw-rwSrw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: Test 2 - qa_user, group-exec file fpunch 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: 6676 -rwSrwsrw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: @@ -9,7 +9,7 @@ 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: Test 3 - qa_user, user-exec file fpunch 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: 6766 -rwsrwSrw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: -766 -rwxrw-rw- TEST_DIR/684/a 2024-03-18T21:47:47.150 INFO:teuthology.orchestra.run.smithi152.stdout: +2766 -rwxrwSrw- TEST_DIR/684/a 2024-03-18T21:47:47.151 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:47.151 INFO:teuthology.orchestra.run.smithi152.stdout: Test 4 - qa_user, all-exec file fpunch 2024-03-18T21:47:47.151 INFO:teuthology.orchestra.run.smithi152.stdout: 6777 -rwsrwsrwx TEST_DIR/684/a 2024-03-18T21:47:47.158 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/684 2024-03-18T21:47:47.159 INFO:teuthology.orchestra.run.smithi152.stdout:Failures: generic/684 2024-03-18T21:47:47.159 INFO:teuthology.orchestra.run.smithi152.stdout:Failed 1 of 1 tests 2024-03-18T21:47:47.169 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:47.362 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T21:47:47.363 INFO:tasks.cephfs.xfstests_dev:Command failed 2024-03-18T21:47:47.363 INFO:tasks.cephfs.xfstests_dev:Command return value: 1 2024-03-18T21:47:47.363 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/685) 2024-03-18T21:47:48.325 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:48.339 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:48.341 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:48.344 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:48.344 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:49.466 INFO:teuthology.orchestra.run.smithi152.stdout:generic/685 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2024-03-18T21:47:49.479 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/685 2024-03-18T21:47:49.479 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/685 2024-03-18T21:47:49.479 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:49.488 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:49.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:49.559 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/686) 2024-03-18T21:47:50.217 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:50.229 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:50.231 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:50.233 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:50.233 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:51.359 INFO:teuthology.orchestra.run.smithi152.stdout:generic/686 [not run] xfs_io finsert failed (old kernel/wrong fs?) 2024-03-18T21:47:51.367 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/686 2024-03-18T21:47:51.367 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/686 2024-03-18T21:47:51.367 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:51.372 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:51.423 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:51.423 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/687) 2024-03-18T21:47:52.086 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:52.108 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:52.109 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:52.126 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:52.126 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:53.205 INFO:teuthology.orchestra.run.smithi152.stdout:generic/687 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2024-03-18T21:47:53.220 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/687 2024-03-18T21:47:53.220 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/687 2024-03-18T21:47:53.220 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:53.232 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:53.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:53.337 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/688) 2024-03-18T21:47:54.151 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:54.170 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:54.172 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:54.176 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:54.176 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:55.208 INFO:teuthology.orchestra.run.smithi152.stdout:generic/688 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T21:47:55.222 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/688 2024-03-18T21:47:55.222 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/688 2024-03-18T21:47:55.222 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:55.231 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:55.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:55.331 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/689) 2024-03-18T21:47:56.105 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:56.126 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:56.129 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:56.132 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:56.132 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:56.976 INFO:teuthology.orchestra.run.smithi152.stdout:generic/689 [not run] vfstest not support by ceph 2024-03-18T21:47:56.989 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/689 2024-03-18T21:47:56.990 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/689 2024-03-18T21:47:56.990 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:56.999 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:57.085 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:57.085 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/690) 2024-03-18T21:47:57.807 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:57.826 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:57.835 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:57.838 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:57.838 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:58.702 INFO:teuthology.orchestra.run.smithi152.stdout:generic/690 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T21:47:58.717 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/690 2024-03-18T21:47:58.717 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/690 2024-03-18T21:47:58.718 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:47:58.726 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:47:58.790 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:47:58.790 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/691) 2024-03-18T21:47:59.477 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:47:59.491 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:47:59.493 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:47:59.495 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:47:59.496 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:00.287 INFO:teuthology.orchestra.run.smithi152.stdout:generic/691 [not run] disk quotas not supported by this filesystem type: ceph 2024-03-18T21:48:00.302 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/691 2024-03-18T21:48:00.302 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/691 2024-03-18T21:48:00.302 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:00.311 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:00.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:00.365 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/692) 2024-03-18T21:48:01.010 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:01.025 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:01.025 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:01.027 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:01.027 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:01.799 INFO:teuthology.orchestra.run.smithi152.stdout:generic/692 [not run] fsverity utility required, skipped this test 2024-03-18T21:48:01.811 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/692 2024-03-18T21:48:01.811 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/692 2024-03-18T21:48:01.812 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:01.819 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:01.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:01.871 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/693) 2024-03-18T21:48:02.534 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:02.553 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:02.554 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:02.558 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:02.558 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:03.621 INFO:teuthology.orchestra.run.smithi152.stdout:generic/693 [not run] kernel does not support ceph encryption 2024-03-18T21:48:03.658 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/693 2024-03-18T21:48:03.658 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/693 2024-03-18T21:48:03.658 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:03.678 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:03.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:03.721 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/694) 2024-03-18T21:48:04.372 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:04.389 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:04.391 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:04.393 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:04.393 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:19.598 INFO:teuthology.orchestra.run.smithi152.stdout:generic/694 15s 2024-03-18T21:48:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/694 2024-03-18T21:48:19.621 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:19.634 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:19.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:19.717 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/695) 2024-03-18T21:48:20.493 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:20.508 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:20.510 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:20.513 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:20.513 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:21.368 INFO:teuthology.orchestra.run.smithi152.stdout:generic/695 [not run] require 172.21.15.152:6789:/scratch to be valid block disk 2024-03-18T21:48:21.384 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/695 2024-03-18T21:48:21.385 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/695 2024-03-18T21:48:21.385 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:21.395 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:21.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:21.467 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/696) 2024-03-18T21:48:22.251 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:22.268 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:22.268 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:22.275 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:22.275 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:23.788 INFO:teuthology.orchestra.run.smithi152.stdout:generic/696 1s 2024-03-18T21:48:23.823 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/696 2024-03-18T21:48:23.824 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:23.842 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:23.996 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:23.996 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/697) 2024-03-18T21:48:24.908 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:24.919 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:24.921 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:24.931 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:24.931 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:26.187 INFO:teuthology.orchestra.run.smithi152.stdout:generic/697 1s 2024-03-18T21:48:26.212 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/697 2024-03-18T21:48:26.213 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:26.223 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:26.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:26.302 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/698) 2024-03-18T21:48:27.422 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:27.436 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:27.439 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:27.441 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:27.441 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:28.298 INFO:teuthology.orchestra.run.smithi152.stdout:generic/698 [not run] vfstest not support by ceph 2024-03-18T21:48:28.311 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/698 2024-03-18T21:48:28.311 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/698 2024-03-18T21:48:28.311 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:28.321 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:28.372 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:28.372 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/699) 2024-03-18T21:48:29.045 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:29.069 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:29.072 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:29.077 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:29.077 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:30.057 INFO:teuthology.orchestra.run.smithi152.stdout:generic/699 [not run] vfstest not support by ceph 2024-03-18T21:48:30.062 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/699 2024-03-18T21:48:30.062 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/699 2024-03-18T21:48:30.063 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:30.068 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:30.142 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:30.142 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/700) 2024-03-18T21:48:30.849 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:30.858 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:30.859 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:30.863 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:30.863 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:31.819 INFO:teuthology.orchestra.run.smithi152.stdout:generic/700 [not run] kernel doesn't support renameat2 syscall 2024-03-18T21:48:31.826 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/700 2024-03-18T21:48:31.826 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/700 2024-03-18T21:48:31.826 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:31.834 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:31.955 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:31.955 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/701) 2024-03-18T21:48:32.958 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:32.973 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:32.975 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:32.978 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:32.978 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:45.699 INFO:teuthology.orchestra.run.smithi152.stdout:generic/701 12s 2024-03-18T21:48:45.722 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/701 2024-03-18T21:48:45.723 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:45.736 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:49.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:49.019 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/702) 2024-03-18T21:48:50.017 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:50.027 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:50.027 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:50.030 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:50.030 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:51.278 INFO:teuthology.orchestra.run.smithi152.stdout:generic/702 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T21:48:51.286 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/702 2024-03-18T21:48:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/702 2024-03-18T21:48:51.287 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:51.292 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:51.902 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:51.902 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/703) 2024-03-18T21:48:52.611 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:52.627 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:52.629 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:52.632 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:52.632 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:53.562 INFO:teuthology.orchestra.run.smithi152.stdout:generic/703 [not run] kernel does not support IO_URING 2024-03-18T21:48:53.572 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/703 2024-03-18T21:48:53.573 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/703 2024-03-18T21:48:53.573 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:53.582 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:53.640 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:53.640 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/704) 2024-03-18T21:48:54.286 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:54.301 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:54.304 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:54.306 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:54.306 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:55.164 INFO:teuthology.orchestra.run.smithi152.stdout:generic/704 [not run] require 172.21.15.152:6789:/test to be valid block disk 2024-03-18T21:48:55.173 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/704 2024-03-18T21:48:55.174 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/704 2024-03-18T21:48:55.174 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:55.181 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:55.225 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:55.226 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/705) 2024-03-18T21:48:55.937 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:55.955 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:55.956 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:55.960 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:55.960 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:56.976 INFO:teuthology.orchestra.run.smithi152.stdout:generic/705 [not run] ceph does not support shutdown 2024-03-18T21:48:57.013 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/705 2024-03-18T21:48:57.013 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/705 2024-03-18T21:48:57.013 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:48:57.022 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:48:57.066 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:48:57.067 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/706) 2024-03-18T21:48:57.732 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:48:57.749 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:48:57.749 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:48:57.751 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:48:57.751 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:49:01.590 INFO:teuthology.orchestra.run.smithi152.stdout:generic/706 3s 2024-03-18T21:49:01.604 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/706 2024-03-18T21:49:01.604 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T21:49:01.610 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:49:01.765 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T21:49:01.765 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/707) 2024-03-18T21:49:02.672 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T21:49:02.693 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T21:49:02.694 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T21:49:02.699 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T21:49:02.699 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T21:50:46.008 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:50:46.017 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T21:50:46.053 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T21:50:46.051+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54665) UID: 0 2024-03-18T21:50:46.053 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T21:50:46.051+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54665) UID: 0 2024-03-18T21:50:46.054 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T21:50:46.051+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54665) UID: 0 2024-03-18T21:50:46.054 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T21:50:46.051+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54665) UID: 0 2024-03-18T21:50:46.140 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T21:50:46.138+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 745081) UID: 0 2024-03-18T21:50:46.141 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T21:50:46.138+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 745081) UID: 0 2024-03-18T22:07:13.967 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T22:07:13.963+0000 7fcb8fbc4640 -1 Fail to open '/proc/780651/cmdline' error = (2) No such file or directory 2024-03-18T22:07:13.968 INFO:tasks.ceph.osd.1.smithi152.stderr:2024-03-18T22:07:13.963+0000 7fcb8fbc4640 -1 received signal: Hangup from (PID: 780651) UID: 0 2024-03-18T22:07:13.968 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T22:07:13.964+0000 7ff58bb55640 -1 Fail to open '/proc/780651/cmdline' error = (2) No such file or directory 2024-03-18T22:07:13.968 INFO:tasks.ceph.osd.0.smithi152.stderr:2024-03-18T22:07:13.964+0000 7ff58bb55640 -1 received signal: Hangup from (PID: 780651) UID: 0 2024-03-18T22:07:13.970 INFO:tasks.ceph.osd.2.smithi152.stderr:2024-03-18T22:07:13.962+0000 7fb5423f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 780651) UID: 0 2024-03-18T22:07:13.970 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T22:07:13.967+0000 7f91da83c640 -1 Fail to open '/proc/780651/cmdline' error = (2) No such file or directory 2024-03-18T22:07:13.970 INFO:tasks.ceph.osd.3.smithi152.stderr:2024-03-18T22:07:13.968+0000 7f91da83c640 -1 received signal: Hangup from (PID: 780651) UID: 0 2024-03-18T22:24:06.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:24:06.971 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:24:07.254 INFO:tasks.ceph.osd.4.smithi186.stderr:2024-03-18T22:24:07.253+0000 7efef7dba640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54721) UID: 0 2024-03-18T22:24:07.254 INFO:tasks.ceph.osd.5.smithi186.stderr:2024-03-18T22:24:07.253+0000 7f5475636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54721) UID: 0 2024-03-18T22:24:07.255 INFO:tasks.ceph.osd.6.smithi186.stderr:2024-03-18T22:24:07.253+0000 7f68834e1640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54721) UID: 0 2024-03-18T22:24:07.255 INFO:tasks.ceph.osd.7.smithi186.stderr:2024-03-18T22:24:07.253+0000 7f695b7f9640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 54721) UID: 0 2024-03-18T22:24:07.325 INFO:tasks.ceph.mds.a.smithi152.stderr:2024-03-18T22:24:07.323+0000 7f6164db7640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 818324) UID: 0 2024-03-18T22:24:07.325 INFO:tasks.ceph.mds.c.smithi152.stderr:2024-03-18T22:24:07.323+0000 7f66649ad640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 818324) UID: 0 2024-03-18T22:34:32.371 INFO:teuthology.orchestra.run.smithi152.stdout:generic/707 2729s 2024-03-18T22:34:32.500 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/707 2024-03-18T22:34:32.500 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:32.509 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:32.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:32.559 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/708) 2024-03-18T22:34:33.924 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:33.937 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:33.939 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:33.942 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:33.943 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:41.093 INFO:teuthology.orchestra.run.smithi152.stdout:generic/708 1s 2024-03-18T22:34:41.113 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/708 2024-03-18T22:34:41.113 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:41.115 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:41.364 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:41.364 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/709) 2024-03-18T22:34:42.199 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:42.216 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:42.218 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:42.221 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:42.221 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:43.107 INFO:teuthology.orchestra.run.smithi152.stdout:generic/709 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/709 2024-03-18T22:34:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/709 2024-03-18T22:34:43.122 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:43.130 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:43.254 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:43.254 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/710) 2024-03-18T22:34:44.225 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:44.243 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:44.244 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:44.248 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:44.248 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:45.100 INFO:teuthology.orchestra.run.smithi152.stdout:generic/710 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:45.118 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/710 2024-03-18T22:34:45.119 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/710 2024-03-18T22:34:45.119 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:45.128 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:45.217 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:45.218 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/711) 2024-03-18T22:34:46.141 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:46.147 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:46.148 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:46.152 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:46.152 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:47.157 INFO:teuthology.orchestra.run.smithi152.stdout:generic/711 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/711 2024-03-18T22:34:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/711 2024-03-18T22:34:47.167 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:47.173 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:47.340 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:47.341 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/712) 2024-03-18T22:34:48.206 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:48.214 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:48.216 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:48.219 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:48.219 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:49.090 INFO:teuthology.orchestra.run.smithi152.stdout:generic/712 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:49.099 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/712 2024-03-18T22:34:49.099 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/712 2024-03-18T22:34:49.100 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:49.106 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:49.287 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:49.287 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/713) 2024-03-18T22:34:50.128 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:50.140 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:50.143 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:50.145 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:50.145 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:50.968 INFO:teuthology.orchestra.run.smithi152.stdout:generic/713 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-18T22:34:50.982 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/713 2024-03-18T22:34:50.982 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/713 2024-03-18T22:34:50.982 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:50.991 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:51.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:51.129 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/714) 2024-03-18T22:34:52.033 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:52.052 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:52.053 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:52.057 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:52.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:52.850 INFO:teuthology.orchestra.run.smithi152.stdout:generic/714 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:52.864 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/714 2024-03-18T22:34:52.864 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/714 2024-03-18T22:34:52.864 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:52.875 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:53.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:53.051 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/715) 2024-03-18T22:34:53.999 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:54.014 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:54.016 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:54.020 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:54.020 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:54.877 INFO:teuthology.orchestra.run.smithi152.stdout:generic/715 [not run] xfs_io swapext -v exchrange -s 64k -l 64k not supported on ceph 2024-03-18T22:34:54.887 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/715 2024-03-18T22:34:54.888 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/715 2024-03-18T22:34:54.888 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:54.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:55.037 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:55.038 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/716) 2024-03-18T22:34:55.894 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:55.907 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:55.910 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:55.912 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:55.913 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:56.743 INFO:teuthology.orchestra.run.smithi152.stdout:generic/716 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:56.755 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/716 2024-03-18T22:34:56.755 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/716 2024-03-18T22:34:56.756 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:56.765 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:56.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:56.974 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/717) 2024-03-18T22:34:57.837 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:57.852 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:57.853 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:57.863 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:57.863 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:58.652 INFO:teuthology.orchestra.run.smithi152.stdout:generic/717 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:34:58.667 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/717 2024-03-18T22:34:58.667 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/717 2024-03-18T22:34:58.667 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:34:58.676 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:34:58.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:34:58.787 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/718) 2024-03-18T22:34:59.469 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:34:59.484 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:34:59.485 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:34:59.485 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:34:59.485 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:00.279 INFO:teuthology.orchestra.run.smithi152.stdout:generic/718 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:35:00.286 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/718 2024-03-18T22:35:00.286 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/718 2024-03-18T22:35:00.286 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:00.289 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:00.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:00.449 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/719) 2024-03-18T22:35:01.276 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:01.292 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:01.295 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:01.298 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:01.298 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:02.235 INFO:teuthology.orchestra.run.smithi152.stdout:generic/719 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:35:02.249 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/719 2024-03-18T22:35:02.250 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/719 2024-03-18T22:35:02.250 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:02.259 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:02.348 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:02.348 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/720) 2024-03-18T22:35:02.991 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:03.003 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:03.006 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:03.010 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:03.010 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:03.879 INFO:teuthology.orchestra.run.smithi152.stdout:generic/720 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:35:03.893 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/720 2024-03-18T22:35:03.893 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/720 2024-03-18T22:35:03.893 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:03.903 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:04.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:04.090 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/721) 2024-03-18T22:35:04.988 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:05.003 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:05.005 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:05.008 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:05.009 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:05.825 INFO:teuthology.orchestra.run.smithi152.stdout:generic/721 [not run] xfs_io startupdate support is missing 2024-03-18T22:35:05.832 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/721 2024-03-18T22:35:05.832 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/721 2024-03-18T22:35:05.832 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:05.837 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:05.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:05.897 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/722) 2024-03-18T22:35:06.421 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:06.439 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:06.440 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:06.443 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:06.443 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:07.177 INFO:teuthology.orchestra.run.smithi152.stdout:generic/722 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T22:35:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/722 2024-03-18T22:35:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/722 2024-03-18T22:35:07.187 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:07.195 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:07.279 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:07.279 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/723) 2024-03-18T22:35:08.147 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:08.161 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:08.162 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:08.164 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:08.164 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:09.021 INFO:teuthology.orchestra.run.smithi152.stdout:generic/723 [not run] xfs_io swapext -v exchrange not supported on ceph 2024-03-18T22:35:09.028 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/723 2024-03-18T22:35:09.028 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/723 2024-03-18T22:35:09.029 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:09.038 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:09.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:09.123 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/724) 2024-03-18T22:35:09.936 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:09.950 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:09.951 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:09.957 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:09.957 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:10.811 INFO:teuthology.orchestra.run.smithi152.stdout:generic/724 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T22:35:10.822 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/724 2024-03-18T22:35:10.822 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/724 2024-03-18T22:35:10.822 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:10.825 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:10.964 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:10.965 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/725) 2024-03-18T22:35:11.861 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:11.876 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:11.878 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:11.882 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:11.882 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:12.569 INFO:teuthology.orchestra.run.smithi152.stdout:generic/725 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T22:35:12.582 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/725 2024-03-18T22:35:12.582 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/725 2024-03-18T22:35:12.582 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:12.592 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:12.762 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:12.762 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/726) 2024-03-18T22:35:13.633 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:13.644 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:13.644 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:13.647 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:13.647 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:15.227 INFO:teuthology.orchestra.run.smithi152.stdout:generic/726 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T22:35:15.239 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/726 2024-03-18T22:35:15.240 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/726 2024-03-18T22:35:15.240 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:15.247 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:15.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:15.404 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/727) 2024-03-18T22:35:16.260 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:16.274 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:16.275 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:16.279 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:16.279 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:17.172 INFO:teuthology.orchestra.run.smithi152.stdout:generic/727 [not run] xfs_io swapext -v exchrange -a not supported on ceph 2024-03-18T22:35:17.185 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/727 2024-03-18T22:35:17.186 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/727 2024-03-18T22:35:17.186 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:17.198 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:17.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:17.373 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/728) 2024-03-18T22:35:18.447 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:18.453 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:18.455 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:18.459 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:18.459 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:23.606 INFO:teuthology.orchestra.run.smithi152.stdout:generic/728 5s 2024-03-18T22:35:23.642 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/728 2024-03-18T22:35:23.643 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:23.650 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:23.755 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:23.756 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/729) 2024-03-18T22:35:24.648 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:24.663 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:24.666 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:24.668 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:24.668 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:26.057 INFO:teuthology.orchestra.run.smithi152.stdout:generic/729 2s 2024-03-18T22:35:26.078 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/729 2024-03-18T22:35:26.079 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:26.088 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:26.255 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:26.256 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/730) 2024-03-18T22:35:27.054 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:27.063 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:27.064 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:27.066 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:27.066 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:27.872 INFO:teuthology.orchestra.run.smithi152.stdout:generic/730 [not run] require 172.21.15.152:6789:/test to be valid block disk 2024-03-18T22:35:27.885 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/730 2024-03-18T22:35:27.885 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/730 2024-03-18T22:35:27.885 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:27.895 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:27.927 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:27.928 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/731) 2024-03-18T22:35:28.638 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:28.650 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:28.651 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:28.653 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:28.653 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:29.330 INFO:teuthology.orchestra.run.smithi152.stdout:generic/731 [not run] require 172.21.15.152:6789:/test to be valid block disk 2024-03-18T22:35:29.344 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/731 2024-03-18T22:35:29.344 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/731 2024-03-18T22:35:29.344 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:29.349 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:29.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:29.388 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/732) 2024-03-18T22:35:30.033 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:30.053 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:30.054 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:30.057 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:30.057 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:31.707 INFO:teuthology.orchestra.run.smithi152.stdout:generic/732 1s 2024-03-18T22:35:31.730 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/732 2024-03-18T22:35:31.730 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:31.748 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:31.789 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:31.789 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/733) 2024-03-18T22:35:32.479 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:32.495 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:32.497 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:32.500 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:32.500 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:33.685 INFO:teuthology.orchestra.run.smithi152.stdout:generic/733 [not run] Reflink not supported by scratch filesystem type: ceph 2024-03-18T22:35:33.698 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/733 2024-03-18T22:35:33.699 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/733 2024-03-18T22:35:33.699 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:33.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:34.006 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:34.006 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/734) 2024-03-18T22:35:34.984 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:34.998 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:34.998 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:34.999 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:34.999 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:35.818 INFO:teuthology.orchestra.run.smithi152.stdout:generic/734 [not run] Reflink not supported by test filesystem type: ceph 2024-03-18T22:35:35.829 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/734 2024-03-18T22:35:35.829 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/734 2024-03-18T22:35:35.829 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:35.836 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:36.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:36.052 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/735) 2024-03-18T22:35:36.983 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:37.007 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:37.009 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:37.013 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:37.013 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:37.771 INFO:teuthology.orchestra.run.smithi152.stdout:generic/735 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2024-03-18T22:35:37.788 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/735 2024-03-18T22:35:37.789 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/735 2024-03-18T22:35:37.789 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:35:37.798 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:35:37.881 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:35:37.881 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/736) 2024-03-18T22:35:38.821 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:35:38.838 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:35:38.840 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:35:38.845 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:35:38.845 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:36:14.934 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:36:14.938 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:36:45.055 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:36:45.059 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:37:15.234 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:37:15.238 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:37:45.384 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:37:45.390 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:38:15.479 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:38:15.484 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:38:45.869 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:38:45.874 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:39:15.982 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:39:15.987 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:39:36.734 INFO:teuthology.orchestra.run.smithi152.stdout:generic/736 237s 2024-03-18T22:39:36.754 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/736 2024-03-18T22:39:36.754 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:39:36.758 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:37.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:39:37.056 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/737) 2024-03-18T22:39:37.925 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:39:37.939 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:39:37.940 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:39:37.941 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:39:37.941 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:38.908 INFO:teuthology.orchestra.run.smithi152.stdout:generic/737 [not run] ceph does not support shutdown 2024-03-18T22:39:38.933 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/737 2024-03-18T22:39:38.933 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/737 2024-03-18T22:39:38.934 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:39:38.942 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:38.998 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:39:38.998 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/738) 2024-03-18T22:39:39.513 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:39:39.522 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:39:39.522 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:39:39.526 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:39:39.526 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:40.258 INFO:teuthology.orchestra.run.smithi152.stdout:generic/738 [not run] ceph does not support freezing 2024-03-18T22:39:40.272 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/738 2024-03-18T22:39:40.272 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/738 2024-03-18T22:39:40.272 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:39:40.284 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:40.325 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:39:40.325 DEBUG:teuthology.orchestra.run.smithi152:> (cd /tmp/tmp.YntrTC91Q1xfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/739) 2024-03-18T22:39:40.901 INFO:teuthology.orchestra.run.smithi152.stdout:FSTYP -- ceph 2024-03-18T22:39:40.916 INFO:teuthology.orchestra.run.smithi152.stdout:PLATFORM -- Linux/x86_64 smithi152 5.14.0-427.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Fri Feb 23 04:45:07 UTC 2024 2024-03-18T22:39:40.916 INFO:teuthology.orchestra.run.smithi152.stdout:MKFS_OPTIONS -- 172.21.15.152:6789:/scratch 2024-03-18T22:39:40.918 INFO:teuthology.orchestra.run.smithi152.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQDgVvhl04IMGBAAHISt14k8w1OTCW9gP+2pBA== -o context=system_u:object_r:root_t:s0 172.21.15.152:6789:/scratch /tmp/tmp.KIGoX27qplscratch 2024-03-18T22:39:40.918 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:41.753 INFO:teuthology.orchestra.run.smithi152.stdout:generic/739 [not run] xfs_io set_encpolicy doesn't support -s 2024-03-18T22:39:41.766 INFO:teuthology.orchestra.run.smithi152.stdout:Ran: generic/739 2024-03-18T22:39:41.766 INFO:teuthology.orchestra.run.smithi152.stdout:Not run: generic/739 2024-03-18T22:39:41.766 INFO:teuthology.orchestra.run.smithi152.stdout:Passed all 1 tests 2024-03-18T22:39:41.770 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:41.817 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2024-03-18T22:39:41.817 INFO:tasks.cephfs.xfstests_dev:=========================================================Total number of tests failed = 2========================================================= 2024-03-18T22:39:41.818 DEBUG:teuthology.orchestra.run.smithi152:> sudo userdel --force --remove fsgqa 2024-03-18T22:39:42.779 DEBUG:teuthology.orchestra.run.smithi152:> sudo userdel --force --remove 123456-fsgqa 2024-03-18T22:39:43.464 DEBUG:teuthology.orchestra.run.smithi152:> sudo groupdel fsgqa 2024-03-18T22:39:43.569 INFO:teuthology.orchestra.run.smithi152.stderr:groupdel: group 'fsgqa' does not exist 2024-03-18T22:39:43.570 DEBUG:teuthology.orchestra.run:got remote process result: 6 2024-03-18T22:39:43.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:39:43.571 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo stat /tmp/tmp.YntrTC91Q1xfstests-dev/results) 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout: File: /tmp/tmp.YntrTC91Q1xfstests-dev/results 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout: Size: 4096 Blocks: 8 IO Block: 4096 directory 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Device: 801h/2049d Inode: 532806 Links: 3 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Access: (0755/drwxr-xr-x) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Context: unconfined_u:object_r:user_tmp_t:s0 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Access: 2024-03-18 15:04:22.086884087 +0000 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Modify: 2024-03-18 22:39:36.752481294 +0000 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout:Change: 2024-03-18 22:39:36.752481294 +0000 2024-03-18T22:39:43.653 INFO:teuthology.orchestra.run.smithi152.stdout: Birth: 2024-03-18 15:04:22.086884087 +0000 2024-03-18T22:39:43.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:39:43.656 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p /var/log/ceph/xfstests-dev-results) 2024-03-18T22:39:43.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:39:43.750 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp -r /tmp/tmp.YntrTC91Q1xfstests-dev/results /var/log/ceph/xfstests-dev-results) 2024-03-18T22:39:44.689 INFO:tasks.cephfs.xfstests_dev:results dir from xfstests-dev has been saved; it was copied from /tmp/tmp.YntrTC91Q1xfstests-dev to /var/log/ceph. 2024-03-18T22:39:44.689 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf /tmp/tmp.YntrTC91Q1xfstests-dev 2024-03-18T22:39:45.152 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2024-03-18T22:39:45.152 DEBUG:teuthology.orchestra.run.smithi152:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T22:39:45.354 DEBUG:teuthology.orchestra.run.smithi186:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-03-18T22:39:45.537 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2024-03-18T22:39:45.537 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T22:39:45.537 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T22:39:45.537 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:39:45.594 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T22:39:45.594 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:39:45.667 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T22:39:46.133 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:39:46.142 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:39:46.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.190+0000 7f47be412640 1 Processor -- start 2024-03-18T22:39:46.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.191+0000 7f47be412640 1 -- start start 2024-03-18T22:39:46.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.194+0000 7f47be412640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 0x7f47b80b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.194+0000 7f47be412640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b80ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.195+0000 7f47be412640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f47b815fc70 con 0x7f47b8159cc0 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.195+0000 7f47b7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 0x7f47b80b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.195+0000 7f47b7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 0x7f47b80b3740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52850/0 (socket says 172.21.15.152:52850) 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.195+0000 7f47b7fff640 1 -- 172.21.15.152:0/37147336 learned_addr learned my addr 172.21.15.152:0/37147336 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.195+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f47b80b3c80 con 0x7f47b81598e0 2024-03-18T22:39:46.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.196+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f47b815ff50 con 0x7f47b80d07f0 2024-03-18T22:39:46.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.196+0000 7f47bc9af640 1 --2- 172.21.15.152:0/37147336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b80ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:46.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.197+0000 7f47b6ffd640 1 -- 172.21.15.152:0/37147336 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2338831860 0 0) 0x7f47b815fc70 con 0x7f47b8159cc0 2024-03-18T22:39:46.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.197+0000 7f47bc9af640 1 -- 172.21.15.152:0/37147336 >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 msgr2=0x7f47b80b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:46.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.197+0000 7f47bc9af640 1 --2- 172.21.15.152:0/37147336 >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 0x7f47b80b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.197+0000 7f47bc9af640 1 -- 172.21.15.152:0/37147336 >> v1:172.21.15.186:6789/0 conn(0x7f47b8159cc0 legacy=0x7f47b80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:46.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.197+0000 7f47bc9af640 1 -- 172.21.15.152:0/37147336 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b8160230 con 0x7f47b80d07f0 2024-03-18T22:39:46.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.200+0000 7f47bc9af640 1 --2- 172.21.15.152:0/37147336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b80ae850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097a0 tx=0x7f47a002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34b4694d8e09d243 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:46.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.200+0000 7f47b6ffd640 1 -- 172.21.15.152:0/37147336 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0035020 con 0x7f47b80d07f0 2024-03-18T22:39:46.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.200+0000 7f47b6ffd640 1 -- 172.21.15.152:0/37147336 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a0031810 con 0x7f47b80d07f0 2024-03-18T22:39:46.201 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.200+0000 7f47b6ffd640 1 -- 172.21.15.152:0/37147336 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0031be0 con 0x7f47b80d07f0 2024-03-18T22:39:46.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.201+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 msgr2=0x7f47b80ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:46.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.201+0000 7f47be412640 1 --2- 172.21.15.152:0/37147336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b80ae850 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f47a00097a0 tx=0x7f47a002b8b0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 shutdown_connections 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 --2- 172.21.15.152:0/37147336 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b80ae850 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 --2- 172.21.15.152:0/37147336 >> v2:172.21.15.152:3300/0 conn(0x7f47b81598e0 0x7f47b80b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 >> 172.21.15.152:0/37147336 conn(0x7f47b806b5e0 msgr2=0x7f47b806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 shutdown_connections 2024-03-18T22:39:46.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.202+0000 7f47be412640 1 -- 172.21.15.152:0/37147336 wait complete. 2024-03-18T22:39:46.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.207+0000 7f47be412640 1 Processor -- start 2024-03-18T22:39:46.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.208+0000 7f47be412640 1 -- start start 2024-03-18T22:39:46.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b81545f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 0x7f47b8200f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f47b806cc70 con 0x7f47b81598e0 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f47b81607f0 con 0x7f47b8159cc0 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.211+0000 7f47be412640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f47b806cdf0 con 0x7f47b80d07f0 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.212+0000 7f47bc9af640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.212+0000 7f47bc9af640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:41022/0 (socket says 172.21.15.152:41022) 2024-03-18T22:39:46.214 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.212+0000 7f47bc9af640 1 -- 172.21.15.152:0/4266017623 learned_addr learned my addr 172.21.15.152:0/4266017623 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:46.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.212+0000 7f47b77fe640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 0x7f47b8200f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:46.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47b77fe640 1 -- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 msgr2=0x7f47b81545f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T22:39:46.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47b77fe640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b81545f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47b77fe640 1 -- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 msgr2=0x7f47b815d9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:46.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47b77fe640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47b77fe640 1 -- 172.21.15.152:0/4266017623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b815c910 con 0x7f47b81598e0 2024-03-18T22:39:46.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.214+0000 7f47bc9af640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:39:46.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.215+0000 7f47b77fe640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 0x7f47b8200f50 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c3e0 tx=0x7f47a800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:46.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.216+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8017070 con 0x7f47b81598e0 2024-03-18T22:39:46.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.217+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b815cbf0 con 0x7f47b81598e0 2024-03-18T22:39:46.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.217+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b815d1b0 con 0x7f47b81598e0 2024-03-18T22:39:46.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.218+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a80052d0 con 0x7f47b81598e0 2024-03-18T22:39:46.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.218+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8003850 con 0x7f47b81598e0 2024-03-18T22:39:46.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.225+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f47a801a070 con 0x7f47b81598e0 2024-03-18T22:39:46.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.225+0000 7f47b4ff9640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 0x7f479806e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:46.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.225+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f47a8089bd0 con 0x7f47b81598e0 2024-03-18T22:39:46.226 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.226+0000 7f47b7fff640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 0x7f479806e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:46.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.228+0000 7f47b7fff640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 0x7f479806e110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009400 tx=0x7f47b0007040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:46.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.236+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f479c005290 con 0x7f47b81598e0 2024-03-18T22:39:46.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.271+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f47a8058150 con 0x7f47b81598e0 2024-03-18T22:39:46.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.661+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f479c005850 con 0x7f47b81598e0 2024-03-18T22:39:46.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.663+0000 7f47b4ff9640 1 -- 172.21.15.152:0/4266017623 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f47a805c1f0 con 0x7f47b81598e0 2024-03-18T22:39:46.665 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:46.665 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:46.574201+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T22:39:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.667+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 msgr2=0x7f479806e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.667+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 0x7f479806e110 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f47b0009400 tx=0x7f47b0007040 comp rx=0 tx=0).stop 2024-03-18T22:39:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.667+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 msgr2=0x7f47b8200f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.667+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 0x7f47b8200f50 secure :-1 s=READY pgs=3271 cs=0 l=1 rev1=1 crypto rx=0x7f47a800c3e0 tx=0x7f47a800c8a0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 shutdown_connections 2024-03-18T22:39:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f47b8159cc0 0x7f47b815d9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f47b81598e0 0x7f47b8200f50 unknown :-1 s=CLOSED pgs=3271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f479806bc50 0x7f479806e110 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 --2- 172.21.15.152:0/4266017623 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f47b80d07f0 0x7f47b81545f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:46.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.668+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 >> 172.21.15.152:0/4266017623 conn(0x7f47b806b5e0 msgr2=0x7f47b80742d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.673+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 shutdown_connections 2024-03-18T22:39:46.674 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:46.673+0000 7f47be412640 1 -- 172.21.15.152:0/4266017623 wait complete. 2024-03-18T22:39:46.719 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:01:42.788340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:01:43.892556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T22:39:46.720 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T22:39:47.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.190+0000 7f7aad034640 1 Processor -- start 2024-03-18T22:39:47.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.193+0000 7f7aad034640 1 -- start start 2024-03-18T22:39:47.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.197+0000 7f7aad034640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7aa815b120 0x7f7aa80cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.197+0000 7f7aad034640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa80cd410 0x7f7aa80cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.197+0000 7f7aad034640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7aa80cc370 con 0x7f7aa8071d60 2024-03-18T22:39:47.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.197+0000 7f7aad034640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa80cc650 con 0x7f7aa815b120 2024-03-18T22:39:47.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.197+0000 7f7aad034640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7aa80cc930 con 0x7f7aa80cd410 2024-03-18T22:39:47.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.198+0000 7f7aa659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa80cd410 0x7f7aa80cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:47.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.198+0000 7f7aa659c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f7aa80cd410 0x7f7aa80cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:41034/0 (socket says 172.21.15.152:41034) 2024-03-18T22:39:47.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.198+0000 7f7aa659c640 1 -- 172.21.15.152:0/721990343 learned_addr learned my addr 172.21.15.152:0/721990343 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:47.199 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.198+0000 7f7aa6d9d640 1 --2- 172.21.15.152:0/721990343 >> v2:172.21.15.152:3300/0 conn(0x7f7aa815b120 0x7f7aa80cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:47.200 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.199+0000 7f7aa659c640 1 -- 172.21.15.152:0/721990343 >> v2:172.21.15.152:3300/0 conn(0x7f7aa815b120 msgr2=0x7f7aa80cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:47.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.199+0000 7f7aa659c640 1 --2- 172.21.15.152:0/721990343 >> v2:172.21.15.152:3300/0 conn(0x7f7aa815b120 0x7f7aa80cbd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:47.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.199+0000 7f7aa659c640 1 -- 172.21.15.152:0/721990343 >> v1:172.21.15.152:6789/0 conn(0x7f7aa8071d60 legacy=0x7f7aa815ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:47.202 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.199+0000 7f7aa659c640 1 -- 172.21.15.152:0/721990343 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa80ccc10 con 0x7f7aa80cd410 2024-03-18T22:39:47.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.202+0000 7f7aa659c640 1 --2- 172.21.15.152:0/721990343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa80cd410 0x7f7aa80cf590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806d1d0 tx=0x7f7a9802b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0afa37c537067db server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:47.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.203+0000 7f7aa5d9b640 1 -- 172.21.15.152:0/721990343 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9802e070 con 0x7f7aa80cd410 2024-03-18T22:39:47.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.203+0000 7f7aa5d9b640 1 -- 172.21.15.152:0/721990343 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a98037070 con 0x7f7aa80cd410 2024-03-18T22:39:47.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.203+0000 7f7aa5d9b640 1 -- 172.21.15.152:0/721990343 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a98031a00 con 0x7f7aa80cd410 2024-03-18T22:39:47.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.206+0000 7f7aad034640 1 -- 172.21.15.152:0/721990343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa80cd410 msgr2=0x7f7aa80cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:47.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.206+0000 7f7aad034640 1 --2- 172.21.15.152:0/721990343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa80cd410 0x7f7aa80cf590 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f7aa806d1d0 tx=0x7f7a9802b880 comp rx=0 tx=0).stop 2024-03-18T22:39:47.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 -- 172.21.15.152:0/721990343 shutdown_connections 2024-03-18T22:39:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 --2- 172.21.15.152:0/721990343 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa80cd410 0x7f7aa80cf590 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 --2- 172.21.15.152:0/721990343 >> v2:172.21.15.152:3300/0 conn(0x7f7aa815b120 0x7f7aa80cbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 -- 172.21.15.152:0/721990343 >> 172.21.15.152:0/721990343 conn(0x7f7aa80d0da0 msgr2=0x7f7aa80d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 -- 172.21.15.152:0/721990343 shutdown_connections 2024-03-18T22:39:47.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.207+0000 7f7aad034640 1 -- 172.21.15.152:0/721990343 wait complete. 2024-03-18T22:39:47.210 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.209+0000 7f7aad034640 1 Processor -- start 2024-03-18T22:39:47.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.210+0000 7f7aad034640 1 -- start start 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 0x7f7aa80c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 0x7f7aa81f7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa815b120 0x7f7aa81f7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa80cf1e0 con 0x7f7aa80cd410 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa80cf060 con 0x7f7aa815b120 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aad034640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7aa80cfad0 con 0x7f7aa8071d60 2024-03-18T22:39:47.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 0x7f7aa81f7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aa659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 0x7f7aa81f7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52876/0 (socket says 172.21.15.152:52876) 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aa659c640 1 -- 172.21.15.152:0/2647862178 learned_addr learned my addr 172.21.15.152:0/2647862178 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.214+0000 7f7aa6d9d640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 0x7f7aa80c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.215+0000 7f7aa6d9d640 1 -- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa815b120 msgr2=0x7f7aa81f7e50 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.215+0000 7f7aa6d9d640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa815b120 0x7f7aa81f7e50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.215+0000 7f7aa6d9d640 1 -- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 msgr2=0x7f7aa81f7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.215+0000 7f7aa6d9d640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 0x7f7aa81f7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:47.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.215+0000 7f7aa6d9d640 1 -- 172.21.15.152:0/2647862178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa81515b0 con 0x7f7aa8071d60 2024-03-18T22:39:47.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.216+0000 7f7aa6d9d640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 0x7f7aa80c7e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00d550 tx=0x7f7a9c00da10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:47.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.217+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0125f0 con 0x7f7aa8071d60 2024-03-18T22:39:47.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.218+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa8151890 con 0x7f7aa8071d60 2024-03-18T22:39:47.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.218+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa8151e50 con 0x7f7aa8071d60 2024-03-18T22:39:47.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.218+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a9c019070 con 0x7f7aa8071d60 2024-03-18T22:39:47.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.220+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0129d0 con 0x7f7aa8071d60 2024-03-18T22:39:47.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.222+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a88005290 con 0x7f7aa8071d60 2024-03-18T22:39:47.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.222+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7a9c012bb0 con 0x7f7aa8071d60 2024-03-18T22:39:47.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.223+0000 7f7a8f7fe640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 0x7f7a9406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.223+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f7a9c08acf0 con 0x7f7aa8071d60 2024-03-18T22:39:47.224 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.223+0000 7f7aa659c640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 0x7f7a9406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.226+0000 7f7aa659c640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 0x7f7a9406e160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7a9802b8c0 tx=0x7f7a9803d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:47.230 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:47.228+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f7a9c0597c0 con 0x7f7aa8071d60 2024-03-18T22:39:48.228 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.228+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f7a88005d90 con 0x7f7aa8071d60 2024-03-18T22:39:48.229 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.228+0000 7f7a8f7fe640 1 -- 172.21.15.152:0/2647862178 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7f7a9c0590c0 con 0x7f7aa8071d60 2024-03-18T22:39:48.229 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T22:39:48.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.236+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 msgr2=0x7f7a9406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.236+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 0x7f7a9406e160 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f7a9802b8c0 tx=0x7f7a9803d040 comp rx=0 tx=0).stop 2024-03-18T22:39:48.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.236+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 msgr2=0x7f7aa80c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.236+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 0x7f7aa80c7e70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00d550 tx=0x7f7a9c00da10 comp rx=0 tx=0).stop 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 shutdown_connections 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7aa815b120 0x7f7aa81f7e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7aa80cd410 0x7f7aa81f7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7a9406bca0 0x7f7a9406e160 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 --2- 172.21.15.152:0/2647862178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7aa8071d60 0x7f7aa80c7e70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.240+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 >> 172.21.15.152:0/2647862178 conn(0x7f7aa80d0da0 msgr2=0x7f7aa8072420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:48.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.242+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 shutdown_connections 2024-03-18T22:39:48.245 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.245+0000 7f7aad034640 1 -- 172.21.15.152:0/2647862178 wait complete. 2024-03-18T22:39:48.267 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T22:39:48.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.726+0000 7f74e9c23640 1 Processor -- start 2024-03-18T22:39:48.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.726+0000 7f74e9c23640 1 -- start start 2024-03-18T22:39:48.728 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.727+0000 7f74e9c23640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc055d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.727+0000 7f74e9c23640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f74dc03a0a0 0x7f74dc03a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.727+0000 7f74e9c23640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74dc050150 con 0x7f74dc0366a0 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.727+0000 7f74e9c23640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f74dc03aa10 con 0x7f74dc03a0a0 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.727+0000 7f74e9c23640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc006c30 con 0x7f74dc0df800 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e9422640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f74dc03a0a0 0x7f74dc03a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e3fff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f74dc0366a0 0x7f74dc04fa40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:55360/0 (socket says 172.21.15.152:55360) 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e3fff640 1 -- 172.21.15.152:0/3172183566 learned_addr learned my addr 172.21.15.152:0/3172183566 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e9422640 1 -- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 msgr2=0x7f74dc055d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:48.729 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e8c21640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc055d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e9422640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc055d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e9422640 1 -- 172.21.15.152:0/3172183566 >> v1:172.21.15.186:6789/0 conn(0x7f74dc0366a0 legacy=0x7f74dc04fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.730 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e9422640 1 -- 172.21.15.152:0/3172183566 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc006f10 con 0x7f74dc03a0a0 2024-03-18T22:39:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.728+0000 7f74e8c21640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc055d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T22:39:48.731 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.730+0000 7f74e9422640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc03a0a0 0x7f74dc03a4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74e4069fe0 tx=0x7f74e4069cc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5a3f491ff8b7e66b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.733+0000 7f74e37fe640 1 -- 172.21.15.152:0/3172183566 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40b4070 con 0x7f74dc03a0a0 2024-03-18T22:39:48.733 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.733+0000 7f74e37fe640 1 -- 172.21.15.152:0/3172183566 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e40af440 con 0x7f74dc03a0a0 2024-03-18T22:39:48.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.733+0000 7f74e37fe640 1 -- 172.21.15.152:0/3172183566 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e40af8d0 con 0x7f74dc03a0a0 2024-03-18T22:39:48.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.734+0000 7f74e9c23640 1 -- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc03a0a0 msgr2=0x7f74dc03a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.734+0000 7f74e9c23640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc03a0a0 0x7f74dc03a4d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f74e4069fe0 tx=0x7f74e4069cc0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 -- 172.21.15.152:0/3172183566 shutdown_connections 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc03a0a0 0x7f74dc03a4d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 --2- 172.21.15.152:0/3172183566 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc055d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 -- 172.21.15.152:0/3172183566 >> 172.21.15.152:0/3172183566 conn(0x7f74dc01e6c0 msgr2=0x7f74dc0553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 -- 172.21.15.152:0/3172183566 shutdown_connections 2024-03-18T22:39:48.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.735+0000 7f74e9c23640 1 -- 172.21.15.152:0/3172183566 wait complete. 2024-03-18T22:39:48.740 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.740+0000 7f74e9c23640 1 Processor -- start 2024-03-18T22:39:48.741 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.740+0000 7f74e9c23640 1 -- start start 2024-03-18T22:39:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.745+0000 7f74e9c23640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc0366a0 0x7f74dc049b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.745 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.745+0000 7f74e9c23640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.746 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.746+0000 7f74e3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.746+0000 7f74e3fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52890/0 (socket says 172.21.15.152:52890) 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.746+0000 7f74e3fff640 1 -- 172.21.15.152:0/247260456 learned_addr learned my addr 172.21.15.152:0/247260456 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.746+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc0e1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.747+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc0dfbe0 con 0x7f74dc03a0a0 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.747+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f74dc0074d0 con 0x7f74dc0366a0 2024-03-18T22:39:48.747 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.747+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f74dc036ae0 con 0x7f74dc0df800 2024-03-18T22:39:48.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.747+0000 7f74e8c21640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc0366a0 0x7f74dc049b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.748 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.747+0000 7f74e9422640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc0e1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.749+0000 7f74e3fff640 1 -- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 msgr2=0x7f74dc0e1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.749+0000 7f74e3fff640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc0e1230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.749+0000 7f74e3fff640 1 -- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc0366a0 msgr2=0x7f74dc049b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.749+0000 7f74e3fff640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc0366a0 0x7f74dc049b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:48.750 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.749+0000 7f74e3fff640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74dc04a680 con 0x7f74dc03a0a0 2024-03-18T22:39:48.752 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.750+0000 7f74e3fff640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c8d0 tx=0x7f74d000cd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:48.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.761+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0018070 con 0x7f74dc03a0a0 2024-03-18T22:39:48.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.761+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d00072d0 con 0x7f74dc03a0a0 2024-03-18T22:39:48.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.762+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d0007680 con 0x7f74dc03a0a0 2024-03-18T22:39:48.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.762+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74dc0e0770 con 0x7f74dc03a0a0 2024-03-18T22:39:48.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.762+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74dc0e0a30 con 0x7f74dc03a0a0 2024-03-18T22:39:48.768 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.767+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74dc0057e0 con 0x7f74dc03a0a0 2024-03-18T22:39:48.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.770+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f74d001b070 con 0x7f74dc03a0a0 2024-03-18T22:39:48.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.772+0000 7f74e17fa640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 0x7f74c806e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:48.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.772+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f74d008a010 con 0x7f74dc03a0a0 2024-03-18T22:39:48.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.773+0000 7f74e8c21640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 0x7f74c806e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:48.779 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.778+0000 7f74e8c21640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 0x7f74c806e300 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f74d800b7c0 tx=0x7f74d8008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:48.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:48.804+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f74dc04a680 con 0x7f74dc03a0a0 2024-03-18T22:39:49.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.769+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74dc0d68b0 con 0x7f74dc03a0a0 2024-03-18T22:39:49.772 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.772+0000 7f74e17fa640 1 -- 172.21.15.152:0/247260456 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7f74d0058ae0 con 0x7f74dc03a0a0 2024-03-18T22:39:49.773 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 msgr2=0x7f74c806e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 0x7f74c806e300 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f74d800b7c0 tx=0x7f74d8008040 comp rx=0 tx=0).stop 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 msgr2=0x7f74dc0d28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 secure :-1 s=READY pgs=3273 cs=0 l=1 rev1=1 crypto rx=0x7f74d000c8d0 tx=0x7f74d000cd90 comp rx=0 tx=0).stop 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 shutdown_connections 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f74c806be40 0x7f74c806e300 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f74dc0df800 0x7f74dc0e1230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:49.780 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f74dc03a0a0 0x7f74dc0d28f0 unknown :-1 s=CLOSED pgs=3273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 --2- 172.21.15.152:0/247260456 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f74dc0366a0 0x7f74dc049b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.779+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 >> 172.21.15.152:0/247260456 conn(0x7f74dc01e6c0 msgr2=0x7f74dc0078f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.780+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 shutdown_connections 2024-03-18T22:39:49.781 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:49.780+0000 7f74e9c23640 1 -- 172.21.15.152:0/247260456 wait complete. 2024-03-18T22:39:49.814 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T22:39:50.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.247+0000 7f7172d5e640 1 Processor -- start 2024-03-18T22:39:50.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.248+0000 7f7172d5e640 1 -- start start 2024-03-18T22:39:50.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f716403ad50 0x7f7164053400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f7164050090 0x7f7164050520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f7164053c30 con 0x7f7164050090 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f7164053f10 con 0x7f716403ad50 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7172d5e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f71640541f0 con 0x7f71640df6f0 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7171d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7171d5c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43580/0 (socket says 172.21.15.152:43580) 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f7171d5c640 1 -- 172.21.15.152:0/3329060634 learned_addr learned my addr 172.21.15.152:0/3329060634 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.252+0000 7f717255d640 1 --2- 172.21.15.152:0/3329060634 >> v2:172.21.15.152:3300/0 conn(0x7f7164050090 0x7f7164050520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:50.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.253+0000 7f7171d5c640 1 -- 172.21.15.152:0/3329060634 >> v2:172.21.15.186:3300/0 conn(0x7f716403ad50 msgr2=0x7f7164053400 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:39:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.253+0000 7f7171d5c640 1 --2- 172.21.15.152:0/3329060634 >> v2:172.21.15.186:3300/0 conn(0x7f716403ad50 0x7f7164053400 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.253+0000 7f7171d5c640 1 -- 172.21.15.152:0/3329060634 >> v2:172.21.15.152:3300/0 conn(0x7f7164050090 msgr2=0x7f7164050520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.253+0000 7f7171d5c640 1 --2- 172.21.15.152:0/3329060634 >> v2:172.21.15.152:3300/0 conn(0x7f7164050090 0x7f7164050520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.253+0000 7f7171d5c640 1 -- 172.21.15.152:0/3329060634 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71640544d0 con 0x7f71640df6f0 2024-03-18T22:39:50.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.254+0000 7f7171d5c640 1 --2- 172.21.15.152:0/3329060634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7164008e30 tx=0x7f715c02de30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e011e95fef9d0c14 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:50.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.254+0000 7f7170d5a640 1 -- 172.21.15.152:0/3329060634 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c034070 con 0x7f71640df6f0 2024-03-18T22:39:50.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.254+0000 7f7170d5a640 1 -- 172.21.15.152:0/3329060634 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f715c02ebe0 con 0x7f71640df6f0 2024-03-18T22:39:50.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.255+0000 7f7170d5a640 1 -- 172.21.15.152:0/3329060634 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f715c038400 con 0x7f71640df6f0 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/3329060634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 msgr2=0x7f7164054cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/3329060634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7164008e30 tx=0x7f715c02de30 comp rx=0 tx=0).stop 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 -- 172.21.15.152:0/3329060634 shutdown_connections 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 --2- 172.21.15.152:0/3329060634 >> v2:172.21.15.152:3300/0 conn(0x7f7164050090 0x7f7164050520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 --2- 172.21.15.152:0/3329060634 >> v2:172.21.15.186:3300/0 conn(0x7f716403ad50 0x7f7164053400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 --2- 172.21.15.152:0/3329060634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f71640df6f0 0x7f7164054cd0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 -- 172.21.15.152:0/3329060634 >> 172.21.15.152:0/3329060634 conn(0x7f7164055350 msgr2=0x7f7164055760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:50.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 -- 172.21.15.152:0/3329060634 shutdown_connections 2024-03-18T22:39:50.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.257+0000 7f7172d5e640 1 -- 172.21.15.152:0/3329060634 wait complete. 2024-03-18T22:39:50.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.263+0000 7f7172d5e640 1 Processor -- start 2024-03-18T22:39:50.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.263+0000 7f7172d5e640 1 -- start start 2024-03-18T22:39:50.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 0x7f7164178790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71640df6f0 0x7f71640d5800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f71640384f0 con 0x7f716403ad50 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7164053940 con 0x7f71640df6f0 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f7172d5e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7164038670 con 0x7f7164050090 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.270+0000 7f717155b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43594/0 (socket says 172.21.15.152:43594) 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 -- 172.21.15.152:0/911421969 learned_addr learned my addr 172.21.15.152:0/911421969 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f7171d5c640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 0x7f7164178790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 -- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71640df6f0 msgr2=0x7f71640d5800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71640df6f0 0x7f71640d5800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 -- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 msgr2=0x7f7164178790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:50.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 0x7f7164178790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f717155b640 1 -- 172.21.15.152:0/911421969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71640dfad0 con 0x7f7164050090 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.271+0000 7f7171d5c640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 0x7f7164178790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.272+0000 7f717155b640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f716800b470 tx=0x7f716800b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.272+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168015020 con 0x7f7164050090 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.272+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7168011890 con 0x7f7164050090 2024-03-18T22:39:50.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.272+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7168011c40 con 0x7f7164050090 2024-03-18T22:39:50.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.273+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71640dfdb0 con 0x7f7164050090 2024-03-18T22:39:50.275 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.273+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f71640e0370 con 0x7f7164050090 2024-03-18T22:39:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.275+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7168018020 con 0x7f7164050090 2024-03-18T22:39:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.277+0000 7f71627fc640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 0x7f715006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:50.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.277+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f716808ac40 con 0x7f7164050090 2024-03-18T22:39:50.280 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.280+0000 7f7171d5c640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 0x7f715006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:50.282 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.282+0000 7f7171d5c640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 0x7f715006e160 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f715c039000 tx=0x7f715c034000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:50.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.283+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71640057e0 con 0x7f7164050090 2024-03-18T22:39:50.290 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:50.289+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f716801f020 con 0x7f7164050090 2024-03-18T22:39:51.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.252+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f716404aa70 con 0x7f7164050090 2024-03-18T22:39:51.253 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.253+0000 7f71627fc640 1 -- 172.21.15.152:0/911421969 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7f716800d040 con 0x7f7164050090 2024-03-18T22:39:51.254 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.255+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 msgr2=0x7f715006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.255+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 0x7f715006e160 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f715c039000 tx=0x7f715c034000 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 msgr2=0x7f71640074f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f716800b470 tx=0x7f716800b930 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 shutdown_connections 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f71640df6f0 0x7f71640d5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f715006bca0 0x7f715006e160 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7164050090 0x7f71640074f0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 --2- 172.21.15.152:0/911421969 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f716403ad50 0x7f7164178790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 >> 172.21.15.152:0/911421969 conn(0x7f7164055350 msgr2=0x7f7164048e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:51.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 shutdown_connections 2024-03-18T22:39:51.258 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.256+0000 7f7172d5e640 1 -- 172.21.15.152:0/911421969 wait complete. 2024-03-18T22:39:51.290 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-18T22:39:51.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.646+0000 7fdf1c681640 1 Processor -- start 2024-03-18T22:39:51.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.647+0000 7fdf1c681640 1 -- start start 2024-03-18T22:39:51.648 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1c681640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1415f230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1c681640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf140b3c70 0x7fdf1406b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1c681640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdf1415f770 con 0x7fdf14067270 2024-03-18T22:39:51.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1c681640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fdf1406e4d0 con 0x7fdf140b3c70 2024-03-18T22:39:51.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1c681640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1406d8c0 con 0x7fdf14158a00 2024-03-18T22:39:51.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.648+0000 7fdf1ac1e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf140b3c70 0x7fdf1406b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdf140b3c70 0x7fdf1406b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:38664/0 (socket says 172.21.15.152:38664) 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 -- 172.21.15.152:0/4057533732 learned_addr learned my addr 172.21.15.152:0/4057533732 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 -- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 msgr2=0x7fdf1415f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 --2- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1415f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 -- 172.21.15.152:0/4057533732 >> v1:172.21.15.186:6789/0 conn(0x7fdf14067270 legacy=0x7fdf140b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:51.650 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.649+0000 7fdf1ac1e640 1 -- 172.21.15.152:0/4057533732 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf1406dba0 con 0x7fdf140b3c70 2024-03-18T22:39:51.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.651+0000 7fdf1ac1e640 1 --2- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf1406b1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e50 tx=0x7fdf0c02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad7c8c9ae1f6b4f3 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:51.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.652+0000 7fdf1941b640 1 -- 172.21.15.152:0/4057533732 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c02c9e0 con 0x7fdf140b3c70 2024-03-18T22:39:51.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.652+0000 7fdf1941b640 1 -- 172.21.15.152:0/4057533732 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf0c02cb80 con 0x7fdf140b3c70 2024-03-18T22:39:51.652 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.652+0000 7fdf1941b640 1 -- 172.21.15.152:0/4057533732 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf0c0343f0 con 0x7fdf140b3c70 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.652+0000 7fdf1c681640 1 -- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 msgr2=0x7fdf1406b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.652+0000 7fdf1c681640 1 --2- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf1406b1c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdf0c009e50 tx=0x7fdf0c02be40 comp rx=0 tx=0).stop 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 -- 172.21.15.152:0/4057533732 shutdown_connections 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 --2- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf1406b1c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 --2- 172.21.15.152:0/4057533732 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1415f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 -- 172.21.15.152:0/4057533732 >> 172.21.15.152:0/4057533732 conn(0x7fdf140d04d0 msgr2=0x7fdf140d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:51.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 -- 172.21.15.152:0/4057533732 shutdown_connections 2024-03-18T22:39:51.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.653+0000 7fdf1c681640 1 -- 172.21.15.152:0/4057533732 wait complete. 2024-03-18T22:39:51.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.654+0000 7fdf1c681640 1 Processor -- start 2024-03-18T22:39:51.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.655+0000 7fdf1c681640 1 -- start start 2024-03-18T22:39:51.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.656+0000 7fdf1c681640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.656+0000 7fdf1a41d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:51.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1c681640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf141e6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1c681640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1413fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1a41d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52928/0 (socket says 172.21.15.152:52928) 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1c681640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1406b700 con 0x7fdf14067270 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1a41d640 1 -- 172.21.15.152:0/1231403761 learned_addr learned my addr 172.21.15.152:0/1231403761 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1c681640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdf1406e160 con 0x7fdf140b3c70 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1c681640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdf1406b880 con 0x7fdf14158a00 2024-03-18T22:39:51.658 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.657+0000 7fdf1ac1e640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1413fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1a41d640 1 -- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 msgr2=0x7fdf1413fce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1a41d640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1413fce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1a41d640 1 -- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 msgr2=0x7fdf141e6df0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1a41d640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf141e6df0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1a41d640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf14157600 con 0x7fdf14067270 2024-03-18T22:39:51.659 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.658+0000 7fdf1ac1e640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:39:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.659+0000 7fdf1a41d640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b440 tx=0x7fdf1000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:51.660 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.660+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10015020 con 0x7fdf14067270 2024-03-18T22:39:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.660+0000 7fdf1c681640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf1413dcf0 con 0x7fdf14067270 2024-03-18T22:39:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.660+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdf10011890 con 0x7fdf14067270 2024-03-18T22:39:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.660+0000 7fdf1c681640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf1413e2b0 con 0x7fdf14067270 2024-03-18T22:39:51.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.660+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf10011c40 con 0x7fdf14067270 2024-03-18T22:39:51.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.664+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdf10018020 con 0x7fdf14067270 2024-03-18T22:39:51.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.664+0000 7fdf0affd640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 0x7fdef806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:51.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.664+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fdf1008a8a0 con 0x7fdf14067270 2024-03-18T22:39:51.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.665+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdefc005290 con 0x7fdf14067270 2024-03-18T22:39:51.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.667+0000 7fdf19c1c640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 0x7fdef806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:51.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.668+0000 7fdf19c1c640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 0x7fdef806e090 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdf141f7330 tx=0x7fdf040079b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:51.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:51.693+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdf1001f030 con 0x7fdf14067270 2024-03-18T22:39:52.722 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.721+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdefc005580 con 0x7fdf14067270 2024-03-18T22:39:52.723 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.723+0000 7fdf0affd640 1 -- 172.21.15.152:0/1231403761 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) ==== 80+0+0 (secure 0 0 0) 0x7fdf1000d040 con 0x7fdf14067270 2024-03-18T22:39:52.723 INFO:teuthology.orchestra.run.smithi152.stderr:listed 0 entries 2024-03-18T22:39:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 msgr2=0x7fdef806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 0x7fdef806e090 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fdf141f7330 tx=0x7fdf040079b0 comp rx=0 tx=0).stop 2024-03-18T22:39:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 msgr2=0x7fdf141e68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:52.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 secure :-1 s=READY pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b440 tx=0x7fdf1000b900 comp rx=0 tx=0).stop 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 shutdown_connections 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdef806bbd0 0x7fdef806e090 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdf14158a00 0x7fdf1413fce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdf140b3c70 0x7fdf141e6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 --2- 172.21.15.152:0/1231403761 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdf14067270 0x7fdf141e68b0 secure :-1 s=CLOSED pgs=3274 cs=0 l=1 rev1=1 crypto rx=0x7fdf1000b440 tx=0x7fdf1000b900 comp rx=0 tx=0).stop 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.733+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 >> 172.21.15.152:0/1231403761 conn(0x7fdf140d04d0 msgr2=0x7fdf140716e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.734+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 shutdown_connections 2024-03-18T22:39:52.735 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:52.734+0000 7fdf08ff9640 1 -- 172.21.15.152:0/1231403761 wait complete. 2024-03-18T22:39:52.772 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-03-18T22:39:52.772 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:39:52.772 DEBUG:teuthology.orchestra.run.smithi152:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-03-18T22:39:52.888 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T22:39:52.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:39:52.888 DEBUG:teuthology.orchestra.run.smithi152:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-03-18T22:39:52.946 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T22:39:52.947 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T22:39:52.947 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:39:52.997 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T22:39:52.997 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T22:39:52.997 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T22:39:52.997 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:39:53.036 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056372,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19578 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T22:39:53.037 INFO:tasks.cephfs.mount:Terminating background process 2024-03-18T22:39:53.037 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T22:39:53.037 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:39:53.053 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T22:39:53.053 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T22:39:53.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.434+0000 7fba95590640 1 Processor -- start 2024-03-18T22:39:53.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.435+0000 7fba95590640 1 -- start start 2024-03-18T22:39:53.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.436+0000 7fba95590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 0x7fba9016d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:53.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.436+0000 7fba95590640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba90073510 con 0x7fba90165c80 2024-03-18T22:39:53.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.436+0000 7fba95590640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fba90166060 con 0x7fba90073080 2024-03-18T22:39:53.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.436+0000 7fba95590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fba900acfb0 con 0x7fba900ae450 2024-03-18T22:39:53.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8e7fc640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fba90073080 0x7fba901669e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:53414/0 (socket says 172.21.15.152:53414) 2024-03-18T22:39:53.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8e7fc640 1 -- 172.21.15.152:0/616758581 learned_addr learned my addr 172.21.15.152:0/616758581 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:39:53.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8f7fe640 1 --2- 172.21.15.152:0/616758581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 0x7fba9016d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:53.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4014504215 0 0) 0x7fba90166060 con 0x7fba90073080 2024-03-18T22:39:53.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba7c003520 con 0x7fba90073080 2024-03-18T22:39:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 891790354 0 0) 0x7fba880013c0 con 0x7fba90165c80 2024-03-18T22:39:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.437+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fba90166060 con 0x7fba90165c80 2024-03-18T22:39:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.438+0000 7fba8f7fe640 1 -- 172.21.15.152:0/616758581 >> v1:172.21.15.186:6789/0 conn(0x7fba90073080 legacy=0x7fba901669e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.438+0000 7fba8f7fe640 1 -- 172.21.15.152:0/616758581 >> v1:172.21.15.152:6789/0 conn(0x7fba90165c80 legacy=0x7fba901662d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.438+0000 7fba8f7fe640 1 -- 172.21.15.152:0/616758581 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba9006e1e0 con 0x7fba900ae450 2024-03-18T22:39:53.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.441+0000 7fba8f7fe640 1 --2- 172.21.15.152:0/616758581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 0x7fba9016d660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba900ad130 tx=0x7fba8002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d39c38199be0ad6b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:53.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.441+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80035020 con 0x7fba900ae450 2024-03-18T22:39:53.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.441+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba80031810 con 0x7fba900ae450 2024-03-18T22:39:53.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.441+0000 7fba8dffb640 1 -- 172.21.15.152:0/616758581 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80031be0 con 0x7fba900ae450 2024-03-18T22:39:53.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.443+0000 7fba95590640 1 -- 172.21.15.152:0/616758581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 msgr2=0x7fba9016d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.443+0000 7fba95590640 1 --2- 172.21.15.152:0/616758581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 0x7fba9016d660 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fba900ad130 tx=0x7fba8002b8b0 comp rx=0 tx=0).stop 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.444+0000 7fba95590640 1 -- 172.21.15.152:0/616758581 shutdown_connections 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.444+0000 7fba95590640 1 --2- 172.21.15.152:0/616758581 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba900ae450 0x7fba9016d660 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.444+0000 7fba95590640 1 -- 172.21.15.152:0/616758581 >> 172.21.15.152:0/616758581 conn(0x7fba900b1cd0 msgr2=0x7fba900b20e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.445+0000 7fba95590640 1 -- 172.21.15.152:0/616758581 shutdown_connections 2024-03-18T22:39:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.445+0000 7fba95590640 1 -- 172.21.15.152:0/616758581 wait complete. 2024-03-18T22:39:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.450+0000 7fba95590640 1 Processor -- start 2024-03-18T22:39:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.452+0000 7fba95590640 1 -- start start 2024-03-18T22:39:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 0x7fba901fc970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:53.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 0x7fba900cf3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fba9006e760 con 0x7fba90165c80 2024-03-18T22:39:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fba9006e480 con 0x7fba900ae450 2024-03-18T22:39:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba95590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fba9006ea40 con 0x7fba90073080 2024-03-18T22:39:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.453+0000 7fba8f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:53.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.454+0000 7fba8f7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52932/0 (socket says 172.21.15.152:52932) 2024-03-18T22:39:53.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.454+0000 7fba8f7fe640 1 -- 172.21.15.152:0/3821285170 learned_addr learned my addr 172.21.15.152:0/3821285170 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:53.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.454+0000 7fba8e7fc640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 0x7fba900cf3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:53.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.455+0000 7fba8f7fe640 1 -- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 msgr2=0x7fba901fc970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:53.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.455+0000 7fba8effd640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 0x7fba901fc970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.456+0000 7fba8f7fe640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 0x7fba901fc970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.456+0000 7fba8f7fe640 1 -- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 msgr2=0x7fba900cf3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.456+0000 7fba8f7fe640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 0x7fba900cf3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.456+0000 7fba8f7fe640 1 -- 172.21.15.152:0/3821285170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba900cf920 con 0x7fba90165c80 2024-03-18T22:39:53.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.458+0000 7fba8f7fe640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7fba8002bec0 tx=0x7fba800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.458+0000 7fba8effd640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 0x7fba901fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T22:39:53.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.458+0000 7fba8e7fc640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 0x7fba900cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:39:53.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.462+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80035040 con 0x7fba90165c80 2024-03-18T22:39:53.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.462+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba900ce000 con 0x7fba90165c80 2024-03-18T22:39:53.462 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.462+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba90163a20 con 0x7fba90165c80 2024-03-18T22:39:53.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.466+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fba8003ae00 con 0x7fba90165c80 2024-03-18T22:39:53.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.469+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba80046680 con 0x7fba90165c80 2024-03-18T22:39:53.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.469+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba74005290 con 0x7fba90165c80 2024-03-18T22:39:53.476 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.476+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fba80038020 con 0x7fba90165c80 2024-03-18T22:39:53.478 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.478+0000 7fba877fe640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 0x7fba7006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:53.479 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.479+0000 7fba8effd640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 0x7fba7006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:53.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.482+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fba800acdd0 con 0x7fba90165c80 2024-03-18T22:39:53.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.488+0000 7fba8effd640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 0x7fba7006e160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fba90165440 tx=0x7fba88009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:53.500 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:53.499+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fba8007b930 con 0x7fba90165c80 2024-03-18T22:39:54.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.698+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fba74005580 con 0x7fba90165c80 2024-03-18T22:39:54.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.701+0000 7fba877fe640 1 -- 172.21.15.152:0/3821285170 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7fba8007b230 con 0x7fba90165c80 2024-03-18T22:39:54.708 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:54.708 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T22:39:54.709 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T22:39:54.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 msgr2=0x7fba7006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:54.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 0x7fba7006e160 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fba90165440 tx=0x7fba88009040 comp rx=0 tx=0).stop 2024-03-18T22:39:54.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 msgr2=0x7fba90159b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:54.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 secure :-1 s=READY pgs=3276 cs=0 l=1 rev1=1 crypto rx=0x7fba8002bec0 tx=0x7fba800046c0 comp rx=0 tx=0).stop 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 shutdown_connections 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fba90165c80 0x7fba90159b70 unknown :-1 s=CLOSED pgs=3276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fba900ae450 0x7fba900cf3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fba7006bca0 0x7fba7006e160 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 --2- 172.21.15.152:0/3821285170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fba90073080 0x7fba901fc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:54.720 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.718+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 >> 172.21.15.152:0/3821285170 conn(0x7fba900b1cd0 msgr2=0x7fba900ad440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:54.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.720+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 shutdown_connections 2024-03-18T22:39:54.721 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:54.720+0000 7fba95590640 1 -- 172.21.15.152:0/3821285170 wait complete. 2024-03-18T22:39:54.764 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T22:39:55.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.161+0000 7fcb2fd4c640 1 Processor -- start 2024-03-18T22:39:55.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.162+0000 7fcb2fd4c640 1 -- start start 2024-03-18T22:39:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.166+0000 7fcb2fd4c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcb2806b1c0 0x7fcb2815f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.167+0000 7fcb2fd4c640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb280b5cd0 con 0x7fcb2806f700 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.167+0000 7fcb2fd4c640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcb2815e890 con 0x7fcb280b57f0 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.167+0000 7fcb2fd4c640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fcb280b40b0 con 0x7fcb2806b1c0 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.168+0000 7fcb2e2e9640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fcb2806f700 0x7fcb2806dc50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38640/0 (socket says 172.21.15.152:38640) 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.168+0000 7fcb2e2e9640 1 -- 172.21.15.152:0/715846950 learned_addr learned my addr 172.21.15.152:0/715846950 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.168+0000 7fcb2d2e7640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fcb280b57f0 0x7fcb2806b5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:53428/0 (socket says 172.21.15.152:53428) 2024-03-18T22:39:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.169+0000 7fcb2dae8640 1 --2- 172.21.15.152:0/715846950 >> v2:172.21.15.152:3300/0 conn(0x7fcb2806b1c0 0x7fcb2815f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.170+0000 7fcb2dae8640 1 -- 172.21.15.152:0/715846950 >> v1:172.21.15.186:6789/0 conn(0x7fcb280b57f0 legacy=0x7fcb2806b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.170+0000 7fcb2dae8640 1 -- 172.21.15.152:0/715846950 >> v1:172.21.15.152:6789/0 conn(0x7fcb2806f700 legacy=0x7fcb2806dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.170+0000 7fcb2dae8640 1 -- 172.21.15.152:0/715846950 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb2815eb70 con 0x7fcb2806b1c0 2024-03-18T22:39:55.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.173+0000 7fcb2dae8640 1 --2- 172.21.15.152:0/715846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806b1c0 0x7fcb2815f370 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7fcb240097a0 tx=0x7fcb2402b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e142525a8d53d6db server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.173+0000 7fcb2cae6640 1 -- 172.21.15.152:0/715846950 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24037070 con 0x7fcb2806b1c0 2024-03-18T22:39:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.174+0000 7fcb2cae6640 1 -- 172.21.15.152:0/715846950 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb24030710 con 0x7fcb2806b1c0 2024-03-18T22:39:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.174+0000 7fcb2cae6640 1 -- 172.21.15.152:0/715846950 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb24030ae0 con 0x7fcb2806b1c0 2024-03-18T22:39:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.179+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/715846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806b1c0 msgr2=0x7fcb2815f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.179+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/715846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806b1c0 0x7fcb2815f370 secure :-1 s=READY pgs=3278 cs=0 l=1 rev1=1 crypto rx=0x7fcb240097a0 tx=0x7fcb2402b790 comp rx=0 tx=0).stop 2024-03-18T22:39:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.180+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/715846950 shutdown_connections 2024-03-18T22:39:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.180+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/715846950 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806b1c0 0x7fcb2815f370 unknown :-1 s=CLOSED pgs=3278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.180+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/715846950 >> 172.21.15.152:0/715846950 conn(0x7fcb280b2a40 msgr2=0x7fcb280b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.184+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/715846950 shutdown_connections 2024-03-18T22:39:55.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.184+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/715846950 wait complete. 2024-03-18T22:39:55.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.186+0000 7fcb2fd4c640 1 Processor -- start 2024-03-18T22:39:55.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.186+0000 7fcb2fd4c640 1 -- start start 2024-03-18T22:39:55.187 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 0x7fcb281514a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 0x7fcb2815fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 0x7fcb28155480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcb2815e450 con 0x7fcb2806f700 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcb280b5fb0 con 0x7fcb280b57f0 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2fd4c640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcb2815e5d0 con 0x7fcb2806b1c0 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2dae8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 0x7fcb281514a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2e2e9640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 0x7fcb28155480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2dae8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 0x7fcb281514a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:60736/0 (socket says 172.21.15.152:60736) 2024-03-18T22:39:55.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2dae8640 1 -- 172.21.15.152:0/2927289768 learned_addr learned my addr 172.21.15.152:0/2927289768 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.187+0000 7fcb2e2e9640 1 -- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 msgr2=0x7fcb281514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2e2e9640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 0x7fcb281514a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2e2e9640 1 -- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 msgr2=0x7fcb2815fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2d2e7640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 0x7fcb2815fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2e2e9640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 0x7fcb2815fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2e2e9640 1 -- 172.21.15.152:0/2927289768 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb28160680 con 0x7fcb280b57f0 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2d2e7640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 0x7fcb2815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb2e2e9640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 0x7fcb28155480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c8c0 tx=0x7fcb2000cd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.188+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb20018070 con 0x7fcb280b57f0 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.189+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcb2000a640 con 0x7fcb280b57f0 2024-03-18T22:39:55.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.189+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000aa10 con 0x7fcb280b57f0 2024-03-18T22:39:55.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.189+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb28160960 con 0x7fcb280b57f0 2024-03-18T22:39:55.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.189+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb28160f20 con 0x7fcb280b57f0 2024-03-18T22:39:55.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.191+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fcb2000abb0 con 0x7fcb280b57f0 2024-03-18T22:39:55.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.192+0000 7fcb1e7fc640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 0x7fcb0c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:55.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.192+0000 7fcb2dae8640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 0x7fcb0c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:55.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.192+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fcb2008a1a0 con 0x7fcb280b57f0 2024-03-18T22:39:55.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.193+0000 7fcb2dae8640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 0x7fcb0c06e090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcb28151bc0 tx=0x7fcb2402f000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:55.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.195+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb2804f5b0 con 0x7fcb280b57f0 2024-03-18T22:39:55.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.205+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fcb200585a0 con 0x7fcb280b57f0 2024-03-18T22:39:55.605 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.604+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb280b4500 con 0x7fcb280b57f0 2024-03-18T22:39:55.623 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.623+0000 7fcb1e7fc640 1 -- 172.21.15.152:0/2927289768 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7fcb2005c640 con 0x7fcb280b57f0 2024-03-18T22:39:55.624 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:39:55.624 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:46.574201+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 msgr2=0x7fcb0c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 0x7fcb0c06e090 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fcb28151bc0 tx=0x7fcb2402f000 comp rx=0 tx=0).stop 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 msgr2=0x7fcb28155480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 0x7fcb28155480 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c8c0 tx=0x7fcb2000cd80 comp rx=0 tx=0).stop 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 shutdown_connections 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcb280b57f0 0x7fcb28155480 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcb2806f700 0x7fcb2815fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcb0c06bbd0 0x7fcb0c06e090 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 --2- 172.21.15.152:0/2927289768 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcb2806b1c0 0x7fcb281514a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.628+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 >> 172.21.15.152:0/2927289768 conn(0x7fcb280b2a40 msgr2=0x7fcb2815c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.629+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 shutdown_connections 2024-03-18T22:39:55.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:55.629+0000 7fcb2fd4c640 1 -- 172.21.15.152:0/2927289768 wait complete. 2024-03-18T22:39:55.665 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-18T15:00:35.846259+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2024-03-18T15:01:42.788340+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '34', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2024-03-18T15:01:43.892556+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '35', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-18T22:39:55.665 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-18T22:39:56.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.000+0000 7fbad59ef640 1 Processor -- start 2024-03-18T22:39:56.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.000+0000 7fbad59ef640 1 -- start start 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.001+0000 7fbad59ef640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.001+0000 7fbad59ef640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 0x7fbad00cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.001+0000 7fbad59ef640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbad00cc370 con 0x7fbad0071d60 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.001+0000 7fbad59ef640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fbad00cc650 con 0x7fbad00cd410 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.001+0000 7fbad59ef640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbad00cc930 con 0x7fbad015b120 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.002+0000 7fbace7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 0x7fbad00cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.002+0000 7fbace7fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 0x7fbad00cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52954/0 (socket says 172.21.15.152:52954) 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.002+0000 7fbace7fc640 1 -- 172.21.15.152:0/2539767021 learned_addr learned my addr 172.21.15.152:0/2539767021 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:56.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.002+0000 7fbaceffd640 1 --2- 172.21.15.152:0/2539767021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.003+0000 7fbaceffd640 1 -- 172.21.15.152:0/2539767021 >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 msgr2=0x7fbad00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:56.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.003+0000 7fbaceffd640 1 --2- 172.21.15.152:0/2539767021 >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 0x7fbad00cf590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.003+0000 7fbaceffd640 1 -- 172.21.15.152:0/2539767021 >> v1:172.21.15.152:6789/0 conn(0x7fbad0071d60 legacy=0x7fbad015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.004 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.003+0000 7fbaceffd640 1 -- 172.21.15.152:0/2539767021 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad00ccc10 con 0x7fbad015b120 2024-03-18T22:39:56.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.004+0000 7fbaceffd640 1 --2- 172.21.15.152:0/2539767021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00cbd00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009d90 tx=0x7fbac802e030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d979ba64279a20c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.005+0000 7fbacdffb640 1 -- 172.21.15.152:0/2539767021 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac803b070 con 0x7fbad015b120 2024-03-18T22:39:56.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.005+0000 7fbacdffb640 1 -- 172.21.15.152:0/2539767021 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac802ede0 con 0x7fbad015b120 2024-03-18T22:39:56.005 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.005+0000 7fbacdffb640 1 -- 172.21.15.152:0/2539767021 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac8036660 con 0x7fbad015b120 2024-03-18T22:39:56.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 -- 172.21.15.152:0/2539767021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 msgr2=0x7fbad00cbd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.006 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 --2- 172.21.15.152:0/2539767021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00cbd00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fbac8009d90 tx=0x7fbac802e030 comp rx=0 tx=0).stop 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 -- 172.21.15.152:0/2539767021 shutdown_connections 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 --2- 172.21.15.152:0/2539767021 >> v2:172.21.15.152:3300/0 conn(0x7fbad00cd410 0x7fbad00cf590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 --2- 172.21.15.152:0/2539767021 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00cbd00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 -- 172.21.15.152:0/2539767021 >> 172.21.15.152:0/2539767021 conn(0x7fbad00d0da0 msgr2=0x7fbad00d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 -- 172.21.15.152:0/2539767021 shutdown_connections 2024-03-18T22:39:56.007 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.006+0000 7fbad59ef640 1 -- 172.21.15.152:0/2539767021 wait complete. 2024-03-18T22:39:56.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.011+0000 7fbad59ef640 1 Processor -- start 2024-03-18T22:39:56.012 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.012+0000 7fbad59ef640 1 -- start start 2024-03-18T22:39:56.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.016+0000 7fbad59ef640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad0071d60 0x7fbad00b6600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.016 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.016+0000 7fbad59ef640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 0x7fbad0146a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.016+0000 7fbad59ef640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.017 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbad59ef640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00cf1e0 con 0x7fbad00cd410 2024-03-18T22:39:56.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbacf7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbacf7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:60752/0 (socket says 172.21.15.152:60752) 2024-03-18T22:39:56.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbacf7fe640 1 -- 172.21.15.152:0/3488695025 learned_addr learned my addr 172.21.15.152:0/3488695025 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:56.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fbad00cf060 con 0x7fbad0071d60 2024-03-18T22:39:56.018 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.017+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fbad00cfad0 con 0x7fbad015b120 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.018+0000 7fbace7fc640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 0x7fbad0146a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 -- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 msgr2=0x7fbad00b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 -- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad0071d60 msgr2=0x7fbad00b6600 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad0071d60 0x7fbad00b6600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbad00b5840 con 0x7fbad00cd410 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbace7fc640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 0x7fbad0146a30 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 crypto rx=0x7fbac000e820 tx=0x7fbac000ece0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac0017070 con 0x7fbad00cd410 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbac000c940 con 0x7fbad00cd410 2024-03-18T22:39:56.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.019+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbac000ccf0 con 0x7fbad00cd410 2024-03-18T22:39:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.021+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbad00b5b20 con 0x7fbad00cd410 2024-03-18T22:39:56.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.021+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbad00b60e0 con 0x7fbad00cd410 2024-03-18T22:39:56.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.026+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fbac001a070 con 0x7fbad00cd410 2024-03-18T22:39:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.027+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbad004f540 con 0x7fbad00cd410 2024-03-18T22:39:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.027+0000 7fbab7fff640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 0x7fbabc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.028 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.028+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fbac008ae50 con 0x7fbad00cd410 2024-03-18T22:39:56.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.028+0000 7fbaceffd640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 0x7fbabc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.032 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.032+0000 7fbaceffd640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 0x7fbabc06e090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbac8038000 tx=0x7fbac8032000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.045 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.045+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fbac00598a0 con 0x7fbad00cd410 2024-03-18T22:39:56.356 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.355+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbad00b24e0 con 0x7fbad00cd410 2024-03-18T22:39:56.357 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.357+0000 7fbab7fff640 1 -- 172.21.15.152:0/3488695025 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) ==== 93+0+10 (secure 0 0 0) 0x7fbac00591a0 con 0x7fbad00cd410 2024-03-18T22:39:56.360 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 1 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 msgr2=0x7fbabc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 0x7fbabc06e090 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fbac8038000 tx=0x7fbac8032000 comp rx=0 tx=0).stop 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 msgr2=0x7fbad0146a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 0x7fbad0146a30 secure :-1 s=READY pgs=3280 cs=0 l=1 rev1=1 crypto rx=0x7fbac000e820 tx=0x7fbac000ece0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 shutdown_connections 2024-03-18T22:39:56.361 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fbabc06bbd0 0x7fbabc06e090 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fbad015b120 0x7fbad00b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fbad00cd410 0x7fbad0146a30 unknown :-1 s=CLOSED pgs=3280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 --2- 172.21.15.152:0/3488695025 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fbad0071d60 0x7fbad00b6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.360+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 >> 172.21.15.152:0/3488695025 conn(0x7fbad00d0da0 msgr2=0x7fbad006f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.361+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 shutdown_connections 2024-03-18T22:39:56.362 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.361+0000 7fbad59ef640 1 -- 172.21.15.152:0/3488695025 wait complete. 2024-03-18T22:39:56.388 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-03-18T22:39:56.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.792+0000 7f4fe8d1d640 1 Processor -- start 2024-03-18T22:39:56.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.792+0000 7f4fe8d1d640 1 -- start start 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe8d1d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4fe414bdf0 0x7f4fe4071790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe8d1d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe8d1d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4fe414c1d0 con 0x7f4fe40ca240 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe8d1d640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe4071cd0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe8d1d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f4fe4071f00 con 0x7f4fe414bdf0 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe2d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe259c640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f4fe414bdf0 0x7f4fe4071790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe2d9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52968/0 (socket says 172.21.15.152:52968) 2024-03-18T22:39:56.796 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.795+0000 7f4fe2d9d640 1 -- 172.21.15.152:0/4114249365 learned_addr learned my addr 172.21.15.152:0/4114249365 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.796+0000 7f4fe2d9d640 1 -- 172.21.15.152:0/4114249365 >> v2:172.21.15.186:3300/0 conn(0x7f4fe414bdf0 msgr2=0x7f4fe4071790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.796+0000 7f4fe2d9d640 1 --2- 172.21.15.152:0/4114249365 >> v2:172.21.15.186:3300/0 conn(0x7f4fe414bdf0 0x7f4fe4071790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.796+0000 7f4fe2d9d640 1 -- 172.21.15.152:0/4114249365 >> v1:172.21.15.152:6789/0 conn(0x7f4fe40ca240 legacy=0x7f4fe40c4b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:56.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.796+0000 7f4fe2d9d640 1 -- 172.21.15.152:0/4114249365 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe40721e0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.797+0000 7f4fe2d9d640 1 --2- 172.21.15.152:0/4114249365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40739e0 tx=0x7f4fdc02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70ec956f34dcbb29 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.797+0000 7f4fe1d9b640 1 -- 172.21.15.152:0/4114249365 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc02c9f0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.797+0000 7f4fe1d9b640 1 -- 172.21.15.152:0/4114249365 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fdc02cb90 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.797+0000 7f4fe1d9b640 1 -- 172.21.15.152:0/4114249365 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fdc0343f0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/4114249365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 msgr2=0x7f4fe40ca6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/4114249365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 secure :-1 s=READY pgs=3281 cs=0 l=1 rev1=1 crypto rx=0x7f4fe40739e0 tx=0x7f4fdc02be50 comp rx=0 tx=0).stop 2024-03-18T22:39:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/4114249365 shutdown_connections 2024-03-18T22:39:56.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/4114249365 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40ca6d0 unknown :-1 s=CLOSED pgs=3281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/4114249365 >> v2:172.21.15.186:3300/0 conn(0x7f4fe414bdf0 0x7f4fe4071790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.798+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/4114249365 >> 172.21.15.152:0/4114249365 conn(0x7f4fe40cfbf0 msgr2=0x7f4fe40cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.799+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/4114249365 shutdown_connections 2024-03-18T22:39:56.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.799+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/4114249365 wait complete. 2024-03-18T22:39:56.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.804+0000 7f4fe8d1d640 1 Processor -- start 2024-03-18T22:39:56.808 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.807+0000 7f4fe8d1d640 1 -- start start 2024-03-18T22:39:56.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe40ca240 0x7f4fe4162170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe414bdf0 0x7f4fe406d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe40c5280 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe40727a0 con 0x7f4fe40ca240 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe8d1d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4fe40c5400 con 0x7f4fe414bdf0 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.811+0000 7f4fe2d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe414bdf0 0x7f4fe406d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:52978/0 (socket says 172.21.15.152:52978) 2024-03-18T22:39:56.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 -- 172.21.15.152:0/3120425503 learned_addr learned my addr 172.21.15.152:0/3120425503 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 -- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe414bdf0 msgr2=0x7f4fe406d850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe414bdf0 0x7f4fe406d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 -- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe40ca240 msgr2=0x7f4fe4162170 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe40ca240 0x7f4fe4162170 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 -- 172.21.15.152:0/3120425503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe40c8730 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.812+0000 7f4fdbfff640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c410 tx=0x7f4fcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.813+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc017070 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.813+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4fcc0035f0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.813+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe40b5740 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.813+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fcc0039e0 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.814+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe40b5d00 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.817+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4fcc01a070 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.817+0000 7f4fdaffd640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 0x7f4fc406e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:56.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.817+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f4fcc089f30 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.818+0000 7f4fe259c640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 0x7f4fc406e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:56.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.820+0000 7f4fe259c640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 0x7f4fc406e160 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009930 tx=0x7f4fd4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:56.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.823+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fc8005290 con 0x7f4fe40ce9e0 2024-03-18T22:39:56.832 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:56.832+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4fcc058a90 con 0x7f4fe40ce9e0 2024-03-18T22:39:57.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.806+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f4fc8005d90 con 0x7f4fe40ce9e0 2024-03-18T22:39:57.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.807+0000 7f4fdaffd640 1 -- 172.21.15.152:0/3120425503 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) ==== 104+0+11 (secure 0 0 0) 0x7f4fcc058390 con 0x7f4fe40ce9e0 2024-03-18T22:39:57.807 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 32 2024-03-18T22:39:57.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.813+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 msgr2=0x7f4fc406e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:57.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.813+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 0x7f4fc406e160 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009930 tx=0x7f4fd4009190 comp rx=0 tx=0).stop 2024-03-18T22:39:57.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.813+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 msgr2=0x7f4fe40b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:57.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.813+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 secure :-1 s=READY pgs=3282 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00c410 tx=0x7f4fcc00c8d0 comp rx=0 tx=0).stop 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 shutdown_connections 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4fc406bca0 0x7f4fc406e160 secure :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009930 tx=0x7f4fd4009190 comp rx=0 tx=0).stop 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4fe414bdf0 0x7f4fe406d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4fe40ce9e0 0x7f4fe40b28d0 unknown :-1 s=CLOSED pgs=3282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 --2- 172.21.15.152:0/3120425503 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4fe40ca240 0x7f4fe4162170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.814+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 >> 172.21.15.152:0/3120425503 conn(0x7f4fe40cfbf0 msgr2=0x7f4fe40c57c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:57.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.815+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 shutdown_connections 2024-03-18T22:39:57.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:57.815+0000 7f4fe8d1d640 1 -- 172.21.15.152:0/3120425503 wait complete. 2024-03-18T22:39:57.853 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-03-18T22:39:58.246 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.245+0000 7f8fe5fc6640 1 Processor -- start 2024-03-18T22:39:58.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.246+0000 7f8fe5fc6640 1 -- start start 2024-03-18T22:39:58.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.250+0000 7f8fe5fc6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8fe00cd410 0x7f8fe015b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.250+0000 7f8fe5fc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe00cfca0 0x7f8fe00cbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.250+0000 7f8fe5fc6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8fe00cc370 con 0x7f8fe0071d60 2024-03-18T22:39:58.251 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.250+0000 7f8fe5fc6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8fe00cc650 con 0x7f8fe00cd410 2024-03-18T22:39:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.250+0000 7f8fe5fc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe00cc930 con 0x7f8fe00cfca0 2024-03-18T22:39:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.251+0000 7f8fdeffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f8fe0071d60 0x7f8fe00cf590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:38670/0 (socket says 172.21.15.152:38670) 2024-03-18T22:39:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.251+0000 7f8fdeffd640 1 -- 172.21.15.152:0/3856720453 learned_addr learned my addr 172.21.15.152:0/3856720453 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:39:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.252+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1285867899 0 0) 0x7f8fe00cc370 con 0x7f8fe0071d60 2024-03-18T22:39:58.252 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.252+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8fc8003520 con 0x7f8fe0071d60 2024-03-18T22:39:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1416623158 0 0) 0x7f8fc8003520 con 0x7f8fe0071d60 2024-03-18T22:39:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe00cfca0 msgr2=0x7f8fe00cbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe00cfca0 0x7f8fe00cbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 >> v2:172.21.15.186:3300/0 conn(0x7f8fe00cd410 msgr2=0x7f8fe015b120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 --2- 172.21.15.152:0/3856720453 >> v2:172.21.15.186:3300/0 conn(0x7f8fe00cd410 0x7f8fe015b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe00ccc10 con 0x7f8fe0071d60 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f8fd4001670 con 0x7f8fe0071d60 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 >> v1:172.21.15.152:6789/0 conn(0x7f8fe0071d60 legacy=0x7f8fe00cf590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc80039b0 0x7f8fc8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.253+0000 7f8fde7fc640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc8004800 0x7f8fc8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.254+0000 7f8fde7fc640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc80053c0 0x7f8fc800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.254+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe00cc650 con 0x7f8fc80039b0 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.254+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe00cc930 con 0x7f8fc8004800 2024-03-18T22:39:58.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.254+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fc800c260 con 0x7f8fc80053c0 2024-03-18T22:39:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.255+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc80039b0 0x7f8fc8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.256 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.255+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc8004800 0x7f8fc8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.256+0000 7f8fdeffd640 1 -- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc80053c0 msgr2=0x7f8fc800b9c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.256+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fc80053c0 0x7f8fc800b9c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.256+0000 7f8fdeffd640 1 -- 172.21.15.152:0/3856720453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc80039b0 msgr2=0x7f8fc8003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.256+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc80039b0 0x7f8fc8003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.256+0000 7f8fdeffd640 1 -- 172.21.15.152:0/3856720453 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe00ccc10 con 0x7f8fc8004800 2024-03-18T22:39:58.257 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.257+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc80039b0 0x7f8fc8003dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:39:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.257+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc8004800 0x7f8fc8004c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400c290 tx=0x7f8fc8005830 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1adda6df3076f851 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.258+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd4007db0 con 0x7f8fc8004800 2024-03-18T22:39:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.258+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd4030070 con 0x7f8fc8004800 2024-03-18T22:39:58.259 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.258+0000 7f8fde7fc640 1 -- 172.21.15.152:0/3856720453 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd402ce10 con 0x7f8fc8004800 2024-03-18T22:39:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.260+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc8004800 msgr2=0x7f8fc8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.260+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/3856720453 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fc8004800 0x7f8fc8004c80 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f8fd400c290 tx=0x7f8fc8005830 comp rx=0 tx=0).stop 2024-03-18T22:39:58.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.260+0000 7f8fdffff640 1 -- 172.21.15.152:0/3856720453 reap_dead start 2024-03-18T22:39:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.261+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/3856720453 shutdown_connections 2024-03-18T22:39:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.261+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/3856720453 >> 172.21.15.152:0/3856720453 conn(0x7f8fe00d0da0 msgr2=0x7f8fe00d11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.261+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/3856720453 shutdown_connections 2024-03-18T22:39:58.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.261+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/3856720453 wait complete. 2024-03-18T22:39:58.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.268+0000 7f8fe5fc6640 1 Processor -- start 2024-03-18T22:39:58.268 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.268+0000 7f8fe5fc6640 1 -- start start 2024-03-18T22:39:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.272+0000 7f8fe5fc6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 0x7f8fe00b1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.272+0000 7f8fe5fc6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.272+0000 7f8fe5fc6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 0x7f8fe01fbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fe5fc6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe00cf1e0 con 0x7f8fc8004800 2024-03-18T22:39:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fe5fc6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8fe00cf060 con 0x7f8fe015a680 2024-03-18T22:39:58.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fe5fc6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8fe00cbd00 con 0x7f8fe01fb940 2024-03-18T22:39:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdeffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.276 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 0x7f8fe01fbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdffff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 0x7f8fe01fbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:60788/0 (socket says 172.21.15.152:60788) 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdffff640 1 -- 172.21.15.152:0/892396170 learned_addr learned my addr 172.21.15.152:0/892396170 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdeffd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:38734/0 (socket says 172.21.15.152:38734) 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.273+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 0x7f8fe00b1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 -- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 msgr2=0x7f8fe01fbdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 0x7f8fe01fbdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 -- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 msgr2=0x7f8fe00c80e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:58.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 -- 172.21.15.152:0/892396170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8fe0157e80 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.274+0000 7f8fdf7fe640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 0x7f8fe00b1440 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c450 tx=0x7f8fd800c540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.275+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd801b070 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.275+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8fd8016410 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.276+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8fd80165c0 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.276+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8fe0158120 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.277+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8fe01586e0 con 0x7f8fc8004800 2024-03-18T22:39:58.278 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.278+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-03-18T22:39:58.283 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.283+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8fd801e070 con 0x7f8fc8004800 2024-03-18T22:39:58.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.285+0000 7f8fc7fff640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 0x7f8fcc07f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:58.285 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.285+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8fe004f540 con 0x7f8fc8004800 2024-03-18T22:39:58.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.285+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 0x7f8fcc07f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:58.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.285+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f8fd808acb0 con 0x7f8fc8004800 2024-03-18T22:39:58.286 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.286+0000 7f8fdeffd640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 0x7f8fcc07f170 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4034000 tx=0x7f8fd4007000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:58.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:58.300+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8fd8059130 con 0x7f8fc8004800 2024-03-18T22:39:59.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.222+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8fe014f890 con 0x7f8fc8004800 2024-03-18T22:39:59.225 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.224+0000 7f8fc7fff640 1 -- 172.21.15.152:0/892396170 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) ==== 100+0+11 (secure 0 0 0) 0x7f8fd805d1d0 con 0x7f8fc8004800 2024-03-18T22:39:59.229 INFO:teuthology.orchestra.run.smithi152.stdout:pg_num: 64 2024-03-18T22:39:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 msgr2=0x7f8fcc07f170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 0x7f8fcc07f170 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fd4034000 tx=0x7f8fd4007000 comp rx=0 tx=0).stop 2024-03-18T22:39:59.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 msgr2=0x7f8fe00b1440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 0x7f8fe00b1440 secure :-1 s=READY pgs=3284 cs=0 l=1 rev1=1 crypto rx=0x7f8fd800c450 tx=0x7f8fd800c540 comp rx=0 tx=0).stop 2024-03-18T22:39:59.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 shutdown_connections 2024-03-18T22:39:59.232 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8fcc07ccb0 0x7f8fcc07f170 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8fe01fb940 0x7f8fe01fbdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8fe015a680 0x7f8fe00c80e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 --2- 172.21.15.152:0/892396170 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8fc8004800 0x7f8fe00b1440 unknown :-1 s=CLOSED pgs=3284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.231+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 >> 172.21.15.152:0/892396170 conn(0x7f8fe00d0da0 msgr2=0x7f8fe00cd820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.232+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 shutdown_connections 2024-03-18T22:39:59.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.232+0000 7f8fe5fc6640 1 -- 172.21.15.152:0/892396170 wait complete. 2024-03-18T22:39:59.266 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T22:39:59.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.687+0000 7f1485162640 1 Processor -- start 2024-03-18T22:39:59.687 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.687+0000 7f1485162640 1 -- start start 2024-03-18T22:39:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f1485162640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f14800b0340 0x7f1480071ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f1485162640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f148015e820 con 0x7f148015f2c0 2024-03-18T22:39:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f1485162640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f14800b40b0 con 0x7f148015e220 2024-03-18T22:39:59.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f1485162640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f148015e600 con 0x7f14800b0340 2024-03-18T22:39:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f147f59e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f14800b0340 0x7f1480071ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f147f59e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f14800b0340 0x7f1480071ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:38746/0 (socket says 172.21.15.152:38746) 2024-03-18T22:39:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.692+0000 7f147f59e640 1 -- 172.21.15.152:0/954426141 learned_addr learned my addr 172.21.15.152:0/954426141 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:59.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.693+0000 7f147dd9b640 1 -- 172.21.15.152:0/954426141 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 89384162 0 0) 0x7f148015e820 con 0x7f148015f2c0 2024-03-18T22:39:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.693+0000 7f147dd9b640 1 -- 172.21.15.152:0/954426141 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1468003520 con 0x7f148015f2c0 2024-03-18T22:39:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.693+0000 7f147f59e640 1 -- 172.21.15.152:0/954426141 >> v1:172.21.15.186:6789/0 conn(0x7f148015e220 legacy=0x7f148006f720 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T22:39:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.693+0000 7f147f59e640 1 -- 172.21.15.152:0/954426141 >> v1:172.21.15.152:6789/0 conn(0x7f148015f2c0 legacy=0x7f14800afc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.693+0000 7f147f59e640 1 -- 172.21.15.152:0/954426141 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f148015eac0 con 0x7f14800b0340 2024-03-18T22:39:59.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.696+0000 7f147f59e640 1 --2- 172.21.15.152:0/954426141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14800b0340 0x7f1480071ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1478009e50 tx=0x7f147802bf70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b26d38ef77b7c7f1 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:59.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.697+0000 7f147dd9b640 1 -- 172.21.15.152:0/954426141 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147802cb10 con 0x7f14800b0340 2024-03-18T22:39:59.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.697+0000 7f147dd9b640 1 -- 172.21.15.152:0/954426141 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f147802ccb0 con 0x7f14800b0340 2024-03-18T22:39:59.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.697+0000 7f147dd9b640 1 -- 172.21.15.152:0/954426141 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147802ce60 con 0x7f14800b0340 2024-03-18T22:39:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.698+0000 7f1485162640 1 -- 172.21.15.152:0/954426141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14800b0340 msgr2=0x7f1480071ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.698+0000 7f1485162640 1 --2- 172.21.15.152:0/954426141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14800b0340 0x7f1480071ed0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f1478009e50 tx=0x7f147802bf70 comp rx=0 tx=0).stop 2024-03-18T22:39:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.699+0000 7f1485162640 1 -- 172.21.15.152:0/954426141 shutdown_connections 2024-03-18T22:39:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.699+0000 7f1485162640 1 --2- 172.21.15.152:0/954426141 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f14800b0340 0x7f1480071ed0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.699+0000 7f1485162640 1 -- 172.21.15.152:0/954426141 >> 172.21.15.152:0/954426141 conn(0x7f14800b2a40 msgr2=0x7f14800b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:39:59.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.699+0000 7f1485162640 1 -- 172.21.15.152:0/954426141 shutdown_connections 2024-03-18T22:39:59.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.700+0000 7f1485162640 1 -- 172.21.15.152:0/954426141 wait complete. 2024-03-18T22:39:59.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.706+0000 7f1485162640 1 Processor -- start 2024-03-18T22:39:59.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.706+0000 7f1485162640 1 -- start start 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148015e220 0x7f148014eae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 0x7f14801f4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f14800b3d40 con 0x7f14800b0340 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f14800b4390 con 0x7f148015f2c0 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.708+0000 7f1485162640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f14800b4510 con 0x7f148015e220 2024-03-18T22:39:59.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.709+0000 7f147ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.709+0000 7f147ed9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:53012/0 (socket says 172.21.15.152:53012) 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.709+0000 7f147ed9d640 1 -- 172.21.15.152:0/2583836665 learned_addr learned my addr 172.21.15.152:0/2583836665 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.709+0000 7f147f59e640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 0x7f14801f4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.709+0000 7f147e59c640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148015e220 0x7f148014eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147f59e640 1 -- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148015e220 msgr2=0x7f148014eae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147f59e640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148015e220 0x7f148014eae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147f59e640 1 -- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 msgr2=0x7f14800ae000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147f59e640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:39:59.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147f59e640 1 -- 172.21.15.152:0/2583836665 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1480140ed0 con 0x7f148015f2c0 2024-03-18T22:39:59.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.710+0000 7f147ed9d640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:39:59.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.711+0000 7f147f59e640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 0x7f14801f4930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1478032000 tx=0x7f1478004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:39:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.712+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1478050070 con 0x7f148015f2c0 2024-03-18T22:39:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.712+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1478007940 con 0x7f148015f2c0 2024-03-18T22:39:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.712+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f147802ce60 con 0x7f148015f2c0 2024-03-18T22:39:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.712+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14801411a0 con 0x7f148015f2c0 2024-03-18T22:39:59.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.712+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1480141760 con 0x7f148015f2c0 2024-03-18T22:39:59.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.715+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1460005290 con 0x7f148015f2c0 2024-03-18T22:39:59.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.716+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1478053070 con 0x7f148015f2c0 2024-03-18T22:39:59.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.718+0000 7f14677fe640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 0x7f146c06e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:39:59.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.718+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f14780b4b00 con 0x7f148015f2c0 2024-03-18T22:39:59.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.723+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1478046070 con 0x7f148015f2c0 2024-03-18T22:39:59.734 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.734+0000 7f147ed9d640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 0x7f146c06e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:39:59.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:39:59.735+0000 7f147ed9d640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 0x7f146c06e0e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1470009e00 tx=0x7f1470009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:00.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.915+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1460005850 con 0x7f148015f2c0 2024-03-18T22:40:00.918 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.917+0000 7f14677fe640 1 -- 172.21.15.152:0/2583836665 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7f14780831a0 con 0x7f148015f2c0 2024-03-18T22:40:00.919 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:00.919 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T22:40:00.919 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T22:40:00.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.924+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 msgr2=0x7f146c06e0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:00.925 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.924+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 0x7f146c06e0e0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f1470009e00 tx=0x7f1470009190 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.924+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 msgr2=0x7f14801f4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 0x7f14801f4930 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f1478032000 tx=0x7f1478004a40 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 shutdown_connections 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f148015f2c0 0x7f14801f4930 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f146c06bc20 0x7f146c06e0e0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f148015e220 0x7f148014eae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 --2- 172.21.15.152:0/2583836665 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f14800b0340 0x7f14800ae000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:00.926 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 >> 172.21.15.152:0/2583836665 conn(0x7f14800b2a40 msgr2=0x7f148014e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:00.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 shutdown_connections 2024-03-18T22:40:00.927 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:00.925+0000 7f1485162640 1 -- 172.21.15.152:0/2583836665 wait complete. 2024-03-18T22:40:00.965 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T22:40:01.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.373+0000 7f22dbda7640 1 Processor -- start 2024-03-18T22:40:01.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.373+0000 7f22dbda7640 1 -- start start 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.374+0000 7f22dbda7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f22d41622b0 0x7f22d40d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.374+0000 7f22dbda7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f22d4162690 0x7f22d4162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.374+0000 7f22dbda7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f22d40b3440 con 0x7f22d40cec80 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.374+0000 7f22dbda7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40d16c0 con 0x7f22d4162690 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.374+0000 7f22dbda7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f22d40d2660 con 0x7f22d41622b0 2024-03-18T22:40:01.377 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22da344640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f22d40cec80 0x7f22d40cf0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:39238/0 (socket says 172.21.15.152:39238) 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22da344640 1 -- 172.21.15.152:0/3712534879 learned_addr learned my addr 172.21.15.152:0/3712534879 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d9b43640 1 --2- 172.21.15.152:0/3712534879 >> v2:172.21.15.186:3300/0 conn(0x7f22d41622b0 0x7f22d40d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d8b41640 1 -- 172.21.15.152:0/3712534879 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3131512340 0 0) 0x7f22d40b3440 con 0x7f22d40cec80 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d8b41640 1 -- 172.21.15.152:0/3712534879 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f22bc003520 con 0x7f22d40cec80 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d9b43640 1 -- 172.21.15.152:0/3712534879 >> v2:172.21.15.152:3300/0 conn(0x7f22d4162690 msgr2=0x7f22d4162b20 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d9b43640 1 --2- 172.21.15.152:0/3712534879 >> v2:172.21.15.152:3300/0 conn(0x7f22d4162690 0x7f22d4162b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d9b43640 1 -- 172.21.15.152:0/3712534879 >> v1:172.21.15.186:6789/0 conn(0x7f22d40cec80 legacy=0x7f22d40cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.375+0000 7f22d9b43640 1 -- 172.21.15.152:0/3712534879 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40d20a0 con 0x7f22d41622b0 2024-03-18T22:40:01.378 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.377+0000 7f22d9b43640 1 --2- 172.21.15.152:0/3712534879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d41622b0 0x7f22d40d10d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009d90 tx=0x7f22c402bdb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5f67cb38b10051f0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:01.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.377+0000 7f22d8b41640 1 -- 172.21.15.152:0/3712534879 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4039070 con 0x7f22d41622b0 2024-03-18T22:40:01.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.377+0000 7f22d8b41640 1 -- 172.21.15.152:0/3712534879 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22c402cb60 con 0x7f22d41622b0 2024-03-18T22:40:01.379 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.378+0000 7f22d8b41640 1 -- 172.21.15.152:0/3712534879 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22c4034440 con 0x7f22d41622b0 2024-03-18T22:40:01.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.381+0000 7f22dbda7640 1 -- 172.21.15.152:0/3712534879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d41622b0 msgr2=0x7f22d40d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:01.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.381+0000 7f22dbda7640 1 --2- 172.21.15.152:0/3712534879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d41622b0 0x7f22d40d10d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009d90 tx=0x7f22c402bdb0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 -- 172.21.15.152:0/3712534879 shutdown_connections 2024-03-18T22:40:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 --2- 172.21.15.152:0/3712534879 >> v2:172.21.15.152:3300/0 conn(0x7f22d4162690 0x7f22d4162b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 --2- 172.21.15.152:0/3712534879 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d41622b0 0x7f22d40d10d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.383 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 -- 172.21.15.152:0/3712534879 >> 172.21.15.152:0/3712534879 conn(0x7f22d40d4070 msgr2=0x7f22d40d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:01.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 -- 172.21.15.152:0/3712534879 shutdown_connections 2024-03-18T22:40:01.384 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.382+0000 7f22dbda7640 1 -- 172.21.15.152:0/3712534879 wait complete. 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.388+0000 7f22dbda7640 1 Processor -- start 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.388+0000 7f22dbda7640 1 -- start start 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.389+0000 7f22dbda7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d40cec80 0x7f22d4158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.389+0000 7f22dbda7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22d41622b0 0x7f22d415a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.389+0000 7f22dbda7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22dbda7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f22d415faa0 con 0x7f22d41622b0 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22dbda7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f22d40d2ab0 con 0x7f22d40cec80 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22dbda7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f22d415fc20 con 0x7f22d4162690 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:42992/0 (socket says 172.21.15.152:42992) 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 -- 172.21.15.152:0/1961292 learned_addr learned my addr 172.21.15.152:0/1961292 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:01.393 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 -- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d40cec80 msgr2=0x7f22d4158420 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d40cec80 0x7f22d4158420 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 -- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22d41622b0 msgr2=0x7f22d415a040 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22d41622b0 0x7f22d415a040 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.390+0000 7f22da344640 1 -- 172.21.15.152:0/1961292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22d40b9b40 con 0x7f22d4162690 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22da344640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c3c0 tx=0x7f22cc001e70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc017070 con 0x7f22d4162690 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f22cc005ce0 con 0x7f22d4162690 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22cc0072d0 con 0x7f22d4162690 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22d415abb0 con 0x7f22d4162690 2024-03-18T22:40:01.394 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.391+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f22d41f3dc0 con 0x7f22d4162690 2024-03-18T22:40:01.396 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.395+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f22cc01a070 con 0x7f22d4162690 2024-03-18T22:40:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.395+0000 7f22d27fc640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 0x7f22c006e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.396+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f22cc089c40 con 0x7f22d4162690 2024-03-18T22:40:01.397 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.396+0000 7f22d9b43640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 0x7f22c006e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:01.398 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.398+0000 7f22d9b43640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 0x7f22c006e160 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c4030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:01.399 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.398+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22d404f5b0 con 0x7f22d4162690 2024-03-18T22:40:01.407 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:01.406+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f22cc058150 con 0x7f22d4162690 2024-03-18T22:40:02.233 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.232+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f22d4158ac0 con 0x7f22d4162690 2024-03-18T22:40:02.236 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.236+0000 7f22d27fc640 1 -- 172.21.15.152:0/1961292 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f22cc05c1f0 con 0x7f22d4162690 2024-03-18T22:40:02.237 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:02.237 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:46.574201+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T22:40:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.239+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 msgr2=0x7f22c006e160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.239+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 0x7f22c006e160 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c4030000 comp rx=0 tx=0).stop 2024-03-18T22:40:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.239+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 msgr2=0x7f22d415a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.239+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f22cc00c3c0 tx=0x7f22cc001e70 comp rx=0 tx=0).stop 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 shutdown_connections 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f22c006bca0 0x7f22c006e160 secure :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c4030000 comp rx=0 tx=0).stop 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22d4162690 0x7f22d415a580 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22d41622b0 0x7f22d415a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 --2- 172.21.15.152:0/1961292 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f22d40cec80 0x7f22d4158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 >> 172.21.15.152:0/1961292 conn(0x7f22d40d4070 msgr2=0x7f22d40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 shutdown_connections 2024-03-18T22:40:02.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.240+0000 7f22dbda7640 1 -- 172.21.15.152:0/1961292 wait complete. 2024-03-18T22:40:02.261 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T22:40:02.261 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T22:40:02.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.672+0000 7fa836885640 1 Processor -- start 2024-03-18T22:40:02.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.673+0000 7fa836885640 1 -- start start 2024-03-18T22:40:02.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.676+0000 7fa836885640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 0x7fa830071240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.676+0000 7fa836885640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 0x7fa8300d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.677+0000 7fa834e22640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fa8300d06f0 0x7fa83006cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33634/0 (socket says 172.21.15.152:33634) 2024-03-18T22:40:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.677+0000 7fa82f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 0x7fa8300d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.677+0000 7fa82f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 0x7fa8300d01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56166/0 (socket says 172.21.15.152:56166) 2024-03-18T22:40:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.677+0000 7fa834e22640 1 -- 172.21.15.152:0/1711393066 learned_addr learned my addr 172.21.15.152:0/1711393066 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:02.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.678+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa830071900 con 0x7fa8300d06f0 2024-03-18T22:40:02.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.678+0000 7fa82ffff640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 0x7fa830071240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.679+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa830072480 con 0x7fa830072810 2024-03-18T22:40:02.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.679+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 80887425 0 0) 0x7fa830071900 con 0x7fa8300d06f0 2024-03-18T22:40:02.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.679+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa830073240 con 0x7fa83015a280 2024-03-18T22:40:02.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.679+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa818005730 con 0x7fa8300d06f0 2024-03-18T22:40:02.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.680+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1640992029 0 0) 0x7fa818005730 con 0x7fa8300d06f0 2024-03-18T22:40:02.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.680+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 msgr2=0x7fa830071240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:02.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.680+0000 7fa82effd640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 0x7fa830071240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.680+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 msgr2=0x7fa8300d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:02.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.681+0000 7fa82effd640 1 --2- 172.21.15.152:0/1711393066 >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 0x7fa8300d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.681+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa830071be0 con 0x7fa8300d06f0 2024-03-18T22:40:02.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.682+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7fa8280019f0 con 0x7fa8300d06f0 2024-03-18T22:40:02.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.682+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/1711393066 >> v2:172.21.15.152:3300/0 conn(0x7fa830072810 0x7fa8300d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.687+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 >> v1:172.21.15.152:6789/0 conn(0x7fa8300d06f0 legacy=0x7fa83006cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.687+0000 7fa82effd640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818005c30 0x7fa818006010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82effd640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa818006550 0x7fa818006a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82effd640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 0x7fa818007120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa830072480 con 0x7fa818005c30 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa818007820 con 0x7fa818006550 2024-03-18T22:40:02.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa818007ba0 con 0x7fa83015a280 2024-03-18T22:40:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82ffff640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818005c30 0x7fa818006010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.688+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa818006550 0x7fa818006a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.689+0000 7fa82f7fe640 1 -- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 msgr2=0x7fa818007120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T22:40:02.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.689+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa83015a280 0x7fa818007120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.689+0000 7fa82f7fe640 1 -- 172.21.15.152:0/1711393066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818005c30 msgr2=0x7fa818006010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.689+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818005c30 0x7fa818006010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.689+0000 7fa82f7fe640 1 -- 172.21.15.152:0/1711393066 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa818005730 con 0x7fa818006550 2024-03-18T22:40:02.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.690+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa818006550 0x7fa818006a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa824009c90 tx=0x7fa818007a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ef94304b15901e90 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:02.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.691+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824039070 con 0x7fa818006550 2024-03-18T22:40:02.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.691+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82402c9b0 con 0x7fa818006550 2024-03-18T22:40:02.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.691+0000 7fa82effd640 1 -- 172.21.15.152:0/1711393066 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824009860 con 0x7fa818006550 2024-03-18T22:40:02.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.693+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa818006550 msgr2=0x7fa818006a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.693+0000 7fa836885640 1 --2- 172.21.15.152:0/1711393066 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa818006550 0x7fa818006a10 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa824009c90 tx=0x7fa818007a40 comp rx=0 tx=0).stop 2024-03-18T22:40:02.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.693+0000 7fa834e22640 1 -- 172.21.15.152:0/1711393066 reap_dead start 2024-03-18T22:40:02.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.694+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 shutdown_connections 2024-03-18T22:40:02.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.694+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 >> 172.21.15.152:0/1711393066 conn(0x7fa83006b5e0 msgr2=0x7fa83006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:02.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.698+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 shutdown_connections 2024-03-18T22:40:02.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.698+0000 7fa836885640 1 -- 172.21.15.152:0/1711393066 wait complete. 2024-03-18T22:40:02.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.703+0000 7fa836885640 1 Processor -- start 2024-03-18T22:40:02.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.704+0000 7fa836885640 1 -- start start 2024-03-18T22:40:02.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.707+0000 7fa836885640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa836885640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 0x7fa83009c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa82ffff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56188/0 (socket says 172.21.15.152:56188) 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa82ffff640 1 -- 172.21.15.152:0/2704216979 learned_addr learned my addr 172.21.15.152:0/2704216979 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa83009c880 0x7fa83009cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.708+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 0x7fa83009c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.709+0000 7fa834e22640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa83009c880 0x7fa83009cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.709+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa8300721a0 con 0x7fa818006550 2024-03-18T22:40:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.709+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa83015a660 con 0x7fa83009c880 2024-03-18T22:40:02.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.709+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa83006efe0 con 0x7fa8301e2b60 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82f7fe640 1 -- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa83009c880 msgr2=0x7fa83009cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa83009c880 0x7fa83009cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82f7fe640 1 -- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 msgr2=0x7fa8301e2620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82f7fe640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83009d270 con 0x7fa8301e2b60 2024-03-18T22:40:02.711 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.710+0000 7fa82ffff640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa82f7fe640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 0x7fa83009c340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa824033000 tx=0x7fa824004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824044020 con 0x7fa8301e2b60 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa82403a040 con 0x7fa8301e2b60 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8301e3070 con 0x7fa8301e2b60 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824039050 con 0x7fa8301e2b60 2024-03-18T22:40:02.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.711+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8300cc840 con 0x7fa8301e2b60 2024-03-18T22:40:02.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.714+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa83004f5b0 con 0x7fa8301e2b60 2024-03-18T22:40:02.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.716+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa824047070 con 0x7fa8301e2b60 2024-03-18T22:40:02.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.717+0000 7fa82cff9640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 0x7fa81c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:02.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.717+0000 7fa82ffff640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 0x7fa81c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:02.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.718+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fa8240784a0 con 0x7fa8301e2b60 2024-03-18T22:40:02.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.719+0000 7fa82ffff640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 0x7fa81c06e0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa820006f00 tx=0x7fa82000c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:02.724 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:02.723+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fa83009d270 con 0x7fa8301e2b60 2024-03-18T22:40:03.656 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.655+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa8300b0b90 con 0x7fa8301e2b60 2024-03-18T22:40:03.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.657+0000 7fa82cff9640 1 -- 172.21.15.152:0/2704216979 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7fa82407a400 con 0x7fa8301e2b60 2024-03-18T22:40:03.659 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:03.659 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T22:40:03.659 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T22:40:03.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 msgr2=0x7fa81c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:03.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 0x7fa81c06e0c0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7fa820006f00 tx=0x7fa82000c040 comp rx=0 tx=0).stop 2024-03-18T22:40:03.661 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 msgr2=0x7fa83009c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 0x7fa83009c340 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa824033000 tx=0x7fa824004730 comp rx=0 tx=0).stop 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 shutdown_connections 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa83009c880 0x7fa83009cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa81c06bc00 0x7fa81c06e0c0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa8301e2b60 0x7fa83009c340 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 --2- 172.21.15.152:0/2704216979 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa818006550 0x7fa8301e2620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 >> 172.21.15.152:0/2704216979 conn(0x7fa83006b5e0 msgr2=0x7fa830158b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 shutdown_connections 2024-03-18T22:40:03.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.661+0000 7fa836885640 1 -- 172.21.15.152:0/2704216979 wait complete. 2024-03-18T22:40:03.682 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T22:40:03.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.992+0000 7fe110eff640 1 Processor -- start 2024-03-18T22:40:03.992 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.992+0000 7fe110eff640 1 -- start start 2024-03-18T22:40:03.993 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe110eff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fe10c0cdf30 0x7fe10c0cf100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe110eff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fe10c06d280 0x7fe10c15db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe110eff640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe10c0ce310 con 0x7fe10c06c370 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe110eff640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fe10c0d1c60 con 0x7fe10c0cdf30 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe110eff640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fe10c0d0f80 con 0x7fe10c06d280 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe109d9b640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fe10c06c370 0x7fe10c06cb70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:39240/0 (socket says 172.21.15.152:39240) 2024-03-18T22:40:03.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.993+0000 7fe109d9b640 1 -- 172.21.15.152:0/2862200517 learned_addr learned my addr 172.21.15.152:0/2862200517 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:03.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.994+0000 7fe10ad9d640 1 --2- 172.21.15.152:0/2862200517 >> v2:172.21.15.186:3300/0 conn(0x7fe10c06d280 0x7fe10c15db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:03.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.995+0000 7fe10ad9d640 1 -- 172.21.15.152:0/2862200517 >> v2:172.21.15.152:3300/0 conn(0x7fe10c0cdf30 msgr2=0x7fe10c0cf100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:03.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.995+0000 7fe10ad9d640 1 --2- 172.21.15.152:0/2862200517 >> v2:172.21.15.152:3300/0 conn(0x7fe10c0cdf30 0x7fe10c0cf100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:03.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.995+0000 7fe10ad9d640 1 -- 172.21.15.152:0/2862200517 >> v1:172.21.15.186:6789/0 conn(0x7fe10c06c370 legacy=0x7fe10c06cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:03.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.995+0000 7fe10ad9d640 1 -- 172.21.15.152:0/2862200517 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c0d0370 con 0x7fe10c06d280 2024-03-18T22:40:03.998 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.998+0000 7fe10ad9d640 1 --2- 172.21.15.152:0/2862200517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c15db10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe10c072fb0 tx=0x7fe10002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e4bfd13347834e84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:03.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.998+0000 7fe10959a640 1 -- 172.21.15.152:0/2862200517 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe100035020 con 0x7fe10c06d280 2024-03-18T22:40:03.999 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:03.999+0000 7fe10959a640 1 -- 172.21.15.152:0/2862200517 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe100031830 con 0x7fe10c06d280 2024-03-18T22:40:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 -- 172.21.15.152:0/2862200517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 msgr2=0x7fe10c15db10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.001 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 --2- 172.21.15.152:0/2862200517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c15db10 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe10c072fb0 tx=0x7fe10002b8d0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 -- 172.21.15.152:0/2862200517 shutdown_connections 2024-03-18T22:40:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 --2- 172.21.15.152:0/2862200517 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c15db10 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 --2- 172.21.15.152:0/2862200517 >> v2:172.21.15.152:3300/0 conn(0x7fe10c0cdf30 0x7fe10c0cf100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.002 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.001+0000 7fe110eff640 1 -- 172.21.15.152:0/2862200517 >> 172.21.15.152:0/2862200517 conn(0x7fe10c0d1ea0 msgr2=0x7fe10c0d22b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.002+0000 7fe110eff640 1 -- 172.21.15.152:0/2862200517 shutdown_connections 2024-03-18T22:40:04.003 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.002+0000 7fe110eff640 1 -- 172.21.15.152:0/2862200517 wait complete. 2024-03-18T22:40:04.008 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.007+0000 7fe110eff640 1 Processor -- start 2024-03-18T22:40:04.013 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.008+0000 7fe110eff640 1 -- start start 2024-03-18T22:40:04.014 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.011+0000 7fe110eff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.015 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.011+0000 7fe10a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe10a59c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56206/0 (socket says 172.21.15.152:56206) 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe10a59c640 1 -- 172.21.15.152:0/3366738349 learned_addr learned my addr 172.21.15.152:0/3366738349 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe110eff640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c09bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe110eff640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe10c0cdf30 0x7fe10c0c6a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe110eff640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0d0930 con 0x7fe10c06c370 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe110eff640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe10c0cf640 con 0x7fe10c06d280 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe110eff640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe10c0d0c10 con 0x7fe10c0cdf30 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.012+0000 7fe109d9b640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c09bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe10a59c640 1 -- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe10c0cdf30 msgr2=0x7fe10c0c6a00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe10a59c640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe10c0cdf30 0x7fe10c0c6a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe10a59c640 1 -- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 msgr2=0x7fe10c09bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.019 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe10a59c640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c09bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe10a59c640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe10c09f6b0 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.013+0000 7fe109d9b640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c09bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.014+0000 7fe10a59c640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ba80 tx=0x7fe10400bf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.014+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104019070 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.014+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe10400cb40 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.014+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe104014440 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.014+0000 7fe110eff640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe10c09f990 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.015+0000 7fe110eff640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe10c1e67f0 con 0x7fe10c06c370 2024-03-18T22:40:04.021 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.020+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe10c06dc60 con 0x7fe10c06c370 2024-03-18T22:40:04.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.021+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe10401c070 con 0x7fe10c06c370 2024-03-18T22:40:04.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.021+0000 7fe0faffd640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 0x7fe0ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.021+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fe10408a760 con 0x7fe10c06c370 2024-03-18T22:40:04.022 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.021+0000 7fe109d9b640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 0x7fe0ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.023 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.022+0000 7fe109d9b640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 0x7fe0ec06e090 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0b7540 tx=0x7fe0fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:04.050 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.049+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe10c06dc60 con 0x7fe10c06c370 2024-03-18T22:40:04.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.450+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe10c1e6300 con 0x7fe10c06c370 2024-03-18T22:40:04.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.451+0000 7fe0faffd640 1 -- 172.21.15.152:0/3366738349 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+5187 (secure 0 0 0) 0x7fe104058b60 con 0x7fe10c06c370 2024-03-18T22:40:04.453 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:04.453 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-18T15:01:44.919837+0000","modified":"2024-03-18T15:01:46.931862+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5148},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5148":{"gid":5148,"name":"c","rank":0,"incarnation":11,"state":"up:active","state_seq":3,"addr":"172.21.15.152:6837/556153091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":556153091},{"type":"v1","addr":"172.21.15.152:6837","nonce":556153091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5148,"qdb_cluster":[5148]},"id":2}]} 2024-03-18T22:40:04.453 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 13 2024-03-18T22:40:04.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.457+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 msgr2=0x7fe0ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.457+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 0x7fe0ec06e090 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fe10c0b7540 tx=0x7fe0fc009040 comp rx=0 tx=0).stop 2024-03-18T22:40:04.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.457+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 msgr2=0x7fe10c1e8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.457+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 secure :-1 s=READY pgs=3287 cs=0 l=1 rev1=1 crypto rx=0x7fe10400ba80 tx=0x7fe10400bf40 comp rx=0 tx=0).stop 2024-03-18T22:40:04.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 shutdown_connections 2024-03-18T22:40:04.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe0ec06bbd0 0x7fe0ec06e090 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.459 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe10c0cdf30 0x7fe10c0c6a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe10c06d280 0x7fe10c09bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 --2- 172.21.15.152:0/3366738349 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe10c06c370 0x7fe10c1e8240 unknown :-1 s=CLOSED pgs=3287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 >> 172.21.15.152:0/3366738349 conn(0x7fe10c0d1ea0 msgr2=0x7fe10c0b03e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:04.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.458+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 shutdown_connections 2024-03-18T22:40:04.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.459+0000 7fe0f8ff9640 1 -- 172.21.15.152:0/3366738349 wait complete. 2024-03-18T22:40:04.476 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T22:40:04.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.878+0000 7f88b0fb5640 1 Processor -- start 2024-03-18T22:40:04.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.878+0000 7f88b0fb5640 1 -- start start 2024-03-18T22:40:04.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.884+0000 7f88b0fb5640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f88ac0d2d50 0x7f88ac0d4b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.884+0000 7f88b0fb5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0d1e40 0x7f88ac0b3c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.884+0000 7f88b0fb5640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88ac0d1200 con 0x7f88ac15e5a0 2024-03-18T22:40:04.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.884+0000 7f88b0fb5640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f88ac0cff90 con 0x7f88ac0d2d50 2024-03-18T22:40:04.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.884+0000 7f88b0fb5640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0b34d0 con 0x7f88ac0d1e40 2024-03-18T22:40:04.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.885+0000 7f88aa59c640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f88ac15e5a0 0x7f88ac0d2640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33636/0 (socket says 172.21.15.152:33636) 2024-03-18T22:40:04.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.885+0000 7f88aa59c640 1 -- 172.21.15.152:0/3641404525 learned_addr learned my addr 172.21.15.152:0/3641404525 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:04.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.886+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1122070280 0 0) 0x7f88ac0d1200 con 0x7f88ac15e5a0 2024-03-18T22:40:04.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.886+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8894003520 con 0x7f88ac15e5a0 2024-03-18T22:40:04.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.886+0000 7f88aad9d640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0d1e40 0x7f88ac0b3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.886+0000 7f88a9d9b640 1 --2- 172.21.15.152:0/3641404525 >> v2:172.21.15.186:3300/0 conn(0x7f88ac0d2d50 0x7f88ac0d4b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 281264415 0 0) 0x7f8894003520 con 0x7f88ac15e5a0 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0d1e40 msgr2=0x7f88ac0b3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0d1e40 0x7f88ac0b3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 >> v2:172.21.15.186:3300/0 conn(0x7f88ac0d2d50 msgr2=0x7f88ac0d4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 --2- 172.21.15.152:0/3641404525 >> v2:172.21.15.186:3300/0 conn(0x7f88ac0d2d50 0x7f88ac0d4b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0d14e0 con 0x7f88ac15e5a0 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f889c001670 con 0x7f88ac15e5a0 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 >> v1:172.21.15.152:6789/0 conn(0x7f88ac15e5a0 legacy=0x7f88ac0d2640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8894003a20 0x7f8894003e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8894004800 0x7f8894004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88940051c0 0x7f889400b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.887+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0b34d0 con 0x7f8894004800 2024-03-18T22:40:04.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.888+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f889400c010 con 0x7f88940051c0 2024-03-18T22:40:04.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.888+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f889400c210 con 0x7f8894003a20 2024-03-18T22:40:04.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.889+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8894003a20 0x7f8894003e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.889+0000 7f88aad9d640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88940051c0 0x7f889400b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.890+0000 7f88aa59c640 1 -- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88940051c0 msgr2=0x7f889400b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:04.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.890+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f88940051c0 0x7f889400b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.890+0000 7f88aa59c640 1 -- 172.21.15.152:0/3641404525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8894004800 msgr2=0x7f8894004c80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:04.893 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.890+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8894004800 0x7f8894004c80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.890+0000 7f88aa59c640 1 -- 172.21.15.152:0/3641404525 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8894003520 con 0x7f8894003a20 2024-03-18T22:40:04.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.893+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8894003a20 0x7f8894003e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f889c0139b0 tx=0x7f8894005830 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77164fd3d74e51ae server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:04.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.893+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c012030 con 0x7f8894003a20 2024-03-18T22:40:04.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.893+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f889c039070 con 0x7f8894003a20 2024-03-18T22:40:04.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.894+0000 7f88a959a640 1 -- 172.21.15.152:0/3641404525 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f889c0135d0 con 0x7f8894003a20 2024-03-18T22:40:04.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8894003a20 msgr2=0x7f8894003e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3641404525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8894003a20 0x7f8894003e40 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f889c0139b0 tx=0x7f8894005830 comp rx=0 tx=0).stop 2024-03-18T22:40:04.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88aad9d640 1 -- 172.21.15.152:0/3641404525 reap_dead start 2024-03-18T22:40:04.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3641404525 shutdown_connections 2024-03-18T22:40:04.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3641404525 >> 172.21.15.152:0/3641404525 conn(0x7f88ac0d4060 msgr2=0x7f88ac0d4470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:04.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3641404525 shutdown_connections 2024-03-18T22:40:04.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.896+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3641404525 wait complete. 2024-03-18T22:40:04.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.898+0000 7f88b0fb5640 1 Processor -- start 2024-03-18T22:40:04.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.898+0000 7f88b0fb5640 1 -- start start 2024-03-18T22:40:04.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.899+0000 7f88b0fb5640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.899+0000 7f88b0fb5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 0x7f88ac0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.899+0000 7f88b0fb5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88aa59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88aa59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:45346/0 (socket says 172.21.15.152:45346) 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88aad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88aad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56222/0 (socket says 172.21.15.152:56222) 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88aa59c640 1 -- 172.21.15.152:0/3856414116 learned_addr learned my addr 172.21.15.152:0/3856414116 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0b3dc0 con 0x7f88ac0cc420 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88a9d9b640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 0x7f88ac0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f88ac0b3c40 con 0x7f8894003a20 2024-03-18T22:40:04.901 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.900+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f88ac0b3f40 con 0x7f88ac0cba60 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 -- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 msgr2=0x7f88ac152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 -- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 msgr2=0x7f88ac1f2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88ac0cc8a0 con 0x7f88ac0cba60 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88aad9d640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.901+0000 7f88a9d9b640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 0x7f88ac0cbee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88a000d520 tx=0x7f88a000d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.902+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a0018020 con 0x7f88ac0cba60 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.902+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88a0014620 con 0x7f88ac0cba60 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.902+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88a00149f0 con 0x7f88ac0cba60 2024-03-18T22:40:04.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.902+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88ac0b9800 con 0x7f88ac0cba60 2024-03-18T22:40:04.904 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.902+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f88ac157c20 con 0x7f88ac0cba60 2024-03-18T22:40:04.906 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.905+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88ac04f5b0 con 0x7f88ac0cba60 2024-03-18T22:40:04.907 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.907+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f88a001b020 con 0x7f88ac0cba60 2024-03-18T22:40:04.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.907+0000 7f889affd640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 0x7f888c06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:04.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.907+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7f88a008aaf0 con 0x7f88ac0cba60 2024-03-18T22:40:04.908 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.907+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 0x7f888c06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:04.909 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.908+0000 7f88aa59c640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 0x7f888c06e0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f889c013160 tx=0x7f889c038000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:04.917 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:04.916+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f88a0022020 con 0x7f88ac0cba60 2024-03-18T22:40:05.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.886+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f88ac0ce370 con 0x7f88ac0cba60 2024-03-18T22:40:05.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.887+0000 7f889affd640 1 -- 172.21.15.152:0/3856414116 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) ==== 74+0+16717 (secure 0 0 0) 0x7f88a0022020 con 0x7f88ac0cba60 2024-03-18T22:40:05.888 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:05.889 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":35,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T15:01:46.574201+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-03-18T15:01:42.788340+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-03-18T15:01:43.892556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T22:40:05.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 msgr2=0x7f888c06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:05.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 0x7f888c06e0c0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f889c013160 tx=0x7f889c038000 comp rx=0 tx=0).stop 2024-03-18T22:40:05.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 msgr2=0x7f88ac0cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:05.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 0x7f88ac0cbee0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88a000d520 tx=0x7f88a000d9e0 comp rx=0 tx=0).stop 2024-03-18T22:40:05.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 shutdown_connections 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f88ac0cc420 0x7f88ac1f2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f888c06bc00 0x7f888c06e0c0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f88ac0cba60 0x7f88ac0cbee0 secure :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f88a000d520 tx=0x7f88a000d9e0 comp rx=0 tx=0).stop 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 --2- 172.21.15.152:0/3856414116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8894003a20 0x7f88ac152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 >> 172.21.15.152:0/3856414116 conn(0x7f88ac0d4060 msgr2=0x7f88ac06c930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 shutdown_connections 2024-03-18T22:40:05.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:05.890+0000 7f88b0fb5640 1 -- 172.21.15.152:0/3856414116 wait complete. 2024-03-18T22:40:05.907 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.297+0000 7fdca183f640 1 Processor -- start 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.297+0000 7fdca183f640 1 -- start start 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc9c08b9e0 0x7fdc9c0b4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fdc9c06cc70 0x7fdc9c16e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c08bdc0 con 0x7fdc9c08b9e0 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fdc9c06d230 con 0x7fdc9c06cc70 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdca183f640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c06d510 con 0x7fdc9c16ef10 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdc9b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43064/0 (socket says 172.21.15.152:43064) 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdc9b7fe640 1 -- 172.21.15.152:0/1488008969 learned_addr learned my addr 172.21.15.152:0/1488008969 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:06.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.299+0000 7fdc9a7fc640 1 --2- 172.21.15.152:0/1488008969 >> v2:172.21.15.186:3300/0 conn(0x7fdc9c06cc70 0x7fdc9c16e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.300+0000 7fdc9b7fe640 1 -- 172.21.15.152:0/1488008969 >> v2:172.21.15.186:3300/0 conn(0x7fdc9c06cc70 msgr2=0x7fdc9c16e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.300+0000 7fdc9b7fe640 1 --2- 172.21.15.152:0/1488008969 >> v2:172.21.15.186:3300/0 conn(0x7fdc9c06cc70 0x7fdc9c16e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.300+0000 7fdc9b7fe640 1 -- 172.21.15.152:0/1488008969 >> v2:172.21.15.152:3300/0 conn(0x7fdc9c08b9e0 msgr2=0x7fdc9c0b4ca0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.300+0000 7fdc9b7fe640 1 --2- 172.21.15.152:0/1488008969 >> v2:172.21.15.152:3300/0 conn(0x7fdc9c08b9e0 0x7fdc9c0b4ca0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.300+0000 7fdc9b7fe640 1 -- 172.21.15.152:0/1488008969 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c06d7f0 con 0x7fdc9c16ef10 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.301+0000 7fdc9b7fe640 1 --2- 172.21.15.152:0/1488008969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0b4a10 tx=0x7fdc8c02b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b28876106fdf5697 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.301+0000 7fdc99ffb640 1 -- 172.21.15.152:0/1488008969 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c035020 con 0x7fdc9c16ef10 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.301+0000 7fdc99ffb640 1 -- 172.21.15.152:0/1488008969 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc8c031890 con 0x7fdc9c16ef10 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.301+0000 7fdc99ffb640 1 -- 172.21.15.152:0/1488008969 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc8c031c60 con 0x7fdc9c16ef10 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 -- 172.21.15.152:0/1488008969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 msgr2=0x7fdc9c16f380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 --2- 172.21.15.152:0/1488008969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c0b4a10 tx=0x7fdc8c02b930 comp rx=0 tx=0).stop 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 -- 172.21.15.152:0/1488008969 shutdown_connections 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 --2- 172.21.15.152:0/1488008969 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c16ef10 0x7fdc9c16f380 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 --2- 172.21.15.152:0/1488008969 >> v2:172.21.15.186:3300/0 conn(0x7fdc9c06cc70 0x7fdc9c16e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 --2- 172.21.15.152:0/1488008969 >> v2:172.21.15.152:3300/0 conn(0x7fdc9c08b9e0 0x7fdc9c0b4ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.302+0000 7fdca183f640 1 -- 172.21.15.152:0/1488008969 >> 172.21.15.152:0/1488008969 conn(0x7fdc9c06b1c0 msgr2=0x7fdc9c06b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:06.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.306+0000 7fdca183f640 1 -- 172.21.15.152:0/1488008969 shutdown_connections 2024-03-18T22:40:06.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.309+0000 7fdca183f640 1 -- 172.21.15.152:0/1488008969 wait complete. 2024-03-18T22:40:06.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.313+0000 7fdca183f640 1 Processor -- start 2024-03-18T22:40:06.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.313+0000 7fdca183f640 1 -- start start 2024-03-18T22:40:06.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdc9affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 0x7fdc9c161500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdc9affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56224/0 (socket says 172.21.15.152:56224) 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc9c16ef10 0x7fdc9c161a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdc9affd640 1 -- 172.21.15.152:0/4164257636 learned_addr learned my addr 172.21.15.152:0/4164257636 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0b2d30 con 0x7fdc9c06cc70 2024-03-18T22:40:06.317 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdc9c0d04f0 con 0x7fdc9c16ef10 2024-03-18T22:40:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc9c0b2eb0 con 0x7fdc9c08b9e0 2024-03-18T22:40:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdc9a7fc640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 0x7fdc9c161500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.318 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.316+0000 7fdc9b7fe640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc9c16ef10 0x7fdc9c161a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9affd640 1 -- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 msgr2=0x7fdc9c161500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9affd640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 0x7fdc9c161500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9affd640 1 -- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc9c16ef10 msgr2=0x7fdc9c161a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9affd640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc9c16ef10 0x7fdc9c161a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:06.319 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9affd640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc9c16b4d0 con 0x7fdc9c06cc70 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.317+0000 7fdc9a7fc640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 0x7fdc9c161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdc9affd640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400ba50 tx=0x7fdc9400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94019070 con 0x7fdc9c06cc70 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc9c1607d0 con 0x7fdc9c06cc70 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc9400cc20 con 0x7fdc9c06cc70 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc94014440 con 0x7fdc9c06cc70 2024-03-18T22:40:06.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.318+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc9c16b770 con 0x7fdc9c06cc70 2024-03-18T22:40:06.323 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.322+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc7c005290 con 0x7fdc9c06cc70 2024-03-18T22:40:06.324 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.323+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdc9401c070 con 0x7fdc9c06cc70 2024-03-18T22:40:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.325+0000 7fdc83fff640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 0x7fdc8806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:06.325 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.325+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5709+0+0 (secure 0 0 0) 0x7fdc9408a740 con 0x7fdc9c06cc70 2024-03-18T22:40:06.326 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.326+0000 7fdc9a7fc640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 0x7fdc8806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:06.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.327+0000 7fdc9a7fc640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 0x7fdc8806e090 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c09de60 tx=0x7fdc90008040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:06.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:06.349+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdc94058b60 con 0x7fdc9c06cc70 2024-03-18T22:40:07.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.474+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fdc7c005850 con 0x7fdc9c06cc70 2024-03-18T22:40:07.511 INFO:tasks.ceph.mon.a.smithi152.stderr:2024-03-18T22:40:07.476+0000 7f8051411640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.479+0000 7fdc83fff640 1 -- 172.21.15.152:0/4164257636 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) ==== 161+0+0 (secure 0 0 0) 0x7fdc9405cc00 con 0x7fdc9c06cc70 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.498+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 msgr2=0x7fdc8806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.498+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 0x7fdc8806e090 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7fdc9c09de60 tx=0x7fdc90008040 comp rx=0 tx=0).stop 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.499+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 msgr2=0x7fdc9c15f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.499+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 secure :-1 s=READY pgs=3289 cs=0 l=1 rev1=1 crypto rx=0x7fdc9400ba50 tx=0x7fdc9400bf10 comp rx=0 tx=0).stop 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.500+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 shutdown_connections 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.500+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc9c16ef10 0x7fdc9c161a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.500+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc8806bbd0 0x7fdc8806e090 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.513 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.500+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc9c08b9e0 0x7fdc9c161500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.500+0000 7fdca183f640 1 --2- 172.21.15.152:0/4164257636 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc9c06cc70 0x7fdc9c15f020 unknown :-1 s=CLOSED pgs=3289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.501+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 >> 172.21.15.152:0/4164257636 conn(0x7fdc9c06b1c0 msgr2=0x7fdc9c0af5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:07.514 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.514+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 shutdown_connections 2024-03-18T22:40:07.515 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.514+0000 7fdca183f640 1 -- 172.21.15.152:0/4164257636 wait complete. 2024-03-18T22:40:07.533 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-03-18T22:40:07.663 INFO:tasks.ceph.mds.c.smithi152.stdout:starting mds.c at 2024-03-18T22:40:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.800+0000 7f5dc975b640 1 Processor -- start 2024-03-18T22:40:07.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.800+0000 7f5dc975b640 1 -- start start 2024-03-18T22:40:07.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc975b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5dc4161890 0x7f5dc40d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc975b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc40d1070 0x7f5dc40b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc975b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5dc40cffe0 con 0x7f5dc40b4ec0 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc975b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f5dc40cfa20 con 0x7f5dc4161890 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc975b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc40cfd00 con 0x7f5dc40d1070 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc2ffd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f5dc4161890 0x7f5dc40d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc27fc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f5dc40b4ec0 0x7f5dc40d0960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33660/0 (socket says 172.21.15.152:33660) 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc27fc640 1 -- 172.21.15.152:0/3808053543 learned_addr learned my addr 172.21.15.152:0/3808053543 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.802+0000 7f5dc37fe640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc40d1070 0x7f5dc40b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.803+0000 7f5dc2ffd640 1 -- 172.21.15.152:0/3808053543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc40d1070 msgr2=0x7f5dc40b6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.803+0000 7f5dc2ffd640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc40d1070 0x7f5dc40b6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.803+0000 7f5dc2ffd640 1 -- 172.21.15.152:0/3808053543 >> v1:172.21.15.152:6789/0 conn(0x7f5dc40b4ec0 legacy=0x7f5dc40d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.804 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.803+0000 7f5dc2ffd640 1 -- 172.21.15.152:0/3808053543 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc40cf710 con 0x7f5dc4161890 2024-03-18T22:40:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.804+0000 7f5dc2ffd640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4161890 0x7f5dc40d4bb0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491bf4c970593056 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.804+0000 7f5dc1ffb640 1 -- 172.21.15.152:0/3808053543 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4035020 con 0x7f5dc4161890 2024-03-18T22:40:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.804+0000 7f5dc1ffb640 1 -- 172.21.15.152:0/3808053543 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db4031810 con 0x7f5dc4161890 2024-03-18T22:40:07.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.804+0000 7f5dc1ffb640 1 -- 172.21.15.152:0/3808053543 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db4031be0 con 0x7f5dc4161890 2024-03-18T22:40:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 -- 172.21.15.152:0/3808053543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4161890 msgr2=0x7f5dc40d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4161890 0x7f5dc40d4bb0 secure :-1 s=READY pgs=3293 cs=0 l=1 rev1=1 crypto rx=0x7f5db40097a0 tx=0x7f5db402b8b0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 -- 172.21.15.152:0/3808053543 shutdown_connections 2024-03-18T22:40:07.806 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc40d1070 0x7f5dc40b6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 --2- 172.21.15.152:0/3808053543 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc4161890 0x7f5dc40d4bb0 unknown :-1 s=CLOSED pgs=3293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 -- 172.21.15.152:0/3808053543 >> 172.21.15.152:0/3808053543 conn(0x7f5dc40d4090 msgr2=0x7f5dc40d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.805+0000 7f5dc975b640 1 -- 172.21.15.152:0/3808053543 shutdown_connections 2024-03-18T22:40:07.807 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.806+0000 7f5dc975b640 1 -- 172.21.15.152:0/3808053543 wait complete. 2024-03-18T22:40:07.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.809+0000 7f5dc975b640 1 Processor -- start 2024-03-18T22:40:07.809 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.809+0000 7f5dc975b640 1 -- start start 2024-03-18T22:40:07.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 0x7f5dc415de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 0x7f5dc415a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 0x7f5dc41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc40d2220 con 0x7f5dc40b4ec0 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5dc40b5580 con 0x7f5dc40d1070 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc975b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5dc40d23a0 con 0x7f5dc4161890 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 0x7f5dc415de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 0x7f5dc415de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56254/0 (socket says 172.21.15.152:56254) 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.811+0000 7f5dc2ffd640 1 -- 172.21.15.152:0/2053421029 learned_addr learned my addr 172.21.15.152:0/2053421029 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 0x7f5dc415a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc37fe640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 0x7f5dc41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 -- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 msgr2=0x7f5dc41579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 0x7f5dc41579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 -- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 msgr2=0x7f5dc415de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 0x7f5dc415de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 -- 172.21.15.152:0/2053421029 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dc41f5af0 con 0x7f5dc40d1070 2024-03-18T22:40:07.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc37fe640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 0x7f5dc41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.812+0000 7f5dc27fc640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 0x7f5dc415a810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db800c800 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.813+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8017070 con 0x7f5dc40d1070 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.813+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5db8005ce0 con 0x7f5dc40d1070 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.813+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dc41f5dd0 con 0x7f5dc40d1070 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.813+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5db8007310 con 0x7f5dc40d1070 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.813+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dc41f6390 con 0x7f5dc40d1070 2024-03-18T22:40:07.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.815+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dc4072db0 con 0x7f5dc40d1070 2024-03-18T22:40:07.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.816+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5db801a070 con 0x7f5dc40d1070 2024-03-18T22:40:07.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.816+0000 7f5dab7fe640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 0x7f5db006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:07.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.817+0000 7f5dc2ffd640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 0x7f5db006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:07.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.817+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f5db8089e00 con 0x7f5dc40d1070 2024-03-18T22:40:07.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.817+0000 7f5dc2ffd640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 0x7f5db006e090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5db402b8f0 tx=0x7f5db403c040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:07.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:07.821+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5dc4072db0 con 0x7f5dc40d1070 2024-03-18T22:40:08.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.476+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f5dc404f540 con 0x7f5dc40d1070 2024-03-18T22:40:08.489 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.489+0000 7f5dab7fe640 1 -- 172.21.15.152:0/2053421029 <== mon.1 v2:172.21.15.186:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) ==== 104+0+0 (secure 0 0 0) 0x7f5db80581a0 con 0x7f5dc40d1070 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 msgr2=0x7f5db006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 0x7f5db006e090 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f5db402b8f0 tx=0x7f5db403c040 comp rx=0 tx=0).stop 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 msgr2=0x7f5dc415a810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 0x7f5dc415a810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5db8000f60 tx=0x7f5db800c800 comp rx=0 tx=0).stop 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 shutdown_connections 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5db006bbd0 0x7f5db006e090 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5dc4161890 0x7f5dc41579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.496 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5dc40d1070 0x7f5dc415a810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 --2- 172.21.15.152:0/2053421029 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5dc40b4ec0 0x7f5dc415de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 >> 172.21.15.152:0/2053421029 conn(0x7f5dc40d4090 msgr2=0x7f5dc40b8030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:08.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 shutdown_connections 2024-03-18T22:40:08.497 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.495+0000 7f5dc975b640 1 -- 172.21.15.152:0/2053421029 wait complete. 2024-03-18T22:40:08.521 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-03-18T22:40:08.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.692+0000 7f53d9710640 1 Processor -- start 2024-03-18T22:40:08.693 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.692+0000 7f53d9710640 1 -- start start 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f53d415e490 0x7f53d40cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 0x7f53d40d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d40d16c0 0x7f53d40d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f53d40d06b0 con 0x7f53d40cfbe0 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f53d40d1230 con 0x7f53d415e490 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d9710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f53d415e870 con 0x7f53d40d16c0 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d27fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 0x7f53d40d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d2ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f53d415e490 0x7f53d40cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d2ffd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f53d415e490 0x7f53d40cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:45384/0 (socket says 172.21.15.152:45384) 2024-03-18T22:40:08.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d27fc640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 0x7f53d40d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56264/0 (socket says 172.21.15.152:56264) 2024-03-18T22:40:08.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d2ffd640 1 -- 172.21.15.152:0/1229382024 learned_addr learned my addr 172.21.15.152:0/1229382024 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:08.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.694+0000 7f53d37fe640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d40d16c0 0x7f53d40d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.695+0000 7f53d2ffd640 1 -- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d40d16c0 msgr2=0x7f53d40d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.695+0000 7f53d2ffd640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d40d16c0 0x7f53d40d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.695+0000 7f53d2ffd640 1 -- 172.21.15.152:0/1229382024 >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 msgr2=0x7f53d40d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.695+0000 7f53d2ffd640 1 --2- 172.21.15.152:0/1229382024 >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 0x7f53d40d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.695+0000 7f53d2ffd640 1 -- 172.21.15.152:0/1229382024 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40d0900 con 0x7f53d415e490 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.696+0000 7f53d2ffd640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d415e490 0x7f53d40cf6a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b6bc0 tx=0x7f53cc02be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb161b1c4446ed5e server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.696+0000 7f53d1ffb640 1 -- 172.21.15.152:0/1229382024 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc02c9e0 con 0x7f53d415e490 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.696+0000 7f53d1ffb640 1 -- 172.21.15.152:0/1229382024 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53cc02cb80 con 0x7f53d415e490 2024-03-18T22:40:08.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.696+0000 7f53d1ffb640 1 -- 172.21.15.152:0/1229382024 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53cc0343f0 con 0x7f53d415e490 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 -- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d415e490 msgr2=0x7f53d40cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d415e490 0x7f53d40cf6a0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f53d40b6bc0 tx=0x7f53cc02be40 comp rx=0 tx=0).stop 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 -- 172.21.15.152:0/1229382024 shutdown_connections 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d40d16c0 0x7f53d40d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 --2- 172.21.15.152:0/1229382024 >> v2:172.21.15.152:3300/0 conn(0x7f53d40cfbe0 0x7f53d40d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 --2- 172.21.15.152:0/1229382024 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d415e490 0x7f53d40cf6a0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 -- 172.21.15.152:0/1229382024 >> 172.21.15.152:0/1229382024 conn(0x7f53d40d4080 msgr2=0x7f53d40d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:08.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 -- 172.21.15.152:0/1229382024 shutdown_connections 2024-03-18T22:40:08.699 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.697+0000 7f53d9710640 1 -- 172.21.15.152:0/1229382024 wait complete. 2024-03-18T22:40:08.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.701+0000 7f53d9710640 1 Processor -- start 2024-03-18T22:40:08.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.701+0000 7f53d9710640 1 -- start start 2024-03-18T22:40:08.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53d40cfbe0 0x7f53d4153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d40d16c0 0x7f53d4160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40d2220 con 0x7f53d40cfbe0 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f53d40d0ec0 con 0x7f53d40d16c0 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d9710640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f53d40d23a0 con 0x7f53d415e490 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43130/0 (socket says 172.21.15.152:43130) 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d2ffd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53d40cfbe0 0x7f53d4153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 -- 172.21.15.152:0/1170065433 learned_addr learned my addr 172.21.15.152:0/1170065433 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d27fc640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d40d16c0 0x7f53d4160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 -- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d40d16c0 msgr2=0x7f53d4160c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d40d16c0 0x7f53d4160c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 -- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53d40cfbe0 msgr2=0x7f53d4153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53d40cfbe0 0x7f53d4153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:08.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.703+0000 7f53d37fe640 1 -- 172.21.15.152:0/1170065433 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d40cd800 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53d37fe640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e930 tx=0x7f53c400edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c4017070 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53c400c980 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53d40cdae0 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53c400cd70 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.704+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f53d40ce0a0 con 0x7f53d415e490 2024-03-18T22:40:08.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.706+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53d404f540 con 0x7f53d415e490 2024-03-18T22:40:08.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.707+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f53c401a070 con 0x7f53d415e490 2024-03-18T22:40:08.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.708+0000 7f53cb7fe640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 0x7f53b406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:08.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.708+0000 7f53d2ffd640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 0x7f53b406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:08.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.708+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(36..36 src has 1..36) ==== 5795+0+0 (secure 0 0 0) 0x7f53c408ad30 con 0x7f53d415e490 2024-03-18T22:40:08.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.709+0000 7f53d2ffd640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 0x7f53b406e090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f53cc035000 tx=0x7f53cc030000 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:08.712 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:08.712+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f53c40592c0 con 0x7f53d415e490 2024-03-18T22:40:09.247 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:09.247+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f53d40d3e60 con 0x7f53d415e490 2024-03-18T22:40:10.145 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.144+0000 7f53cb7fe640 1 -- 172.21.15.152:0/1170065433 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) ==== 181+0+0 (secure 0 0 0) 0x7f53c405d360 con 0x7f53d415e490 2024-03-18T22:40:10.146 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_metadata' removed 2024-03-18T22:40:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 msgr2=0x7f53b406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 0x7f53b406e090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f53cc035000 tx=0x7f53cc030000 comp rx=0 tx=0).stop 2024-03-18T22:40:10.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 msgr2=0x7f53d41611c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f53c400e930 tx=0x7f53c400edf0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 shutdown_connections 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f53b406bbd0 0x7f53b406e090 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f53d415e490 0x7f53d41611c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f53d40d16c0 0x7f53d4160c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.151+0000 7f53d9710640 1 --2- 172.21.15.152:0/1170065433 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f53d40cfbe0 0x7f53d4153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.152+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 >> 172.21.15.152:0/1170065433 conn(0x7f53d40d4080 msgr2=0x7f53d40b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.152+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 shutdown_connections 2024-03-18T22:40:10.153 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.152+0000 7f53d9710640 1 -- 172.21.15.152:0/1170065433 wait complete. 2024-03-18T22:40:10.173 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-03-18T22:40:10.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.469+0000 7f6a141d4640 1 Processor -- start 2024-03-18T22:40:10.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.469+0000 7f6a141d4640 1 -- start start 2024-03-18T22:40:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.471+0000 7f6a141d4640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6a0c0d0420 0x7f6a0c0d0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.471+0000 7f6a141d4640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6a0c0c5f70 0x7f6a0c0c6400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.471+0000 7f6a141d4640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a0c0d0d40 con 0x7f6a0c0c6940 2024-03-18T22:40:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.471+0000 7f6a141d4640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0c067d90 con 0x7f6a0c0d0420 2024-03-18T22:40:10.472 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.471+0000 7f6a141d4640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6a0c0cfbd0 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a12771640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6a0c0c6940 0x7f6a0c0cca50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:33674/0 (socket says 172.21.15.152:33674) 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a12771640 1 -- 172.21.15.152:0/1285301883 learned_addr learned my addr 172.21.15.152:0/1285301883 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a11f70640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f6a0c0d0420 0x7f6a0c0d0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a1176f640 1 --2- 172.21.15.152:0/1285301883 >> v2:172.21.15.186:3300/0 conn(0x7f6a0c0c5f70 0x7f6a0c0c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a10f6e640 1 -- 172.21.15.152:0/1285301883 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1181593955 0 0) 0x7f6a0c0d0d40 con 0x7f6a0c0c6940 2024-03-18T22:40:10.473 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a10f6e640 1 -- 172.21.15.152:0/1285301883 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69f8003520 con 0x7f6a0c0c6940 2024-03-18T22:40:10.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a1176f640 1 -- 172.21.15.152:0/1285301883 >> v2:172.21.15.152:3300/0 conn(0x7f6a0c0d0420 msgr2=0x7f6a0c0d0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:10.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a1176f640 1 --2- 172.21.15.152:0/1285301883 >> v2:172.21.15.152:3300/0 conn(0x7f6a0c0d0420 0x7f6a0c0d0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a1176f640 1 -- 172.21.15.152:0/1285301883 >> v1:172.21.15.152:6789/0 conn(0x7f6a0c0c6940 legacy=0x7f6a0c0cca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.474 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.472+0000 7f6a1176f640 1 -- 172.21.15.152:0/1285301883 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c0cfeb0 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.474+0000 7f6a1176f640 1 --2- 172.21.15.152:0/1285301883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c0c6400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c072410 tx=0x7f69fc02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=79fc1cff45bbf99 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:10.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.475+0000 7f6a10f6e640 1 -- 172.21.15.152:0/1285301883 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc035020 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.475+0000 7f6a10f6e640 1 -- 172.21.15.152:0/1285301883 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69fc031830 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.475 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.475+0000 7f6a10f6e640 1 -- 172.21.15.152:0/1285301883 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69fc031be0 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 -- 172.21.15.152:0/1285301883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 msgr2=0x7f6a0c0c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1285301883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c0c6400 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c072410 tx=0x7f69fc02b8d0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 -- 172.21.15.152:0/1285301883 shutdown_connections 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1285301883 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c0c6400 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1285301883 >> v2:172.21.15.152:3300/0 conn(0x7f6a0c0d0420 0x7f6a0c0d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 -- 172.21.15.152:0/1285301883 >> 172.21.15.152:0/1285301883 conn(0x7f6a0c0d1e60 msgr2=0x7f6a0c0d2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 -- 172.21.15.152:0/1285301883 shutdown_connections 2024-03-18T22:40:10.477 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.476+0000 7f6a141d4640 1 -- 172.21.15.152:0/1285301883 wait complete. 2024-03-18T22:40:10.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.479+0000 7f6a141d4640 1 Processor -- start 2024-03-18T22:40:10.480 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.480+0000 7f6a141d4640 1 -- start start 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.481+0000 7f6a141d4640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c158600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.481+0000 7f6a141d4640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a0c0c6940 0x7f6a0c0b6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a141d4640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a141d4640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0d2980 con 0x7f6a0c0c6940 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a141d4640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6a0c0c5a50 con 0x7f6a0c0c5f70 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a141d4640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6a0c0d2b00 con 0x7f6a0c0d0420 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a11f70640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c158600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a1176f640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a0c0c6940 0x7f6a0c0b6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43144/0 (socket says 172.21.15.152:43144) 2024-03-18T22:40:10.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 -- 172.21.15.152:0/1383132563 learned_addr learned my addr 172.21.15.152:0/1383132563 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 -- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 msgr2=0x7f6a0c158600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c158600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 -- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a0c0c6940 msgr2=0x7f6a0c0b6e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a0c0c6940 0x7f6a0c0b6e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 -- 172.21.15.152:0/1383132563 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a0c15c740 con 0x7f6a0c0d0420 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.482+0000 7f6a12771640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cb40 tx=0x7f6a0400a060 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:10.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.483+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04017070 con 0x7f6a0c0d0420 2024-03-18T22:40:10.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.483+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0400aca0 con 0x7f6a0c0d0420 2024-03-18T22:40:10.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.483+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a04012620 con 0x7f6a0c0d0420 2024-03-18T22:40:10.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.483+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a0c1f2ab0 con 0x7f6a0c0d0420 2024-03-18T22:40:10.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.483+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a0c1f1fd0 con 0x7f6a0c0d0420 2024-03-18T22:40:10.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.485+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a0c069130 con 0x7f6a0c0d0420 2024-03-18T22:40:10.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.486+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6a0401a070 con 0x7f6a0c0d0420 2024-03-18T22:40:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.486+0000 7f6a027fc640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.486+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(37..37 src has 1..37) ==== 5357+0+0 (secure 0 0 0) 0x7f6a0408a6c0 con 0x7f6a0c0d0420 2024-03-18T22:40:10.487 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.486+0000 7f6a11f70640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:10.488 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.487+0000 7f6a11f70640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 0x7f69f006e090 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0cddb0 tx=0x7f6a08009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:10.491 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:10.491+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6a0c069130 con 0x7f6a0c0d0420 2024-03-18T22:40:11.093 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.093+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f6a0c158b40 con 0x7f6a0c0d0420 2024-03-18T22:40:11.152 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.151+0000 7f6a027fc640 1 -- 172.21.15.152:0/1383132563 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) ==== 169+0+0 (secure 0 0 0) 0x7f6a0c15c740 con 0x7f6a0c0d0420 2024-03-18T22:40:11.156 INFO:teuthology.orchestra.run.smithi152.stderr:pool 'cephfs_data' removed 2024-03-18T22:40:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.159+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 msgr2=0x7f69f006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.159+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 0x7f69f006e090 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0cddb0 tx=0x7f6a08009190 comp rx=0 tx=0).stop 2024-03-18T22:40:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.159+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 msgr2=0x7f6a0c0b73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:11.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.159+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a0400cb40 tx=0x7f6a0400a060 comp rx=0 tx=0).stop 2024-03-18T22:40:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 shutdown_connections 2024-03-18T22:40:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f69f006bbd0 0x7f69f006e090 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.162 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6a0c0d0420 0x7f6a0c0b73c0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6a0c0c6940 0x7f6a0c0b6e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 --2- 172.21.15.152:0/1383132563 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6a0c0c5f70 0x7f6a0c158600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 >> 172.21.15.152:0/1383132563 conn(0x7f6a0c0d1e60 msgr2=0x7f6a0c0d2240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 shutdown_connections 2024-03-18T22:40:11.163 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.160+0000 7f6a141d4640 1 -- 172.21.15.152:0/1383132563 wait complete. 2024-03-18T22:40:11.202 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2024-03-18T22:40:11.629 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.629+0000 7f4d0740b640 1 Processor -- start 2024-03-18T22:40:11.630 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.629+0000 7f4d0740b640 1 -- start start 2024-03-18T22:40:11.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.630+0000 7f4d0740b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4d000ce100 0x7f4d0006ec30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.630+0000 7f4d0740b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000ca940 0x7f4d000cad90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.631 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.630+0000 7f4d0740b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d0015aa30 con 0x7f4d000cd7c0 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.630+0000 7f4d0740b640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f4d0006d4d0 con 0x7f4d000ce100 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.630+0000 7f4d0740b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4d0006e7a0 con 0x7f4d000ca940 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.631+0000 7f4d049a6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4d000ce100 0x7f4d0006ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.631+0000 7f4d049a6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f4d000ce100 0x7f4d0006ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47474/0 (socket says 172.21.15.152:47474) 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.631+0000 7f4d049a6640 1 -- 172.21.15.152:0/2679119570 learned_addr learned my addr 172.21.15.152:0/2679119570 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:11.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.631+0000 7f4d059a8640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000ca940 0x7f4d000cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.631+0000 7f4d049a6640 1 -- 172.21.15.152:0/2679119570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000ca940 msgr2=0x7f4d000cad90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:11.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.632+0000 7f4d049a6640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000ca940 0x7f4d000cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.632+0000 7f4d049a6640 1 -- 172.21.15.152:0/2679119570 >> v1:172.21.15.186:6789/0 conn(0x7f4d000cd7c0 legacy=0x7f4d0006cdc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:11.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.632+0000 7f4d049a6640 1 -- 172.21.15.152:0/2679119570 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d0006e190 con 0x7f4d000ce100 2024-03-18T22:40:11.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.633+0000 7f4d049a6640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ce100 0x7f4d0006ec30 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009870 tx=0x7f4cfc02b7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=967ae1c96111c6a5 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:11.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.633+0000 7f4cf7fff640 1 -- 172.21.15.152:0/2679119570 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc038070 con 0x7f4d000ce100 2024-03-18T22:40:11.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.633+0000 7f4cf7fff640 1 -- 172.21.15.152:0/2679119570 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc033620 con 0x7f4d000ce100 2024-03-18T22:40:11.634 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.633+0000 7f4cf7fff640 1 -- 172.21.15.152:0/2679119570 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc0339f0 con 0x7f4d000ce100 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 -- 172.21.15.152:0/2679119570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ce100 msgr2=0x7f4d0006ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ce100 0x7f4d0006ec30 secure :-1 s=READY pgs=3295 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc009870 tx=0x7f4cfc02b7d0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 -- 172.21.15.152:0/2679119570 shutdown_connections 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000ca940 0x7f4d000cad90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 --2- 172.21.15.152:0/2679119570 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ce100 0x7f4d0006ec30 unknown :-1 s=CLOSED pgs=3295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.635 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.634+0000 7f4d0740b640 1 -- 172.21.15.152:0/2679119570 >> 172.21.15.152:0/2679119570 conn(0x7f4d000cfbf0 msgr2=0x7f4d000cffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:11.637 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.636+0000 7f4d0740b640 1 -- 172.21.15.152:0/2679119570 shutdown_connections 2024-03-18T22:40:11.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.636+0000 7f4d0740b640 1 -- 172.21.15.152:0/2679119570 wait complete. 2024-03-18T22:40:11.638 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.638+0000 7f4d0740b640 1 Processor -- start 2024-03-18T22:40:11.639 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.638+0000 7f4d0740b640 1 -- start start 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ca940 0x7f4d00200dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 0x7f4d00142d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f4d000ce9a0 con 0x7f4d000ca940 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f4d0006e430 con 0x7f4d000b4150 2024-03-18T22:40:11.640 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.639+0000 7f4d0740b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f4d000cc260 con 0x7f4d000cd7c0 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d059a8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 0x7f4d00142d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:48118/0 (socket says 172.21.15.152:48118) 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 -- 172.21.15.152:0/1335848464 learned_addr learned my addr 172.21.15.152:0/1335848464 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d059a8640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 0x7f4d00142d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50234/0 (socket says 172.21.15.152:50234) 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d051a7640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ca940 0x7f4d00200dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.641 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 -- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 msgr2=0x7f4d00142d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 0x7f4d00142d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 -- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ca940 msgr2=0x7f4d00200dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ca940 0x7f4d00200dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.640+0000 7f4d049a6640 1 -- 172.21.15.152:0/1335848464 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d00201310 con 0x7f4d000cd7c0 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.641+0000 7f4d049a6640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc02bde0 tx=0x7f4cfc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:11.642 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.641+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc038040 con 0x7f4d000cd7c0 2024-03-18T22:40:11.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.642+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d000b4940 con 0x7f4d000cd7c0 2024-03-18T22:40:11.646 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.642+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d000b4f00 con 0x7f4d000cd7c0 2024-03-18T22:40:11.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.646+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cfc004250 con 0x7f4d000cd7c0 2024-03-18T22:40:11.647 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.646+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cfc03d670 con 0x7f4d000cd7c0 2024-03-18T22:40:11.649 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.649+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ce0005290 con 0x7f4d000cd7c0 2024-03-18T22:40:11.653 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.652+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f4cfc03b070 con 0x7f4d000cd7c0 2024-03-18T22:40:11.654 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.654+0000 7f4cf5ffb640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 0x7f4ce406e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.654+0000 7f4d051a7640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 0x7f4ce406e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:11.655 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.655+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f4cfc0ac0a0 con 0x7f4d000cd7c0 2024-03-18T22:40:11.657 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.656+0000 7f4d051a7640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 0x7f4ce406e190 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006fd0 tx=0x7f4cf00090e0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:11.662 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:11.661+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f4d00201310 con 0x7f4d000cd7c0 2024-03-18T22:40:12.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.715+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) -- 0x7f4ce0005d90 con 0x7f4d000cd7c0 2024-03-18T22:40:12.727 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.726+0000 7f4cf5ffb640 1 -- 172.21.15.152:0/1335848464 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) ==== 104+0+0 (secure 0 0 0) 0x7f4cfc042020 con 0x7f4d000cd7c0 2024-03-18T22:40:12.736 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 msgr2=0x7f4ce406e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 0x7f4ce406e190 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006fd0 tx=0x7f4cf00090e0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 msgr2=0x7f4d000b3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4cfc02bde0 tx=0x7f4cfc0046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 shutdown_connections 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f4d000b4150 0x7f4d00142d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f4ce406bcd0 0x7f4ce406e190 secure :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f4cf0006fd0 tx=0x7f4cf00090e0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f4d000cd7c0 0x7f4d000b3c10 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 --2- 172.21.15.152:0/1335848464 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f4d000ca940 0x7f4d00200dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:12.737 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.735+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 >> 172.21.15.152:0/1335848464 conn(0x7f4d000cfbf0 msgr2=0x7f4d000b0f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:12.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.736+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 shutdown_connections 2024-03-18T22:40:12.738 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:12.737+0000 7f4d0740b640 1 -- 172.21.15.152:0/1335848464 wait complete. 2024-03-18T22:40:12.780 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2024-03-18T22:40:13.231 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.230+0000 7f76d0174640 1 Processor -- start 2024-03-18T22:40:13.235 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.235+0000 7f76d0174640 1 -- start start 2024-03-18T22:40:13.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76d0174640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f76c80d07f0 0x7f76c806cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76d0174640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c815ee60 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76d0174640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c815f140 con 0x7f76c80ad800 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76d0174640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f76c80b3b10 con 0x7f76c80d07f0 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76cdf10640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f76c815ad40 0x7f76c80b3400 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34122/0 (socket says 172.21.15.152:34122) 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.236+0000 7f76cdf10640 1 -- 172.21.15.152:0/4133332328 learned_addr learned my addr 172.21.15.152:0/4133332328 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1813581697 0 0) 0x7f76c815ee60 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f76b400bd30 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.0 v1:172.21.15.152:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 41453029 0 0) 0x7f76b400bd30 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 >> v2:172.21.15.186:3300/0 conn(0x7f76c80d07f0 msgr2=0x7f76c806cc70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 --2- 172.21.15.152:0/4133332328 >> v2:172.21.15.186:3300/0 conn(0x7f76c80d07f0 0x7f76c806cc70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 >> v1:172.21.15.186:6789/0 conn(0x7f76c80ad800 legacy=0x7f76c80d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 --> v1:172.21.15.152:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c815f420 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.0 v1:172.21.15.152:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1321760339 0 0) 0x7f76c4001670 con 0x7f76c815ad40 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 >> v1:172.21.15.152:6789/0 conn(0x7f76c815ad40 legacy=0x7f76c80b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76b400c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b400d010 0x7f76b400d490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b400dc20 0x7f76b4009520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76c80b3b10 con 0x7f76b400dc20 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f76b4009e00 con 0x7f76b400d010 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.237+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76b400a000 con 0x7f76b400c280 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76b400c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 -- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b400d010 msgr2=0x7f76b400d490 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76b400d010 0x7f76b400d490 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 -- 172.21.15.152:0/4133332328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b400dc20 msgr2=0x7f76b4009520 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76b400dc20 0x7f76b4009520 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.238+0000 7f76cdf10640 1 -- 172.21.15.152:0/4133332328 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76b400bd30 con 0x7f76b400c280 2024-03-18T22:40:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.241+0000 7f76ce711640 1 -- 172.21.15.152:0/4133332328 reap_dead start 2024-03-18T22:40:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.242+0000 7f76cdf10640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76b400c6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c110 tx=0x7f76b400e040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ffac747f277c4db server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.243+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007c40 con 0x7f76b400c280 2024-03-18T22:40:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.243+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4052070 con 0x7f76b400c280 2024-03-18T22:40:13.244 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.243+0000 7f76ccf0e640 1 -- 172.21.15.152:0/4133332328 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4005d70 con 0x7f76b400c280 2024-03-18T22:40:13.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.244+0000 7f76d0174640 1 -- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 msgr2=0x7f76b400c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:13.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.244+0000 7f76d0174640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76b400c6a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c110 tx=0x7f76b400e040 comp rx=0 tx=0).stop 2024-03-18T22:40:13.254 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.254+0000 7f76d0174640 1 -- 172.21.15.152:0/4133332328 shutdown_connections 2024-03-18T22:40:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.254+0000 7f76d0174640 1 --2- 172.21.15.152:0/4133332328 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76b400c6a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.255 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.254+0000 7f76d0174640 1 -- 172.21.15.152:0/4133332328 >> 172.21.15.152:0/4133332328 conn(0x7f76c806b5e0 msgr2=0x7f76c806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:13.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.260+0000 7f76d0174640 1 -- 172.21.15.152:0/4133332328 shutdown_connections 2024-03-18T22:40:13.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.262+0000 7f76d0174640 1 -- 172.21.15.152:0/4133332328 wait complete. 2024-03-18T22:40:13.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.264+0000 7f76d0174640 1 Processor -- start 2024-03-18T22:40:13.271 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.268+0000 7f76d0174640 1 -- start start 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81e5250 0x7f76c81e56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c80cdb10 0x7f76c80cdf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f76c815b2a0 con 0x7f76c80cdb10 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f76c815b120 con 0x7f76c81e5250 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.269+0000 7f76d0174640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f76c815ea10 con 0x7f76b400c280 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.270+0000 7f76cdf10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.270+0000 7f76cdf10640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:48130/0 (socket says 172.21.15.152:48130) 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.270+0000 7f76cdf10640 1 -- 172.21.15.152:0/318578146 learned_addr learned my addr 172.21.15.152:0/318578146 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.270+0000 7f76cd70f640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81e5250 0x7f76c81e56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.270+0000 7f76ce711640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c80cdb10 0x7f76c80cdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:13.272 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 -- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81e5250 msgr2=0x7f76c81e56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81e5250 0x7f76c81e56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 -- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c80cdb10 msgr2=0x7f76c80cdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c80cdb10 0x7f76c80cdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 -- 172.21.15.152:0/318578146 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c80ce6f0 con 0x7f76b400c280 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.271+0000 7f76cdf10640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c110 tx=0x7f76c815f030 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:13.273 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.272+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4066070 con 0x7f76b400c280 2024-03-18T22:40:13.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.272+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c80ce9d0 con 0x7f76b400c280 2024-03-18T22:40:13.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.272+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c80cef90 con 0x7f76b400c280 2024-03-18T22:40:13.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.274+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76c4000ed0 con 0x7f76b400c280 2024-03-18T22:40:13.274 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.274+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76c4007c40 con 0x7f76b400c280 2024-03-18T22:40:13.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.276+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f76c4007070 con 0x7f76b400c280 2024-03-18T22:40:13.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.276+0000 7f76be7fc640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 0x7f76ac06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:13.277 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.276+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f76c40cd8e0 con 0x7f76b400c280 2024-03-18T22:40:13.281 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.277+0000 7f76cd70f640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 0x7f76ac06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:13.284 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.281+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76b0005290 con 0x7f76b400c280 2024-03-18T22:40:13.288 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.287+0000 7f76cd70f640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 0x7f76ac06e090 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f76c0007fd0 tx=0x7f76c0009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:13.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:13.293+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f76c409c030 con 0x7f76b400c280 2024-03-18T22:40:14.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:14.815+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) -- 0x7f76b0005580 con 0x7f76b400c280 2024-03-18T22:40:15.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.173+0000 7f76be7fc640 1 -- 172.21.15.152:0/318578146 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v13866) ==== 144+0+0 (secure 0 0 0) 0x7f76c40a0080 con 0x7f76b400c280 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 msgr2=0x7f76ac06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 0x7f76ac06e090 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f76c0007fd0 tx=0x7f76c0009040 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 msgr2=0x7f76c80cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76c400c110 tx=0x7f76c815f030 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 shutdown_connections 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f76c80cdb10 0x7f76c80cdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f76c81e5250 0x7f76c81e56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f76ac06bbd0 0x7f76ac06e090 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 --2- 172.21.15.152:0/318578146 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f76b400c280 0x7f76c80cd2d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:15.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 >> 172.21.15.152:0/318578146 conn(0x7f76c806b5e0 msgr2=0x7f76c80b3d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:15.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 shutdown_connections 2024-03-18T22:40:15.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:15.183+0000 7f76d0174640 1 -- 172.21.15.152:0/318578146 wait complete. 2024-03-18T22:40:15.504 INFO:tasks.cephfs_test_runner:test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) ... FAIL 2024-03-18T22:40:15.504 INFO:tasks.cephfs_test_runner: 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner:Ran 1 test in 27534.533s 2024-03-18T22:40:15.505 INFO:tasks.cephfs_test_runner: 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:FAILED (failures=1) 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:====================================================================== 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:FAIL: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/tests_from_xfstests_dev.py", line 12, in test_generic 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: self.run_generic_tests() 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/xfstests_dev.py", line 407, in run_generic_tests 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: return self.run_testdir('generic') 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs/xfstests_dev.py", line 399, in run_testdir 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: self.assertEqual(self.total_tests_failed, 0) 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner:AssertionError: 2 != 0 2024-03-18T22:40:15.506 INFO:tasks.cephfs_test_runner: 2024-03-18T22:40:15.507 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T22:40:17.362 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=e1a996d84b2b4f59811219290cb0a14e Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/github.com_batrick_ceph_4e19f704afd9957ea657ab858f9ecf76401fef6f/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2024-03-18T22:40:17.363 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-03-18T22:40:17.375 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-03-18T22:40:17.410 INFO:tasks.kclient:Unmounting kernel clients... 2024-03-18T22:40:17.410 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T22:40:17.410 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:40:17.414 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:40:17.425 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:40:17.447 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056372,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19578 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T22:40:17.447 DEBUG:teuthology.orchestra.run.smithi152:> set -ex 2024-03-18T22:40:17.447 DEBUG:teuthology.orchestra.run.smithi152:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:40:17.522 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056372,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19578 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497692k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-03-18T22:40:17.522 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T22:40:17.523 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:40:17.540 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T22:40:17.541 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-03-18T22:40:17.541 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-18T22:40:17.628 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056373,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19747 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248844k,nr_inodes=812211,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497696k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-03-18T22:40:17.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.628 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T22:40:17.722 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-03-18T22:40:17.723 INFO:teuthology.orchestra.run.smithi152.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-03-18T22:40:17.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.723 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-03-18T22:40:17.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.785 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-18T22:40:17.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.844 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-03-18T22:40:17.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.934 DEBUG:teuthology.orchestra.run.smithi152:> ip netns list 2024-03-18T22:40:17.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:17.967 DEBUG:teuthology.orchestra.run.smithi152:> sudo ip link delete ceph-brx 2024-03-18T22:40:18.101 INFO:teuthology.orchestra.run.smithi152.stderr:Cannot find device "ceph-brx" 2024-03-18T22:40:18.104 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T22:40:18.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.104 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T22:40:18.169 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-03-18T22:40:18.170 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-03-18T22:40:18.170 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.170 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-03-18T22:40:18.203 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.203 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-18T22:40:18.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.275 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-03-18T22:40:18.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.365 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-03-18T22:40:18.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-18T22:40:18.381 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-03-18T22:40:18.550 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-03-18T22:40:18.551 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T22:40:18.552 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-03-18T22:40:18.561 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-03-18T22:40:18.562 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T22:40:18.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.834+0000 7fd568636640 1 Processor -- start 2024-03-18T22:40:18.835 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.834+0000 7fd568636640 1 -- start start 2024-03-18T22:40:18.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd568636640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 0x7fd5600b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd568636640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd560159cc0 0x7fd5600ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd568636640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd56015fc70 con 0x7fd5601598e0 2024-03-18T22:40:18.836 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd568636640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd5600b3c80 con 0x7fd560159cc0 2024-03-18T22:40:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd568636640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd56015ff50 con 0x7fd5600d07f0 2024-03-18T22:40:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd5663d2640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd5601598e0 0x7fd5600d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:34126/0 (socket says 172.21.15.152:34126) 2024-03-18T22:40:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd5663d2640 1 -- 172.21.15.152:0/93753319 learned_addr learned my addr 172.21.15.152:0/93753319 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd565bd1640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 0x7fd5600b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.837 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.835+0000 7fd566bd3640 1 --2- 172.21.15.152:0/93753319 >> v2:172.21.15.186:3300/0 conn(0x7fd560159cc0 0x7fd5600ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.836+0000 7fd566bd3640 1 -- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 msgr2=0x7fd5600b3740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.836+0000 7fd566bd3640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 0x7fd5600b3740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.836+0000 7fd566bd3640 1 -- 172.21.15.152:0/93753319 >> v1:172.21.15.152:6789/0 conn(0x7fd5601598e0 legacy=0x7fd5600d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:18.838 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.836+0000 7fd566bd3640 1 -- 172.21.15.152:0/93753319 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd560160230 con 0x7fd560159cc0 2024-03-18T22:40:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.836+0000 7fd565bd1640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 0x7fd5600b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.837+0000 7fd566bd3640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd560159cc0 0x7fd5600ae850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55802beb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7014078ea5a9d5e6 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.837+0000 7fd5653d0640 1 -- 172.21.15.152:0/93753319 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558039070 con 0x7fd560159cc0 2024-03-18T22:40:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.837+0000 7fd5653d0640 1 -- 172.21.15.152:0/93753319 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd55802cc60 con 0x7fd560159cc0 2024-03-18T22:40:18.839 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.837+0000 7fd5653d0640 1 -- 172.21.15.152:0/93753319 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558034660 con 0x7fd560159cc0 2024-03-18T22:40:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.838+0000 7fd568636640 1 -- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd560159cc0 msgr2=0x7fd5600ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.838+0000 7fd568636640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd560159cc0 0x7fd5600ae850 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd558009d90 tx=0x7fd55802beb0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 -- 172.21.15.152:0/93753319 shutdown_connections 2024-03-18T22:40:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd560159cc0 0x7fd5600ae850 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 --2- 172.21.15.152:0/93753319 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd5600d07f0 0x7fd5600b3740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 -- 172.21.15.152:0/93753319 >> 172.21.15.152:0/93753319 conn(0x7fd56006b5e0 msgr2=0x7fd56006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 -- 172.21.15.152:0/93753319 shutdown_connections 2024-03-18T22:40:18.841 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.839+0000 7fd568636640 1 -- 172.21.15.152:0/93753319 wait complete. 2024-03-18T22:40:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.842+0000 7fd568636640 1 Processor -- start 2024-03-18T22:40:18.843 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.842+0000 7fd568636640 1 -- start start 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5601598e0 0x7fd56015dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 0x7fd5600b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd56006cc70 con 0x7fd5601598e0 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd5601607f0 con 0x7fd5600d07f0 2024-03-18T22:40:18.845 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.844+0000 7fd568636640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd56006cdf0 con 0x7fd560159cc0 2024-03-18T22:40:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd565bd1640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5601598e0 0x7fd56015dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd5663d2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 0x7fd5600b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd5663d2640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:50272/0 (socket says 172.21.15.152:50272) 2024-03-18T22:40:18.846 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd5663d2640 1 -- 172.21.15.152:0/2119522437 learned_addr learned my addr 172.21.15.152:0/2119522437 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:18.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 -- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 msgr2=0x7fd560150dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:18.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 -- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5601598e0 msgr2=0x7fd56015dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5601598e0 0x7fd56015dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 -- 172.21.15.152:0/2119522437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd560152710 con 0x7fd560159cc0 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd5663d2640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd566bd3640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 0x7fd5600b2520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56006f030 tx=0x7fd558004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.845+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558039050 con 0x7fd560159cc0 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.846+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd558045070 con 0x7fd560159cc0 2024-03-18T22:40:18.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.846+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd560070fa0 con 0x7fd560159cc0 2024-03-18T22:40:18.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.846+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd558009450 con 0x7fd560159cc0 2024-03-18T22:40:18.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.846+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd56015e8a0 con 0x7fd560159cc0 2024-03-18T22:40:18.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.847+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd55803e850 con 0x7fd560159cc0 2024-03-18T22:40:18.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.848+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd56004f5b0 con 0x7fd560159cc0 2024-03-18T22:40:18.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.848+0000 7fd552ffd640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 0x7fd54406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:18.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.848+0000 7fd5663d2640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 0x7fd54406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:18.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.849+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fd5580ad280 con 0x7fd560159cc0 2024-03-18T22:40:18.850 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.849+0000 7fd5663d2640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 0x7fd54406e090 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd554004e60 tx=0x7fd554007f10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:18.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:18.853+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd55807b980 con 0x7fd560159cc0 2024-03-18T22:40:19.381 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.381+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd56006e840 con 0x7fd54406bbd0 2024-03-18T22:40:19.382 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.382+0000 7fd552ffd640 1 -- 172.21.15.152:0/2119522437 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13714 (secure 0 0 0) 0x7fd56006e840 con 0x7fd54406bbd0 2024-03-18T22:40:19.383 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:19.383 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T22:40:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 msgr2=0x7fd54406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 0x7fd54406e090 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd554004e60 tx=0x7fd554007f10 comp rx=0 tx=0).stop 2024-03-18T22:40:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 msgr2=0x7fd5600b2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 0x7fd5600b2520 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd56006f030 tx=0x7fd558004a40 comp rx=0 tx=0).stop 2024-03-18T22:40:19.388 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 shutdown_connections 2024-03-18T22:40:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd54406bbd0 0x7fd54406e090 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd560159cc0 0x7fd5600b2520 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd5601598e0 0x7fd56015dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.389 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 --2- 172.21.15.152:0/2119522437 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd5600d07f0 0x7fd560150dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 >> 172.21.15.152:0/2119522437 conn(0x7fd56006b5e0 msgr2=0x7fd560158aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:19.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 shutdown_connections 2024-03-18T22:40:19.390 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.387+0000 7fd568636640 1 -- 172.21.15.152:0/2119522437 wait complete. 2024-03-18T22:40:19.415 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":13819,"stamp":"2024-03-18T22:40:17.767790+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":73,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":5,"kb":754974720,"kb_used":16010424,"kb_used_data":5230144,"kb_used_omap":38165,"kb_used_meta":10704874,"kb_avail":738964296,"statfs":{"total":773094113280,"available":756699439104,"internally_reserved":0,"allocated":5355667456,"data_stored":5351818046,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39081677,"internal_metadata":10961791283},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":424,"apply_latency_ms":424,"commit_latency_ns":424000000,"apply_latency_ns":424000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38406821171,"num_objects":-27327,"num_object_clones":0,"num_object_copies":-54654,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27327,"num_whiteouts":0,"num_read":-1543567,"num_read_kb":-406269431,"num_write":-3174103,"num_write_kb":-602962392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-1841,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002561"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-18T22:40:11.172663+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T22:40:11.172663+0000","last_peered":"2024-03-18T22:40:11.172663+0000","last_clean":"2024-03-18T22:40:11.172663+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T22:40:11.172663+0000","last_undegraded":"2024-03-18T22:40:11.172663+0000","last_fullsized":"2024-03-18T22:40:11.172663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424514865,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4965168,"kb_used_data":3153984,"kb_used_omap":7727,"kb_used_meta":1766288,"kb_avail":89406672,"statfs":{"total":96636764160,"available":91552432128,"internally_reserved":0,"allocated":3229679616,"data_stored":3228307955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7912914,"internal_metadata":1808679470},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424514913,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1633560,"kb_used_data":13520,"kb_used_omap":2359,"kb_used_meta":1617672,"kb_avail":92738280,"statfs":{"total":96636764160,"available":94963998720,"internally_reserved":0,"allocated":13844480,"data_stored":13563145,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2416376,"internal_metadata":1656496392},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":69,"apply_latency_ms":69,"commit_latency_ns":69000000,"apply_latency_ns":69000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424514896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3482856,"kb_used_data":2059360,"kb_used_omap":6735,"kb_used_meta":1416752,"kb_avail":90888984,"statfs":{"total":96636764160,"available":93070319616,"internally_reserved":0,"allocated":2108784640,"data_stored":2107909335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6897302,"internal_metadata":1450754410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547660,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1275960,"kb_used_data":1004,"kb_used_omap":3582,"kb_used_meta":1271361,"kb_avail":93095880,"statfs":{"total":96636764160,"available":95330181120,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3668584,"internal_metadata":1301874072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129547663,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1262644,"kb_used_data":424,"kb_used_omap":4191,"kb_used_meta":1258016,"kb_avail":93109196,"statfs":{"total":96636764160,"available":95343816704,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4292009,"internal_metadata":1288208983},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129547658,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":917300,"kb_used_data":424,"kb_used_omap":4365,"kb_used_meta":912498,"kb_avail":93454540,"statfs":{"total":96636764160,"available":95697448960,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4469946,"internal_metadata":934398790},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":807732,"kb_used_data":424,"kb_used_omap":7263,"kb_used_meta":800032,"kb_avail":93564108,"statfs":{"total":96636764160,"available":95809646592,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7437455,"internal_metadata":819233649},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580338,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1665204,"kb_used_data":1004,"kb_used_omap":1940,"kb_used_meta":1662251,"kb_avail":92706636,"statfs":{"total":96636764160,"available":94931595264,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1987091,"internal_metadata":1702145517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T22:40:19.416 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T22:40:19.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.683+0000 7f84bee19640 1 Processor -- start 2024-03-18T22:40:19.685 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.683+0000 7f84bee19640 1 -- start start 2024-03-18T22:40:19.688 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84bee19640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f84b81622b0 0x7f84b80d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84bee19640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84b8162690 0x7f84b8162b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84bee19640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b80b3440 con 0x7f84b80cec80 2024-03-18T22:40:19.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84bee19640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f84b80d16c0 con 0x7f84b8162690 2024-03-18T22:40:19.689 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84bee19640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f84b80d2660 con 0x7f84b81622b0 2024-03-18T22:40:19.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.685+0000 7f84b7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84b8162690 0x7f84b8162b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f84b8162690 0x7f84b8162b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47508/0 (socket says 172.21.15.152:47508) 2024-03-18T22:40:19.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 -- 172.21.15.152:0/4270104945 learned_addr learned my addr 172.21.15.152:0/4270104945 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:19.690 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84bcbb5640 1 --2- 172.21.15.152:0/4270104945 >> v2:172.21.15.186:3300/0 conn(0x7f84b81622b0 0x7f84b80d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 -- 172.21.15.152:0/4270104945 >> v2:172.21.15.186:3300/0 conn(0x7f84b81622b0 msgr2=0x7f84b80d10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:19.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 --2- 172.21.15.152:0/4270104945 >> v2:172.21.15.186:3300/0 conn(0x7f84b81622b0 0x7f84b80d10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 -- 172.21.15.152:0/4270104945 >> v1:172.21.15.152:6789/0 conn(0x7f84b80cec80 legacy=0x7f84b80cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.691 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b7fff640 1 -- 172.21.15.152:0/4270104945 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b80d20a0 con 0x7f84b8162690 2024-03-18T22:40:19.692 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.686+0000 7f84b77fe640 1 -- 172.21.15.152:0/4270104945 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 993915987 0 0) 0x7f84b80b3440 con 0x7f84b80cec80 2024-03-18T22:40:19.694 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.687+0000 7f84b7fff640 1 --2- 172.21.15.152:0/4270104945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b8162690 0x7f84b8162b20 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009870 tx=0x7f84a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e09256a24ca5a951 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:19.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.688+0000 7f84b77fe640 1 -- 172.21.15.152:0/4270104945 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a402e070 con 0x7f84b8162690 2024-03-18T22:40:19.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.688+0000 7f84b77fe640 1 -- 172.21.15.152:0/4270104945 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a4037070 con 0x7f84b8162690 2024-03-18T22:40:19.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.688+0000 7f84b77fe640 1 -- 172.21.15.152:0/4270104945 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84a4031a00 con 0x7f84b8162690 2024-03-18T22:40:19.695 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 -- 172.21.15.152:0/4270104945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b8162690 msgr2=0x7f84b8162b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 --2- 172.21.15.152:0/4270104945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b8162690 0x7f84b8162b20 secure :-1 s=READY pgs=3299 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009870 tx=0x7f84a402b880 comp rx=0 tx=0).stop 2024-03-18T22:40:19.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 -- 172.21.15.152:0/4270104945 shutdown_connections 2024-03-18T22:40:19.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 --2- 172.21.15.152:0/4270104945 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b8162690 0x7f84b8162b20 unknown :-1 s=CLOSED pgs=3299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.696 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 --2- 172.21.15.152:0/4270104945 >> v2:172.21.15.186:3300/0 conn(0x7f84b81622b0 0x7f84b80d10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 -- 172.21.15.152:0/4270104945 >> 172.21.15.152:0/4270104945 conn(0x7f84b80d4070 msgr2=0x7f84b80d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:19.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 -- 172.21.15.152:0/4270104945 shutdown_connections 2024-03-18T22:40:19.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.689+0000 7f84bee19640 1 -- 172.21.15.152:0/4270104945 wait complete. 2024-03-18T22:40:19.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.692+0000 7f84bee19640 1 Processor -- start 2024-03-18T22:40:19.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.693+0000 7f84bee19640 1 -- start start 2024-03-18T22:40:19.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 0x7f84b815fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 0x7f84b80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f84b815faa0 con 0x7f84b81622b0 2024-03-18T22:40:19.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f84b80d2ab0 con 0x7f84b8162690 2024-03-18T22:40:19.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bee19640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f84b815fc20 con 0x7f84b80cec80 2024-03-18T22:40:19.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84b7fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:47518/0 (socket says 172.21.15.152:47518) 2024-03-18T22:40:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bcbb5640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 0x7f84b815fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84b7fff640 1 -- 172.21.15.152:0/2745175873 learned_addr learned my addr 172.21.15.152:0/2745175873 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.695+0000 7f84bd3b6640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 0x7f84b80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 -- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 msgr2=0x7f84b80cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.705 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 0x7f84b80cdae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 -- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 msgr2=0x7f84b8158800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 -- 172.21.15.152:0/2745175873 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b8160460 con 0x7f84b80cec80 2024-03-18T22:40:19.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bd3b6640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 0x7f84b80cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84b7fff640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.696+0000 7f84bcbb5640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 0x7f84b815fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00e880 tx=0x7f84ac00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.697+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac017070 con 0x7f84b80cec80 2024-03-18T22:40:19.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.697+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84ac00c940 con 0x7f84b80cec80 2024-03-18T22:40:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.697+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f84ac00cd30 con 0x7f84b80cec80 2024-03-18T22:40:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.697+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b8160740 con 0x7f84b80cec80 2024-03-18T22:40:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.697+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b8160d00 con 0x7f84b80cec80 2024-03-18T22:40:19.708 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.699+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f84ac01a070 con 0x7f84b80cec80 2024-03-18T22:40:19.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.699+0000 7f84b57fa640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 0x7f849c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:19.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.699+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f84ac08a9f0 con 0x7f84b80cec80 2024-03-18T22:40:19.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.699+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b804f5b0 con 0x7f84b80cec80 2024-03-18T22:40:19.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.699+0000 7f84b7fff640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 0x7f849c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:19.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.700+0000 7f84b7fff640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 0x7f849c06e090 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f84a402b8c0 tx=0x7f84a4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:19.710 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:19.705+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f84ac059190 con 0x7f84b80cec80 2024-03-18T22:40:20.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.239+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f84b8068710 con 0x7f849c06bbd0 2024-03-18T22:40:20.242 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.241+0000 7f84b57fa640 1 -- 172.21.15.152:0/2745175873 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13707 (secure 0 0 0) 0x7f84a4037040 con 0x7f849c06bbd0 2024-03-18T22:40:20.243 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:20.243 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T22:40:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.246+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 msgr2=0x7f849c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.248 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.246+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 0x7f849c06e090 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f84a402b8c0 tx=0x7f84a4008030 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.246+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 msgr2=0x7f84b815fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.246+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 0x7f84b815fe80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00e880 tx=0x7f84ac00ed40 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 shutdown_connections 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f84b8162690 0x7f84b80cdae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f84b81622b0 0x7f84b8158800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f849c06bbd0 0x7f849c06e090 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 --2- 172.21.15.152:0/2745175873 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f84b80cec80 0x7f84b815fe80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 >> 172.21.15.152:0/2745175873 conn(0x7f84b80d4070 msgr2=0x7f84b80b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:20.249 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 shutdown_connections 2024-03-18T22:40:20.250 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.247+0000 7f84bee19640 1 -- 172.21.15.152:0/2745175873 wait complete. 2024-03-18T22:40:20.276 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":13820,"stamp":"2024-03-18T22:40:19.768308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":16015376,"kb_used_data":5217048,"kb_used_omap":38165,"kb_used_meta":10722922,"kb_avail":738959344,"statfs":{"total":773094113280,"available":756694368256,"internally_reserved":0,"allocated":5342257152,"data_stored":5338426276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39081677,"internal_metadata":10980272435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":578,"apply_latency_ms":578,"commit_latency_ns":578000000,"apply_latency_ns":578000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38135504877,"num_objects":-25412,"num_object_clones":0,"num_object_copies":-50824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25412,"num_whiteouts":0,"num_read":-1494324,"num_read_kb":-406233480,"num_write":-1472342,"num_write_kb":-592690674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.624522"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-18T22:40:11.172663+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T22:40:11.172663+0000","last_peered":"2024-03-18T22:40:11.172663+0000","last_clean":"2024-03-18T22:40:11.172663+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T22:40:11.172663+0000","last_undegraded":"2024-03-18T22:40:11.172663+0000","last_fullsized":"2024-03-18T22:40:11.172663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424514865,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4965168,"kb_used_data":3153984,"kb_used_omap":7727,"kb_used_meta":1766288,"kb_avail":89406672,"statfs":{"total":96636764160,"available":91552432128,"internally_reserved":0,"allocated":3229679616,"data_stored":3228307955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7912914,"internal_metadata":1808679470},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424514914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1638512,"kb_used_data":424,"kb_used_omap":2359,"kb_used_meta":1635720,"kb_avail":92733328,"statfs":{"total":96636764160,"available":94958927872,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2416376,"internal_metadata":1674977544},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":223,"apply_latency_ms":223,"commit_latency_ns":223000000,"apply_latency_ns":223000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424514896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3482856,"kb_used_data":2059360,"kb_used_omap":6735,"kb_used_meta":1416752,"kb_avail":90888984,"statfs":{"total":96636764160,"available":93070319616,"internally_reserved":0,"allocated":2108784640,"data_stored":2107909335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6897302,"internal_metadata":1450754410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547660,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1275960,"kb_used_data":1004,"kb_used_omap":3582,"kb_used_meta":1271361,"kb_avail":93095880,"statfs":{"total":96636764160,"available":95330181120,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3668584,"internal_metadata":1301874072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129547663,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1262644,"kb_used_data":424,"kb_used_omap":4191,"kb_used_meta":1258016,"kb_avail":93109196,"statfs":{"total":96636764160,"available":95343816704,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4292009,"internal_metadata":1288208983},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129547658,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":917300,"kb_used_data":424,"kb_used_omap":4365,"kb_used_meta":912498,"kb_avail":93454540,"statfs":{"total":96636764160,"available":95697448960,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4469946,"internal_metadata":934398790},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":807732,"kb_used_data":424,"kb_used_omap":7263,"kb_used_meta":800032,"kb_avail":93564108,"statfs":{"total":96636764160,"available":95809646592,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7437455,"internal_metadata":819233649},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580338,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1665204,"kb_used_data":1004,"kb_used_omap":1940,"kb_used_meta":1662251,"kb_avail":92706636,"statfs":{"total":96636764160,"available":94931595264,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1987091,"internal_metadata":1702145517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T22:40:20.276 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-03-18T22:40:20.276 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T22:40:20.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.552+0000 7f3d5d590640 1 Processor -- start 2024-03-18T22:40:20.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.552+0000 7f3d5d590640 1 -- start start 2024-03-18T22:40:20.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.553+0000 7f3d5d590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 0x7f3d580b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:20.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.553+0000 7f3d5d590640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5815fc70 con 0x7f3d581598e0 2024-03-18T22:40:20.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.553+0000 7f3d5d590640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3d5815ff50 con 0x7f3d58159cc0 2024-03-18T22:40:20.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.553+0000 7f3d5d590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3d580b3c80 con 0x7f3d580d07f0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d56ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f3d581598e0 0x7f3d580d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60304/0 (socket says 172.21.15.152:60304) 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d56ffd640 1 -- 172.21.15.152:0/3352663178 learned_addr learned my addr 172.21.15.152:0/3352663178 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d567fc640 1 --2- 172.21.15.152:0/3352663178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 0x7f3d580b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 786450213 0 0) 0x7f3d5815fc70 con 0x7f3d581598e0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d40003520 con 0x7f3d581598e0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1114206080 0 0) 0x7f3d5815ff50 con 0x7f3d58159cc0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3d5815fc70 con 0x7f3d58159cc0 2024-03-18T22:40:20.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d567fc640 1 -- 172.21.15.152:0/3352663178 >> v1:172.21.15.186:6789/0 conn(0x7f3d58159cc0 legacy=0x7f3d580ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d567fc640 1 -- 172.21.15.152:0/3352663178 >> v1:172.21.15.152:6789/0 conn(0x7f3d581598e0 legacy=0x7f3d580d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.554+0000 7f3d567fc640 1 -- 172.21.15.152:0/3352663178 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d58160230 con 0x7f3d580d07f0 2024-03-18T22:40:20.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.556+0000 7f3d567fc640 1 --2- 172.21.15.152:0/3352663178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 0x7f3d580b3740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c02bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6760a746578ade84 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.557+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c039070 con 0x7f3d580d07f0 2024-03-18T22:40:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.557+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d4c02ccd0 con 0x7f3d580d07f0 2024-03-18T22:40:20.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.557+0000 7f3d55ffb640 1 -- 172.21.15.152:0/3352663178 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d4c034660 con 0x7f3d580d07f0 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.557+0000 7f3d5d590640 1 -- 172.21.15.152:0/3352663178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 msgr2=0x7f3d580b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.557+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3352663178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 0x7f3d580b3740 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3d4c009dc0 tx=0x7f3d4c02bf20 comp rx=0 tx=0).stop 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.558+0000 7f3d5d590640 1 -- 172.21.15.152:0/3352663178 shutdown_connections 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.558+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3352663178 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d580d07f0 0x7f3d580b3740 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.558+0000 7f3d5d590640 1 -- 172.21.15.152:0/3352663178 >> 172.21.15.152:0/3352663178 conn(0x7f3d5806b5e0 msgr2=0x7f3d5806b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.558+0000 7f3d5d590640 1 -- 172.21.15.152:0/3352663178 shutdown_connections 2024-03-18T22:40:20.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.558+0000 7f3d5d590640 1 -- 172.21.15.152:0/3352663178 wait complete. 2024-03-18T22:40:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.559+0000 7f3d5d590640 1 Processor -- start 2024-03-18T22:40:20.561 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 -- start start 2024-03-18T22:40:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d580d07f0 0x7f3d5809d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:20.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:20.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 0x7f3d5815f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:20.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f3d5806cc70 con 0x7f3d581598e0 2024-03-18T22:40:20.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f3d581607f0 con 0x7f3d580d07f0 2024-03-18T22:40:20.563 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.560+0000 7f3d5d590640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f3d5806cdf0 con 0x7f3d58159cc0 2024-03-18T22:40:20.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d567fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:20.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d567fc640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56680/0 (socket says 172.21.15.152:56680) 2024-03-18T22:40:20.564 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d567fc640 1 -- 172.21.15.152:0/3869105718 learned_addr learned my addr 172.21.15.152:0/3869105718 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:20.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 0x7f3d5815f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:20.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d56ffd640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d580d07f0 0x7f3d5809d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:20.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 -- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d580d07f0 msgr2=0x7f3d5809d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d580d07f0 0x7f3d5809d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 -- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 msgr2=0x7f3d581477c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d577fe640 1 -- 172.21.15.152:0/3869105718 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d5815df50 con 0x7f3d58159cc0 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.561+0000 7f3d567fc640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d577fe640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 0x7f3d5815f020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c390 tx=0x7f3d5000c850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:20.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50017070 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3d500052d0 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d5815e540 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d50003830 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.562+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d5815eb00 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.565+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3d5804f5b0 con 0x7f3d58159cc0 2024-03-18T22:40:20.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.565+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f3d5001a070 con 0x7f3d58159cc0 2024-03-18T22:40:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.566+0000 7f3d3f7fe640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 0x7f3d4406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.566+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f3d50089a00 con 0x7f3d58159cc0 2024-03-18T22:40:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.567+0000 7f3d56ffd640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 0x7f3d4406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:20.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.567+0000 7f3d56ffd640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 0x7f3d4406e090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f60 tx=0x7f3d48007d50 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:20.573 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:20.571+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f3d50058100 con 0x7f3d58159cc0 2024-03-18T22:40:21.095 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.093+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3d58158f40 con 0x7f3d4406bbd0 2024-03-18T22:40:21.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.094+0000 7f3d3f7fe640 1 -- 172.21.15.152:0/3869105718 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13707 (secure 0 0 0) 0x7f3d58158f40 con 0x7f3d4406bbd0 2024-03-18T22:40:21.096 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:21.097 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 msgr2=0x7f3d4406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 0x7f3d4406e090 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f3d48000f60 tx=0x7f3d48007d50 comp rx=0 tx=0).stop 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 msgr2=0x7f3d5815f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 0x7f3d5815f020 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3d5000c390 tx=0x7f3d5000c850 comp rx=0 tx=0).stop 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 shutdown_connections 2024-03-18T22:40:21.101 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f3d4406bbd0 0x7f3d4406e090 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f3d58159cc0 0x7f3d5815f020 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f3d581598e0 0x7f3d581477c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 --2- 172.21.15.152:0/3869105718 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f3d580d07f0 0x7f3d5809d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 >> 172.21.15.152:0/3869105718 conn(0x7f3d5806b5e0 msgr2=0x7f3d58157280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 shutdown_connections 2024-03-18T22:40:21.102 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.099+0000 7f3d5d590640 1 -- 172.21.15.152:0/3869105718 wait complete. 2024-03-18T22:40:21.128 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":13820,"stamp":"2024-03-18T22:40:19.768308+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":60,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":4,"kb":754974720,"kb_used":16015376,"kb_used_data":5217048,"kb_used_omap":38165,"kb_used_meta":10722922,"kb_avail":738959344,"statfs":{"total":773094113280,"available":756694368256,"internally_reserved":0,"allocated":5342257152,"data_stored":5338426276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39081677,"internal_metadata":10980272435},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":578,"apply_latency_ms":578,"commit_latency_ns":578000000,"apply_latency_ns":578000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-38135504877,"num_objects":-25412,"num_object_clones":0,"num_object_copies":-50824,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-25412,"num_whiteouts":0,"num_read":-1494324,"num_read_kb":-406233480,"num_write":-1472342,"num_write_kb":-592690674,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.624522"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":426,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-18T22:40:11.172663+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T22:40:11.172663+0000","last_peered":"2024-03-18T22:40:11.172663+0000","last_clean":"2024-03-18T22:40:11.172663+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T22:40:11.172663+0000","last_undegraded":"2024-03-18T22:40:11.172663+0000","last_fullsized":"2024-03-18T22:40:11.172663+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424514865,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4965168,"kb_used_data":3153984,"kb_used_omap":7727,"kb_used_meta":1766288,"kb_avail":89406672,"statfs":{"total":96636764160,"available":91552432128,"internally_reserved":0,"allocated":3229679616,"data_stored":3228307955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7912914,"internal_metadata":1808679470},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":73,"apply_latency_ms":73,"commit_latency_ns":73000000,"apply_latency_ns":73000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424514914,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1638512,"kb_used_data":424,"kb_used_omap":2359,"kb_used_meta":1635720,"kb_avail":92733328,"statfs":{"total":96636764160,"available":94958927872,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2416376,"internal_metadata":1674977544},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":223,"apply_latency_ms":223,"commit_latency_ns":223000000,"apply_latency_ns":223000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424514896,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3482856,"kb_used_data":2059360,"kb_used_omap":6735,"kb_used_meta":1416752,"kb_avail":90888984,"statfs":{"total":96636764160,"available":93070319616,"internally_reserved":0,"allocated":2108784640,"data_stored":2107909335,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6897302,"internal_metadata":1450754410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":103,"apply_latency_ms":103,"commit_latency_ns":103000000,"apply_latency_ns":103000000},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547660,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1275960,"kb_used_data":1004,"kb_used_omap":3582,"kb_used_meta":1271361,"kb_avail":93095880,"statfs":{"total":96636764160,"available":95330181120,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3668584,"internal_metadata":1301874072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[]},{"osd":6,"up_from":14,"seq":60129547663,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1262644,"kb_used_data":424,"kb_used_omap":4191,"kb_used_meta":1258016,"kb_avail":93109196,"statfs":{"total":96636764160,"available":95343816704,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4292009,"internal_metadata":1288208983},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[]},{"osd":5,"up_from":14,"seq":60129547658,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":917300,"kb_used_data":424,"kb_used_omap":4365,"kb_used_meta":912498,"kb_avail":93454540,"statfs":{"total":96636764160,"available":95697448960,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4469946,"internal_metadata":934398790},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547659,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":807732,"kb_used_data":424,"kb_used_omap":7263,"kb_used_meta":800032,"kb_avail":93564108,"statfs":{"total":96636764160,"available":95809646592,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7437455,"internal_metadata":819233649},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580338,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1665204,"kb_used_data":1004,"kb_used_omap":1940,"kb_used_meta":1662251,"kb_avail":92706636,"statfs":{"total":96636764160,"available":94931595264,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1987091,"internal_metadata":1702145517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":65,"apply_latency_ms":65,"commit_latency_ns":65000000,"apply_latency_ns":65000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T22:40:21.129 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-18T22:40:21.297 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.296+0000 7f1d90012640 1 Processor -- start 2024-03-18T22:40:21.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.296+0000 7f1d90012640 1 -- start start 2024-03-18T22:40:21.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.298+0000 7f1d90012640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 0x7f1d880d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.300 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.298+0000 7f1d90012640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 0x7f1d8815ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.298+0000 7f1d90012640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d880b3440 con 0x7f1d88162690 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.298+0000 7f1d90012640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1d88163200 con 0x7f1d8815ea90 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.298+0000 7f1d90012640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1d880d16c0 con 0x7f1d881622b0 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8d5ad640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f1d88162690 0x7f1d88162af0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59692/0 (socket says 172.21.15.152:59692) 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8d5ad640 1 -- 172.21.15.152:0/345901634 learned_addr learned my addr 172.21.15.152:0/345901634 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/345901634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 0x7f1d880d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8e5af640 1 --2- 172.21.15.152:0/345901634 >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 0x7f1d8815ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.301 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3762455328 0 0) 0x7f1d880b3440 con 0x7f1d88162690 2024-03-18T22:40:21.302 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d74003520 con 0x7f1d88162690 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 <== mon.1 v1:172.21.15.186:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1284691027 0 0) 0x7f1d74003520 con 0x7f1d88162690 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8ddae640 1 -- 172.21.15.152:0/345901634 >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 msgr2=0x7f1d8815ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/345901634 >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 0x7f1d8815ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8ddae640 1 -- 172.21.15.152:0/345901634 >> v1:172.21.15.186:6789/0 conn(0x7f1d88162690 legacy=0x7f1d88162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8ddae640 1 -- 172.21.15.152:0/345901634 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d880d20a0 con 0x7f1d881622b0 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.299+0000 7f1d8e5af640 1 --2- 172.21.15.152:0/345901634 >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 0x7f1d8815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:21.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.301+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/345901634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 0x7f1d880d10d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d840097a0 tx=0x7f1d8402b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9862b8a41107b342 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.302+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84037070 con 0x7f1d881622b0 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.302+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d84030510 con 0x7f1d881622b0 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.302+0000 7f1d8cdac640 1 -- 172.21.15.152:0/345901634 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d8402be60 con 0x7f1d881622b0 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 -- 172.21.15.152:0/345901634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 msgr2=0x7f1d880d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 --2- 172.21.15.152:0/345901634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 0x7f1d880d10d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1d840097a0 tx=0x7f1d8402b660 comp rx=0 tx=0).stop 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 -- 172.21.15.152:0/345901634 shutdown_connections 2024-03-18T22:40:21.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 --2- 172.21.15.152:0/345901634 >> v2:172.21.15.152:3300/0 conn(0x7f1d8815ea90 0x7f1d8815ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 --2- 172.21.15.152:0/345901634 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d881622b0 0x7f1d880d10d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 -- 172.21.15.152:0/345901634 >> 172.21.15.152:0/345901634 conn(0x7f1d880d4070 msgr2=0x7f1d880d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:21.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 -- 172.21.15.152:0/345901634 shutdown_connections 2024-03-18T22:40:21.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.303+0000 7f1d90012640 1 -- 172.21.15.152:0/345901634 wait complete. 2024-03-18T22:40:21.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.306+0000 7f1d90012640 1 Processor -- start 2024-03-18T22:40:21.308 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.306+0000 7f1d90012640 1 -- start start 2024-03-18T22:40:21.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d881622b0 0x7f1d880b9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 0x7f1d88158720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880d2ab0 con 0x7f1d88162690 2024-03-18T22:40:21.311 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1d880d2660 con 0x7f1d881622b0 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.308+0000 7f1d90012640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1d880cfc90 con 0x7f1d8815ea90 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8e5af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 0x7f1d88158720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8d5ad640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d881622b0 0x7f1d880b9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:45708/0 (socket says 172.21.15.152:45708) 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8e5af640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 0x7f1d88158720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56694/0 (socket says 172.21.15.152:56694) 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 -- 172.21.15.152:0/2303662681 learned_addr learned my addr 172.21.15.152:0/2303662681 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 -- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d881622b0 msgr2=0x7f1d880b9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.312 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d881622b0 0x7f1d880b9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 -- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 msgr2=0x7f1d88158720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 0x7f1d88158720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.309+0000 7f1d8ddae640 1 -- 172.21.15.152:0/2303662681 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d881617b0 con 0x7f1d8815ea90 2024-03-18T22:40:21.313 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d8ddae640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d8402b6a0 tx=0x7f1d840046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84042020 con 0x7f1d8815ea90 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d840044c0 con 0x7f1d8815ea90 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d84037040 con 0x7f1d8815ea90 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d881601f0 con 0x7f1d8815ea90 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.310+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d88160a90 con 0x7f1d8815ea90 2024-03-18T22:40:21.314 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.312+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d8804f5b0 con 0x7f1d8815ea90 2024-03-18T22:40:21.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.313+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1d84045020 con 0x7f1d8815ea90 2024-03-18T22:40:21.315 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.314+0000 7f1d7a7fc640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 0x7f1d6c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:21.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.314+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f1d840ac0d0 con 0x7f1d8815ea90 2024-03-18T22:40:21.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.314+0000 7f1d8d5ad640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 0x7f1d6c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:21.316 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.315+0000 7f1d8d5ad640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 0x7f1d6c06e090 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c001360 tx=0x7f1d7c0012b0 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:21.320 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.318+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f1d8404c030 con 0x7f1d8815ea90 2024-03-18T22:40:21.858 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.856+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d880d18d0 con 0x7f1d8815ea90 2024-03-18T22:40:21.859 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.857+0000 7f1d7a7fc640 1 -- 172.21.15.152:0/2303662681 <== mon.2 v2:172.21.15.186:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) ==== 74+0+13068 (secure 0 0 0) 0x7f1d8407ae20 con 0x7f1d8815ea90 2024-03-18T22:40:21.859 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:21.860 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":38,"fsid":"ee22e391-802c-4342-9093-15071cbd8b50","created":"2024-03-18T15:00:23.630250+0000","modified":"2024-03-18T22:40:11.141292+0000","last_up_change":"2024-03-18T15:00:35.523516+0000","last_in_change":"2024-03-18T15:00:26.655403+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-18T15:00:35.846259+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"93c5306e-a039-4e02-bb7d-cf282b2ef568","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6804","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6806","nonce":3028176000}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6808","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6809","nonce":3028176000}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6816","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6818","nonce":3028176000}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6811","nonce":3028176000},{"type":"v1","addr":"172.21.15.152:6814","nonce":3028176000}]},"public_addr":"172.21.15.152:6806/3028176000","cluster_addr":"172.21.15.152:6809/3028176000","heartbeat_back_addr":"172.21.15.152:6818/3028176000","heartbeat_front_addr":"172.21.15.152:6814/3028176000","state":["exists","up"]},{"osd":1,"uuid":"8b4a44e2-07c8-402c-ab60-c8a51c2cbae6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6800","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6801","nonce":1305469316}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6802","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6803","nonce":1305469316}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6810","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6813","nonce":1305469316}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6805","nonce":1305469316},{"type":"v1","addr":"172.21.15.152:6807","nonce":1305469316}]},"public_addr":"172.21.15.152:6801/1305469316","cluster_addr":"172.21.15.152:6803/1305469316","heartbeat_back_addr":"172.21.15.152:6813/1305469316","heartbeat_front_addr":"172.21.15.152:6807/1305469316","state":["exists","up"]},{"osd":2,"uuid":"d88dd052-806c-4c46-bb7f-0bc31d9917f5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6812","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6815","nonce":2040307032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6817","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6819","nonce":2040307032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6822","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6823","nonce":2040307032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6820","nonce":2040307032},{"type":"v1","addr":"172.21.15.152:6821","nonce":2040307032}]},"public_addr":"172.21.15.152:6815/2040307032","cluster_addr":"172.21.15.152:6819/2040307032","heartbeat_back_addr":"172.21.15.152:6823/2040307032","heartbeat_front_addr":"172.21.15.152:6821/2040307032","state":["exists","up"]},{"osd":3,"uuid":"462bf08e-cd41-4ad5-9df5-8a0ed49d2dce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6824","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6825","nonce":602992539}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6826","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6827","nonce":602992539}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6830","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6831","nonce":602992539}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6828","nonce":602992539},{"type":"v1","addr":"172.21.15.152:6829","nonce":602992539}]},"public_addr":"172.21.15.152:6825/602992539","cluster_addr":"172.21.15.152:6827/602992539","heartbeat_back_addr":"172.21.15.152:6831/602992539","heartbeat_front_addr":"172.21.15.152:6829/602992539","state":["exists","up"]},{"osd":4,"uuid":"d38e1761-b438-46fc-840f-626022d011c1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6800","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6801","nonce":4143159879}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6802","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6803","nonce":4143159879}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6806","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6807","nonce":4143159879}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6804","nonce":4143159879},{"type":"v1","addr":"172.21.15.186:6805","nonce":4143159879}]},"public_addr":"172.21.15.186:6801/4143159879","cluster_addr":"172.21.15.186:6803/4143159879","heartbeat_back_addr":"172.21.15.186:6807/4143159879","heartbeat_front_addr":"172.21.15.186:6805/4143159879","state":["exists","up"]},{"osd":5,"uuid":"e6693b7d-6381-4d7c-9769-70e5ec2ff9cd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6824","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6825","nonce":1793138665}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6826","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6827","nonce":1793138665}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6830","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6831","nonce":1793138665}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6828","nonce":1793138665},{"type":"v1","addr":"172.21.15.186:6829","nonce":1793138665}]},"public_addr":"172.21.15.186:6825/1793138665","cluster_addr":"172.21.15.186:6827/1793138665","heartbeat_back_addr":"172.21.15.186:6831/1793138665","heartbeat_front_addr":"172.21.15.186:6829/1793138665","state":["exists","up"]},{"osd":6,"uuid":"99946048-348e-47d6-b454-73a71f5803ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6808","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6809","nonce":2621081910}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6810","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6811","nonce":2621081910}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6814","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6815","nonce":2621081910}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6812","nonce":2621081910},{"type":"v1","addr":"172.21.15.186:6813","nonce":2621081910}]},"public_addr":"172.21.15.186:6809/2621081910","cluster_addr":"172.21.15.186:6811/2621081910","heartbeat_back_addr":"172.21.15.186:6815/2621081910","heartbeat_front_addr":"172.21.15.186:6813/2621081910","state":["exists","up"]},{"osd":7,"uuid":"0505d7d0-a9e4-4303-877d-0fb3289b1bbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6816","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6817","nonce":2838791468}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6818","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6819","nonce":2838791468}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6822","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6823","nonce":2838791468}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6820","nonce":2838791468},{"type":"v1","addr":"172.21.15.186:6821","nonce":2838791468}]},"public_addr":"172.21.15.186:6817/2838791468","cluster_addr":"172.21.15.186:6819/2838791468","heartbeat_back_addr":"172.21.15.186:6823/2838791468","heartbeat_front_addr":"172.21.15.186:6821/2838791468","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.736442+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.846503+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.788138+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.818327+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.728005+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.837189+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.768442+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-03-18T15:00:31.840132+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.152:6837/556153091":"2024-03-19T22:40:07.476114+0000","172.21.15.152:6835/556153091":"2024-03-19T22:40:07.476114+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-18T22:40:21.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 msgr2=0x7f1d6c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.863 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 0x7f1d6c06e090 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c001360 tx=0x7f1d7c0012b0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 msgr2=0x7f1d88161270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:21.864 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f1d8402b6a0 tx=0x7f1d840046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 shutdown_connections 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1d88162690 0x7f1d88158720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1d881622b0 0x7f1d880b9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d6c06bbd0 0x7f1d6c06e090 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 --2- 172.21.15.152:0/2303662681 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1d8815ea90 0x7f1d88161270 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 >> 172.21.15.152:0/2303662681 conn(0x7f1d880d4070 msgr2=0x7f1d880ca8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:21.865 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 shutdown_connections 2024-03-18T22:40:21.866 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:21.862+0000 7f1d90012640 1 -- 172.21.15.152:0/2303662681 wait complete. 2024-03-18T22:40:22.892 INFO:tasks.ceph:Scrubbing osd.0 2024-03-18T22:40:22.892 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:23.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.175+0000 7fce008c6640 1 Processor -- start 2024-03-18T22:40:23.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.175+0000 7fce008c6640 1 -- start start 2024-03-18T22:40:23.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.177+0000 7fce008c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 0x7fcdfc0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.177+0000 7fce008c6640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcdfc0cfbe0 0x7fcdfc0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.177+0000 7fce008c6640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 0x7fcdfc0d2ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fce008c6640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc0d06b0 con 0x7fcdfc0d16c0 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fce008c6640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fcdfc0d1230 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fce008c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcdfc15e870 con 0x7fcdfc15e490 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdfa59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 0x7fcdfc0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdf1d9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fcdfc0cfbe0 0x7fcdfc0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdfad9d640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 0x7fcdfc0d2ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdfa59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 0x7fcdfc0cf6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:45712/0 (socket says 172.21.15.152:45712) 2024-03-18T22:40:23.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdfa59c640 1 -- 172.21.15.152:0/568036545 learned_addr learned my addr 172.21.15.152:0/568036545 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdf1d9b640 1 -- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 msgr2=0x7fcdfc0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdf1d9b640 1 --2- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 0x7fcdfc0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdf1d9b640 1 -- 172.21.15.152:0/568036545 >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 msgr2=0x7fcdfc0d2ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.178+0000 7fcdf1d9b640 1 --2- 172.21.15.152:0/568036545 >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 0x7fcdfc0d2ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.179+0000 7fcdf1d9b640 1 -- 172.21.15.152:0/568036545 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc0d0900 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.182 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.179+0000 7fcdfad9d640 1 --2- 172.21.15.152:0/568036545 >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 0x7fcdfc0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:23.183 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.181+0000 7fcdf1d9b640 1 --2- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0d2660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0739e0 tx=0x7fcde402b7a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f36362ea365c6314 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.181+0000 7fcdf9d9b640 1 -- 172.21.15.152:0/568036545 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4038070 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.181+0000 7fcdf9d9b640 1 -- 172.21.15.152:0/568036545 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcde4031700 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.181+0000 7fcdf9d9b640 1 -- 172.21.15.152:0/568036545 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcde4031ad0 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 -- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 msgr2=0x7fcdfc0d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.184 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 --2- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0d2660 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc0739e0 tx=0x7fcde402b7a0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 -- 172.21.15.152:0/568036545 shutdown_connections 2024-03-18T22:40:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 --2- 172.21.15.152:0/568036545 >> v2:172.21.15.152:3300/0 conn(0x7fcdfc0d16c0 0x7fcdfc0d2ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 --2- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0d2660 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.185 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 --2- 172.21.15.152:0/568036545 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc15e490 0x7fcdfc0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.182+0000 7fce008c6640 1 -- 172.21.15.152:0/568036545 >> 172.21.15.152:0/568036545 conn(0x7fcdfc0d4080 msgr2=0x7fcdfc0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:23.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.183+0000 7fce008c6640 1 -- 172.21.15.152:0/568036545 shutdown_connections 2024-03-18T22:40:23.186 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.183+0000 7fce008c6640 1 -- 172.21.15.152:0/568036545 wait complete. 2024-03-18T22:40:23.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.187+0000 7fce008c6640 1 Processor -- start 2024-03-18T22:40:23.188 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.187+0000 7fce008c6640 1 -- start start 2024-03-18T22:40:23.190 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0b7470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc0d16c0 0x7fcdfc15a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 0x7fcdfc0cbf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc0d2220 con 0x7fcdfc15e490 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fcdfc0d0ec0 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fce008c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fcdfc0d23a0 con 0x7fcdfc0d16c0 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0b7470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.191 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 0x7fcdfc0cbf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdf1d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc0d16c0 0x7fcdfc15a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 0x7fcdfc0cbf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56712/0 (socket says 172.21.15.152:56712) 2024-03-18T22:40:23.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0b7470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58620/0 (socket says 172.21.15.152:58620) 2024-03-18T22:40:23.192 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfad9d640 1 -- 172.21.15.152:0/2297048504 learned_addr learned my addr 172.21.15.152:0/2297048504 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:23.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 -- 172.21.15.152:0/2297048504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc0d16c0 msgr2=0x7fcdfc15a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.193 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fcdfc0d16c0 0x7fcdfc15a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 -- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 msgr2=0x7fcdfc0cbf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.189+0000 7fcdfa59c640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 0x7fcdfc0cbf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdfa59c640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcdfc160370 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdfad9d640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fcdfc15e490 0x7fcdfc0cbf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdfa59c640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0b7470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00e850 tx=0x7fcdec00ed10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec017070 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcdec00c940 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdec00ccf0 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.190+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcdfc0a15f0 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.191+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcdfc0a1bb0 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.195 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.192+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcdfc068710 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.193+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fcdec01a070 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.196 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.194+0000 7fcdf37fe640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcddc06bbd0 0x7fcddc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf1d9b640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcddc06bbd0 0x7fcddc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fcdec08a680 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf37fe640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7fcddc071a90 0x7fcddc073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcdec004470 con 0x7fcddc071a90 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fcdec091050 con 0x7fcdfc0cfbe0 2024-03-18T22:40:23.197 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdfad9d640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7fcddc071a90 0x7fcddc073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.195+0000 7fcdf1d9b640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcddc06bbd0 0x7fcddc06e090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcde4035000 tx=0x7fcde4008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.196+0000 7fcdfad9d640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7fcddc071a90 0x7fcddc073eb0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.198 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.197+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== osd.0 v2:172.21.15.152:6804/3028176000 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcdec004470 con 0x7fcddc071a90 2024-03-18T22:40:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.235+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 --> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcdfc08d7b0 con 0x7fcddc071a90 2024-03-18T22:40:23.237 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.236+0000 7fcdf37fe640 1 -- 172.21.15.152:0/2297048504 <== osd.0 v2:172.21.15.152:6804/3028176000 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcdfc08d7b0 con 0x7fcddc071a90 2024-03-18T22:40:23.238 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:23.238 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:23.238 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:23.239 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7fcddc071a90 msgr2=0x7fcddc073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6804/3028176000,v1:172.21.15.152:6806/3028176000] conn(0x7fcddc071a90 0x7fcddc073eb0 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcddc06bbd0 msgr2=0x7fcddc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fcddc06bbd0 0x7fcddc06e090 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fcde4035000 tx=0x7fcde4008030 comp rx=0 tx=0).stop 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 msgr2=0x7fcdfc0b7470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 --2- 172.21.15.152:0/2297048504 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fcdfc0cfbe0 0x7fcdfc0b7470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00e850 tx=0x7fcdec00ed10 comp rx=0 tx=0).stop 2024-03-18T22:40:23.240 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fcdfad9d640 1 -- 172.21.15.152:0/2297048504 reap_dead start 2024-03-18T22:40:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 shutdown_connections 2024-03-18T22:40:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 >> 172.21.15.152:0/2297048504 conn(0x7fcdfc0d4080 msgr2=0x7fcdfc0b4da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 shutdown_connections 2024-03-18T22:40:23.241 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.237+0000 7fce008c6640 1 -- 172.21.15.152:0/2297048504 wait complete. 2024-03-18T22:40:23.264 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-03-18T22:40:23.551 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.550+0000 7fdc43ac0640 1 Processor -- start 2024-03-18T22:40:23.552 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.550+0000 7fdc43ac0640 1 -- start start 2024-03-18T22:40:23.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.552+0000 7fdc43ac0640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc3c0d10d0 0x7fdc3c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.554 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc43ac0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 0x7fdc3c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc43ac0640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdc3c0b3440 con 0x7fdc3c1622b0 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc43ac0640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fdc3c0d16c0 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc43ac0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3c0d2660 con 0x7fdc3c15ea90 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4105b640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fdc3c0d10d0 0x7fdc3c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4205d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 0x7fdc3c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4185c640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fdc3c1622b0 0x7fdc3c162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59698/0 (socket says 172.21.15.152:59698) 2024-03-18T22:40:23.555 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4185c640 1 -- 172.21.15.152:0/1791882499 learned_addr learned my addr 172.21.15.152:0/1791882499 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:23.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4205d640 1 -- 172.21.15.152:0/1791882499 >> v2:172.21.15.152:3300/0 conn(0x7fdc3c0d10d0 msgr2=0x7fdc3c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:23.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4205d640 1 --2- 172.21.15.152:0/1791882499 >> v2:172.21.15.152:3300/0 conn(0x7fdc3c0d10d0 0x7fdc3c162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4085a640 1 -- 172.21.15.152:0/1791882499 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2120393285 0 0) 0x7fdc3c0b3440 con 0x7fdc3c1622b0 2024-03-18T22:40:23.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.553+0000 7fdc4205d640 1 -- 172.21.15.152:0/1791882499 >> v1:172.21.15.186:6789/0 conn(0x7fdc3c1622b0 legacy=0x7fdc3c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.556 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.554+0000 7fdc4205d640 1 -- 172.21.15.152:0/1791882499 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c0d20a0 con 0x7fdc3c15ea90 2024-03-18T22:40:23.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.555+0000 7fdc4205d640 1 --2- 172.21.15.152:0/1791882499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 0x7fdc3c15ef20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009dc0 tx=0x7fdc3402bd70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a872406d281627b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.556+0000 7fdc4085a640 1 -- 172.21.15.152:0/1791882499 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34039070 con 0x7fdc3c15ea90 2024-03-18T22:40:23.557 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.556+0000 7fdc4085a640 1 -- 172.21.15.152:0/1791882499 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc3402cb20 con 0x7fdc3c15ea90 2024-03-18T22:40:23.558 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.556+0000 7fdc4085a640 1 -- 172.21.15.152:0/1791882499 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc34034440 con 0x7fdc3c15ea90 2024-03-18T22:40:23.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 -- 172.21.15.152:0/1791882499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 msgr2=0x7fdc3c15ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/1791882499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 0x7fdc3c15ef20 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fdc34009dc0 tx=0x7fdc3402bd70 comp rx=0 tx=0).stop 2024-03-18T22:40:23.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 -- 172.21.15.152:0/1791882499 shutdown_connections 2024-03-18T22:40:23.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/1791882499 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c15ea90 0x7fdc3c15ef20 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.559 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/1791882499 >> v2:172.21.15.152:3300/0 conn(0x7fdc3c0d10d0 0x7fdc3c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 -- 172.21.15.152:0/1791882499 >> 172.21.15.152:0/1791882499 conn(0x7fdc3c0d4070 msgr2=0x7fdc3c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:23.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.557+0000 7fdc43ac0640 1 -- 172.21.15.152:0/1791882499 shutdown_connections 2024-03-18T22:40:23.560 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.558+0000 7fdc43ac0640 1 -- 172.21.15.152:0/1791882499 wait complete. 2024-03-18T22:40:23.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.561+0000 7fdc43ac0640 1 Processor -- start 2024-03-18T22:40:23.562 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.561+0000 7fdc43ac0640 1 -- start start 2024-03-18T22:40:23.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 0x7fdc3c156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 0x7fdc3c0cb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.565 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc3c1622b0 0x7fdc3c0cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c0cfc90 con 0x7fdc3c15ea90 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fdc3c0d2ab0 con 0x7fdc3c1622b0 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc43ac0640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fdc3c0cfe10 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc4105b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 0x7fdc3c0cb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc4105b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 0x7fdc3c0cb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56730/0 (socket says 172.21.15.152:56730) 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc4105b640 1 -- 172.21.15.152:0/3561508156 learned_addr learned my addr 172.21.15.152:0/3561508156 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:23.566 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc4185c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 0x7fdc3c156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.563+0000 7fdc4205d640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc3c1622b0 0x7fdc3c0cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 -- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc3c1622b0 msgr2=0x7fdc3c0cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc3c1622b0 0x7fdc3c0cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 -- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 msgr2=0x7fdc3c0cb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 0x7fdc3c0cb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 -- 172.21.15.152:0/3561508156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc3c1607d0 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.567 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc4185c640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 0x7fdc3c156400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c480 tx=0x7fdc3800c940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38018070 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc380074e0 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.568 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc38004a20 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc3c160a70 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.564+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc3c0b5030 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.568+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc3c04f5b0 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.569 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.568+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fdc3801b070 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.570 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.569+0000 7fdc327fc640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 0x7fdc2006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:23.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.569+0000 7fdc4105b640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 0x7fdc2006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:23.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.569+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fdc38089970 con 0x7fdc3c0d10d0 2024-03-18T22:40:23.571 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.570+0000 7fdc4105b640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 0x7fdc2006e090 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b3d10 tx=0x7fdc2c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:23.575 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:23.574+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fdc380581a0 con 0x7fdc3c0d10d0 2024-03-18T22:40:24.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.111+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fdc3c068710 con 0x7fdc2006bbd0 2024-03-18T22:40:24.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.112+0000 7fdc327fc640 1 -- 172.21.15.152:0/3561508156 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fdc2c011a30 con 0x7fdc2006bbd0 2024-03-18T22:40:24.114 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 0 to deep-scrub 2024-03-18T22:40:24.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 msgr2=0x7fdc2006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 0x7fdc2006e090 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fdc3c0b3d10 tx=0x7fdc2c009190 comp rx=0 tx=0).stop 2024-03-18T22:40:24.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 msgr2=0x7fdc3c156400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 0x7fdc3c156400 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fdc3800c480 tx=0x7fdc3800c940 comp rx=0 tx=0).stop 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 shutdown_connections 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fdc3c1622b0 0x7fdc3c0cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fdc3c15ea90 0x7fdc3c0cb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fdc2006bbd0 0x7fdc2006e090 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 --2- 172.21.15.152:0/3561508156 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fdc3c0d10d0 0x7fdc3c156400 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.114+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 >> 172.21.15.152:0/3561508156 conn(0x7fdc3c0d4070 msgr2=0x7fdc3c159d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:24.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.115+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 shutdown_connections 2024-03-18T22:40:24.118 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.115+0000 7fdc43ac0640 1 -- 172.21.15.152:0/3561508156 wait complete. 2024-03-18T22:40:24.132 INFO:tasks.ceph:Scrubbing osd.1 2024-03-18T22:40:24.132 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:24.421 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.420+0000 7fc5a6cd8640 1 Processor -- start 2024-03-18T22:40:24.422 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.420+0000 7fc5a6cd8640 1 -- start start 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a6cd8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 0x7fc5a00cd700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a6cd8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 0x7fc5a015da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a6cd8640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc5a006c140 con 0x7fc5a00cdc40 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a6cd8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc5a00ce130 con 0x7fc5a00ced20 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a6cd8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a006c420 con 0x7fc5a00b77d0 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a4a74640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 0x7fc5a00cd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.424 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc59ffff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7fc5a00cdc40 0x7fc5a00ce610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59704/0 (socket says 172.21.15.152:59704) 2024-03-18T22:40:24.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc59ffff640 1 -- 172.21.15.152:0/2867714525 learned_addr learned my addr 172.21.15.152:0/2867714525 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:24.425 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.422+0000 7fc5a5275640 1 --2- 172.21.15.152:0/2867714525 >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 0x7fc5a015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc59f7fe640 1 -- 172.21.15.152:0/2867714525 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2420818260 0 0) 0x7fc5a006c140 con 0x7fc5a00cdc40 2024-03-18T22:40:24.426 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc59f7fe640 1 -- 172.21.15.152:0/2867714525 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc58c003520 con 0x7fc5a00cdc40 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc5a4a74640 1 -- 172.21.15.152:0/2867714525 >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 msgr2=0x7fc5a015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc5a4a74640 1 --2- 172.21.15.152:0/2867714525 >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 0x7fc5a015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc5a4a74640 1 -- 172.21.15.152:0/2867714525 >> v1:172.21.15.186:6789/0 conn(0x7fc5a00cdc40 legacy=0x7fc5a00ce610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc5a4a74640 1 -- 172.21.15.152:0/2867714525 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a006c700 con 0x7fc5a00b77d0 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.423+0000 7fc5a5275640 1 --2- 172.21.15.152:0/2867714525 >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 0x7fc5a015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T22:40:24.427 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.425+0000 7fc5a4a74640 1 --2- 172.21.15.152:0/2867714525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 0x7fc5a00cd700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5900097a0 tx=0x7fc59002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7df892b09d277d2 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.428 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.425+0000 7fc59f7fe640 1 -- 172.21.15.152:0/2867714525 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5900315a0 con 0x7fc5a00b77d0 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.425+0000 7fc59f7fe640 1 -- 172.21.15.152:0/2867714525 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc590037070 con 0x7fc5a00b77d0 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.425+0000 7fc59f7fe640 1 -- 172.21.15.152:0/2867714525 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc590031960 con 0x7fc5a00b77d0 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2867714525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 msgr2=0x7fc5a00cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2867714525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 0x7fc5a00cd700 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fc5900097a0 tx=0x7fc59002b840 comp rx=0 tx=0).stop 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2867714525 shutdown_connections 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2867714525 >> v2:172.21.15.152:3300/0 conn(0x7fc5a00ced20 0x7fc5a015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2867714525 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00b77d0 0x7fc5a00cd700 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.429 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2867714525 >> 172.21.15.152:0/2867714525 conn(0x7fc5a00d1e00 msgr2=0x7fc5a00d2210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2867714525 shutdown_connections 2024-03-18T22:40:24.430 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.427+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2867714525 wait complete. 2024-03-18T22:40:24.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.430+0000 7fc5a6cd8640 1 Processor -- start 2024-03-18T22:40:24.432 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.430+0000 7fc5a6cd8640 1 -- start start 2024-03-18T22:40:24.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00b77d0 0x7fc5a00c9700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 0x7fc5a01e1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00ced20 0x7fc5a01e8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.435 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00b7bb0 con 0x7fc5a00b77d0 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc5a00d0db0 con 0x7fc5a00cdc40 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a6cd8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc5a01e8d20 con 0x7fc5a00ced20 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a4a74640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00b77d0 0x7fc5a00c9700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc59ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 0x7fc5a01e1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc5a5275640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00ced20 0x7fc5a01e8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.436 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc59ffff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 0x7fc5a01e1370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58630/0 (socket says 172.21.15.152:58630) 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.433+0000 7fc59ffff640 1 -- 172.21.15.152:0/2870679724 learned_addr learned my addr 172.21.15.152:0/2870679724 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 -- 172.21.15.152:0/2870679724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00ced20 msgr2=0x7fc5a01e8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc5a00ced20 0x7fc5a01e8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 -- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00b77d0 msgr2=0x7fc5a00c9700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc5a00b77d0 0x7fc5a00c9700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.437 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5a01e5f00 con 0x7fc5a00cdc40 2024-03-18T22:40:24.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59ffff640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 0x7fc5a01e1370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c400 tx=0x7fc58800c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588017070 con 0x7fc5a00cdc40 2024-03-18T22:40:24.438 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc588005d00 con 0x7fc5a00cdc40 2024-03-18T22:40:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5a01e61e0 con 0x7fc5a00cdc40 2024-03-18T22:40:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc588007310 con 0x7fc5a00cdc40 2024-03-18T22:40:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.434+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5a01e67a0 con 0x7fc5a00cdc40 2024-03-18T22:40:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.436+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc5a0068710 con 0x7fc5a00cdc40 2024-03-18T22:40:24.439 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.437+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc58801a070 con 0x7fc5a00cdc40 2024-03-18T22:40:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.438+0000 7fc59d7fa640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc58006bbd0 0x7fc58006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.439+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fc588089b60 con 0x7fc5a00cdc40 2024-03-18T22:40:24.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.439+0000 7fc5a4a74640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc58006bbd0 0x7fc58006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.439+0000 7fc59d7fa640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7fc580071a90 0x7fc580073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.439+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc580074560 con 0x7fc580071a90 2024-03-18T22:40:24.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.439+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fc58808e2a0 con 0x7fc5a00cdc40 2024-03-18T22:40:24.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.440+0000 7fc5a5275640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7fc580071a90 0x7fc580073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.440+0000 7fc5a4a74640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc58006bbd0 0x7fc58006e090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc590036000 tx=0x7fc59003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.440+0000 7fc5a5275640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7fc580071a90 0x7fc580073eb0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.442+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== osd.1 v2:172.21.15.152:6800/1305469316 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc580074560 con 0x7fc580071a90 2024-03-18T22:40:24.482 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.480+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 --> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc5a004f540 con 0x7fc580071a90 2024-03-18T22:40:24.483 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.481+0000 7fc59d7fa640 1 -- 172.21.15.152:0/2870679724 <== osd.1 v2:172.21.15.152:6800/1305469316 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc5a004f540 con 0x7fc580071a90 2024-03-18T22:40:24.483 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:24.483 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:24.483 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:24.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7fc580071a90 msgr2=0x7fc580073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.484 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6800/1305469316,v1:172.21.15.152:6801/1305469316] conn(0x7fc580071a90 0x7fc580073eb0 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc58006bbd0 msgr2=0x7fc58006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc58006bbd0 0x7fc58006e090 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fc590036000 tx=0x7fc59003d040 comp rx=0 tx=0).stop 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 msgr2=0x7fc5a01e1370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 --2- 172.21.15.152:0/2870679724 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc5a00cdc40 0x7fc5a01e1370 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fc58800c400 tx=0x7fc58800c8c0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a5275640 1 -- 172.21.15.152:0/2870679724 reap_dead start 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 shutdown_connections 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 >> 172.21.15.152:0/2870679724 conn(0x7fc5a00d1e00 msgr2=0x7fc5a01e5720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:24.485 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 shutdown_connections 2024-03-18T22:40:24.486 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.482+0000 7fc5a6cd8640 1 -- 172.21.15.152:0/2870679724 wait complete. 2024-03-18T22:40:24.509 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-03-18T22:40:24.787 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.785+0000 7f89b3330640 1 Processor -- start 2024-03-18T22:40:24.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.786+0000 7f89b3330640 1 -- start start 2024-03-18T22:40:24.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b3330640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f89ac0b36b0 0x7f89ac0d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.788 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b3330640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f89ac0aea80 0x7f89ac0d0620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b3330640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f89ac0ad9e0 con 0x7f89ac14bdf0 2024-03-18T22:40:24.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b3330640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f89ac0ad790 con 0x7f89ac0aea80 2024-03-18T22:40:24.789 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b3330640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f89ac0adcc0 con 0x7f89ac0b36b0 2024-03-18T22:40:24.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b18cd640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f89ac0aea80 0x7f89ac0d0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b10cc640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f89ac14bdf0 0x7f89ac0b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60316/0 (socket says 172.21.15.152:60316) 2024-03-18T22:40:24.790 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b10cc640 1 -- 172.21.15.152:0/2458417672 learned_addr learned my addr 172.21.15.152:0/2458417672 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:24.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.787+0000 7f89b08cb640 1 --2- 172.21.15.152:0/2458417672 >> v2:172.21.15.186:3300/0 conn(0x7f89ac0b36b0 0x7f89ac0d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.788+0000 7f89b18cd640 1 -- 172.21.15.152:0/2458417672 >> v2:172.21.15.186:3300/0 conn(0x7f89ac0b36b0 msgr2=0x7f89ac0d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:24.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.788+0000 7f89b18cd640 1 --2- 172.21.15.152:0/2458417672 >> v2:172.21.15.186:3300/0 conn(0x7f89ac0b36b0 0x7f89ac0d00e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.788+0000 7f89b18cd640 1 -- 172.21.15.152:0/2458417672 >> v1:172.21.15.152:6789/0 conn(0x7f89ac14bdf0 legacy=0x7f89ac0b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.791 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.788+0000 7f89b18cd640 1 -- 172.21.15.152:0/2458417672 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac0adfa0 con 0x7f89ac0aea80 2024-03-18T22:40:24.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.789+0000 7f89b18cd640 1 --2- 172.21.15.152:0/2458417672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac0aea80 0x7f89ac0d0620 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b4960 tx=0x7f89a402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f09d94d832df5b server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.792 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.789+0000 7f89a3fff640 1 -- 172.21.15.152:0/2458417672 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4035020 con 0x7f89ac0aea80 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.789+0000 7f89a3fff640 1 -- 172.21.15.152:0/2458417672 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a4031830 con 0x7f89ac0aea80 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.789+0000 7f89a3fff640 1 -- 172.21.15.152:0/2458417672 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4031c00 con 0x7f89ac0aea80 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 -- 172.21.15.152:0/2458417672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac0aea80 msgr2=0x7f89ac0d0620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 --2- 172.21.15.152:0/2458417672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac0aea80 0x7f89ac0d0620 secure :-1 s=READY pgs=3302 cs=0 l=1 rev1=1 crypto rx=0x7f89ac0b4960 tx=0x7f89a402b8d0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 -- 172.21.15.152:0/2458417672 shutdown_connections 2024-03-18T22:40:24.793 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 --2- 172.21.15.152:0/2458417672 >> v2:172.21.15.186:3300/0 conn(0x7f89ac0b36b0 0x7f89ac0d00e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 --2- 172.21.15.152:0/2458417672 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac0aea80 0x7f89ac0d0620 unknown :-1 s=CLOSED pgs=3302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 -- 172.21.15.152:0/2458417672 >> 172.21.15.152:0/2458417672 conn(0x7f89ac06b5e0 msgr2=0x7f89ac06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 -- 172.21.15.152:0/2458417672 shutdown_connections 2024-03-18T22:40:24.794 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.790+0000 7f89b3330640 1 -- 172.21.15.152:0/2458417672 wait complete. 2024-03-18T22:40:24.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 Processor -- start 2024-03-18T22:40:24.797 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 -- start start 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 0x7f89ac1473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac14c1d0 con 0x7f89ac14bdf0 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac0ae560 con 0x7f89ac1e9c80 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.792+0000 7f89b3330640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f89ac14c350 con 0x7f89ac0aea80 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b08cb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.798 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b08cb640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56742/0 (socket says 172.21.15.152:56742) 2024-03-18T22:40:24.799 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58642/0 (socket says 172.21.15.152:58642) 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b10cc640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 0x7f89ac1473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b08cb640 1 -- 172.21.15.152:0/3356622189 learned_addr learned my addr 172.21.15.152:0/3356622189 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 -- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 msgr2=0x7f89ac1473b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 0x7f89ac1473b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 -- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 msgr2=0x7f89ac1e81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.793+0000 7f89b18cd640 1 -- 172.21.15.152:0/3356622189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac1eabc0 con 0x7f89ac1e9c80 2024-03-18T22:40:24.800 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89b08cb640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89b10cc640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 0x7f89ac1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89b18cd640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89a4033000 tx=0x7f89a40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4035040 con 0x7f89ac1e9c80 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89a403b860 con 0x7f89ac1e9c80 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac1eaea0 con 0x7f89ac1e9c80 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.794+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a403bc50 con 0x7f89ac1e9c80 2024-03-18T22:40:24.801 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.795+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac1eb460 con 0x7f89ac1e9c80 2024-03-18T22:40:24.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.798+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac04f5b0 con 0x7f89ac1e9c80 2024-03-18T22:40:24.802 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.798+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f89a4038020 con 0x7f89ac1e9c80 2024-03-18T22:40:24.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.799+0000 7f89a1ffb640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 0x7f899006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:24.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.800+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f89a40ac2d0 con 0x7f89ac1e9c80 2024-03-18T22:40:24.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.800+0000 7f89b10cc640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 0x7f899006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:24.803 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.801+0000 7f89b10cc640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 0x7f899006e090 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f89a8005c00 tx=0x7f89a8009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:24.805 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:24.804+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f89a4031800 con 0x7f89ac1e9c80 2024-03-18T22:40:25.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.341+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f89ac0731b0 con 0x7f899006bbd0 2024-03-18T22:40:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.342+0000 7f89a1ffb640 1 -- 172.21.15.152:0/3356622189 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f89ac0731b0 con 0x7f899006bbd0 2024-03-18T22:40:25.344 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 1 to deep-scrub 2024-03-18T22:40:25.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 msgr2=0x7f899006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 0x7f899006e090 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f89a8005c00 tx=0x7f89a8009040 comp rx=0 tx=0).stop 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 msgr2=0x7f89ac1ea130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f89a4033000 tx=0x7f89a40046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 shutdown_connections 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f89ac1e9c80 0x7f89ac1ea130 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.350 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f89ac14bdf0 0x7f89ac1e81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f899006bbd0 0x7f899006e090 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 --2- 172.21.15.152:0/3356622189 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f89ac0aea80 0x7f89ac1473b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.351 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 >> 172.21.15.152:0/3356622189 conn(0x7f89ac06b5e0 msgr2=0x7f89ac0b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:25.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 shutdown_connections 2024-03-18T22:40:25.352 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.347+0000 7f89b3330640 1 -- 172.21.15.152:0/3356622189 wait complete. 2024-03-18T22:40:25.376 INFO:tasks.ceph:Scrubbing osd.2 2024-03-18T22:40:25.376 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:25.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.661+0000 7ff871c81640 1 Processor -- start 2024-03-18T22:40:25.663 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.661+0000 7ff871c81640 1 -- start start 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.663+0000 7ff871c81640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.663+0000 7ff871c81640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff86c0cfbe0 0x7ff86c0d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.663+0000 7ff871c81640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff86c15e870 con 0x7ff86c0d16c0 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.663+0000 7ff871c81640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7ff86c0d06b0 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.663+0000 7ff871c81640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0d1230 con 0x7ff86c15e490 2024-03-18T22:40:25.666 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86affd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7ff86c0cfbe0 0x7ff86c0d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86bfff640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7ff86c0d16c0 0x7ff86c161f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59714/0 (socket says 172.21.15.152:59714) 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86bfff640 1 -- 172.21.15.152:0/1964982726 learned_addr learned my addr 172.21.15.152:0/1964982726 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86b7fe640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86a7fc640 1 -- 172.21.15.152:0/1964982726 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1512427148 0 0) 0x7ff86c15e870 con 0x7ff86c0d16c0 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86a7fc640 1 -- 172.21.15.152:0/1964982726 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff854003520 con 0x7ff86c0d16c0 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86affd640 1 -- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 msgr2=0x7ff86c0cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:25.667 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86affd640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86affd640 1 -- 172.21.15.152:0/1964982726 >> v1:172.21.15.186:6789/0 conn(0x7ff86c0d16c0 legacy=0x7ff86c161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.664+0000 7ff86affd640 1 -- 172.21.15.152:0/1964982726 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0d0900 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.668 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.666+0000 7ff86affd640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c0d2660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8600097a0 tx=0x7ff86002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=25b6e68f7edabdf7 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.667+0000 7ff86a7fc640 1 -- 172.21.15.152:0/1964982726 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860031780 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.667+0000 7ff86a7fc640 1 -- 172.21.15.152:0/1964982726 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff860037070 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.667+0000 7ff86a7fc640 1 -- 172.21.15.152:0/1964982726 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff860031b40 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 -- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 msgr2=0x7ff86c0d2660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c0d2660 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7ff8600097a0 tx=0x7ff86002b820 comp rx=0 tx=0).stop 2024-03-18T22:40:25.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 -- 172.21.15.152:0/1964982726 shutdown_connections 2024-03-18T22:40:25.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c0d2660 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 --2- 172.21.15.152:0/1964982726 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 -- 172.21.15.152:0/1964982726 >> 172.21.15.152:0/1964982726 conn(0x7ff86c0d4080 msgr2=0x7ff86c0d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:25.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.668+0000 7ff871c81640 1 -- 172.21.15.152:0/1964982726 shutdown_connections 2024-03-18T22:40:25.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.669+0000 7ff871c81640 1 -- 172.21.15.152:0/1964982726 wait complete. 2024-03-18T22:40:25.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.672+0000 7ff871c81640 1 Processor -- start 2024-03-18T22:40:25.673 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.672+0000 7ff871c81640 1 -- start start 2024-03-18T22:40:25.676 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c14e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff86c0d16c0 0x7ff86c0cb150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0c9c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c0d2220 con 0x7ff86c0d16c0 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7ff86c0d0ec0 con 0x7ff86c0cfbe0 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff871c81640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7ff86c0d23a0 con 0x7ff86c15e490 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.674+0000 7ff86affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff86c0d16c0 0x7ff86c0cb150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.677 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0c9c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86b7fe640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c14e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86affd640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff86c0d16c0 0x7ff86c0cb150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56756/0 (socket says 172.21.15.152:56756) 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86affd640 1 -- 172.21.15.152:0/2691382767 learned_addr learned my addr 172.21.15.152:0/2691382767 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0c9c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:45776/0 (socket says 172.21.15.152:45776) 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 -- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 msgr2=0x7ff86c14e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7ff86c0cfbe0 0x7ff86c14e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 -- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff86c0d16c0 msgr2=0x7ff86c0cb150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.678 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7ff86c0d16c0 0x7ff86c0cb150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.679 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff86c0ccda0 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.675+0000 7ff86bfff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0c9c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff86400ca80 tx=0x7ff86400cf40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.676+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864017070 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.676+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff86400ac30 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.676+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff86c0cd080 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.676+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff864012600 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.676+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff86c0cd640 con 0x7ff86c15e490 2024-03-18T22:40:25.680 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.677+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7ff86401a070 con 0x7ff86c15e490 2024-03-18T22:40:25.681 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.678+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff86c068710 con 0x7ff86c15e490 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.678+0000 7ff853fff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff85806bbd0 0x7ff85806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff86b7fe640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff85806bbd0 0x7ff85806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7ff86408a400 con 0x7ff86c15e490 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff853fff640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7ff858071a90 0x7ff858073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff864013e50 con 0x7ff858071a90 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7ff864091050 con 0x7ff86c15e490 2024-03-18T22:40:25.682 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.679+0000 7ff86affd640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7ff858071a90 0x7ff858073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.680+0000 7ff86b7fe640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff85806bbd0 0x7ff85806e090 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009b40 tx=0x7ff85c009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.680+0000 7ff86affd640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7ff858071a90 0x7ff858073eb0 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.683 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.682+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== osd.2 v2:172.21.15.152:6812/2040307032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff864013e50 con 0x7ff858071a90 2024-03-18T22:40:25.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.696+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 --> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ff86c04f540 con 0x7ff858071a90 2024-03-18T22:40:25.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff853fff640 1 -- 172.21.15.152:0/2691382767 <== osd.2 v2:172.21.15.152:6812/2040307032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ff86c04f540 con 0x7ff858071a90 2024-03-18T22:40:25.699 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:25.699 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:25.699 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:25.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7ff858071a90 msgr2=0x7ff858073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6812/2040307032,v1:172.21.15.152:6815/2040307032] conn(0x7ff858071a90 0x7ff858073eb0 crc :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff85806bbd0 msgr2=0x7ff85806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7ff85806bbd0 0x7ff85806e090 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7ff85c009b40 tx=0x7ff85c009190 comp rx=0 tx=0).stop 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 msgr2=0x7ff86c0c9c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 --2- 172.21.15.152:0/2691382767 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7ff86c15e490 0x7ff86c0c9c70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ff86400ca80 tx=0x7ff86400cf40 comp rx=0 tx=0).stop 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff86bfff640 1 -- 172.21.15.152:0/2691382767 reap_dead start 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 shutdown_connections 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.697+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 >> 172.21.15.152:0/2691382767 conn(0x7ff86c0d4080 msgr2=0x7ff86c0b3b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.698+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 shutdown_connections 2024-03-18T22:40:25.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.698+0000 7ff871c81640 1 -- 172.21.15.152:0/2691382767 wait complete. 2024-03-18T22:40:25.714 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-03-18T22:40:25.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.883+0000 7f5a11f77640 1 Processor -- start 2024-03-18T22:40:25.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.883+0000 7f5a11f77640 1 -- start start 2024-03-18T22:40:25.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a11f77640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a0c0d18a0 0x7f5a0c0af770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a11f77640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a11f77640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a0c15f9d0 con 0x7f5a0c1589d0 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a11f77640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5a0c0ae9b0 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a11f77640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0c0aec90 con 0x7f5a0c15ec80 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a0c0d18a0 0x7f5a0c0af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5a0c0d18a0 0x7f5a0c0af770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58676/0 (socket says 172.21.15.152:58676) 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 -- 172.21.15.152:0/1450929353 learned_addr learned my addr 172.21.15.152:0/1450929353 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0bfff640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 -- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 msgr2=0x7f5a0c15f130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:25.887 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15f130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 -- 172.21.15.152:0/1450929353 >> v1:172.21.15.186:6789/0 conn(0x7f5a0c1589d0 legacy=0x7f5a0c0d1190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0affd640 1 -- 172.21.15.152:0/1450929353 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c0aef70 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.888 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.884+0000 7f5a0bfff640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T22:40:25.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.885+0000 7f5a0affd640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0af770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009870 tx=0x7f5a0002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7c1af07ca8db42ae server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.885+0000 7f5a0a7fc640 1 -- 172.21.15.152:0/1450929353 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00034070 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.885+0000 7f5a0a7fc640 1 -- 172.21.15.152:0/1450929353 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a00030840 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.889 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.885+0000 7f5a0a7fc640 1 -- 172.21.15.152:0/1450929353 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a00030c10 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 -- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c0d18a0 msgr2=0x7f5a0c0af770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0af770 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f5a00009870 tx=0x7f5a0002b980 comp rx=0 tx=0).stop 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 -- 172.21.15.152:0/1450929353 shutdown_connections 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15f130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 --2- 172.21.15.152:0/1450929353 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0af770 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 -- 172.21.15.152:0/1450929353 >> 172.21.15.152:0/1450929353 conn(0x7f5a0c06c4b0 msgr2=0x7f5a0c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:25.890 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 -- 172.21.15.152:0/1450929353 shutdown_connections 2024-03-18T22:40:25.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.887+0000 7f5a11f77640 1 -- 172.21.15.152:0/1450929353 wait complete. 2024-03-18T22:40:25.891 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.890+0000 7f5a11f77640 1 Processor -- start 2024-03-18T22:40:25.892 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.890+0000 7f5a11f77640 1 -- start start 2024-03-18T22:40:25.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0b1400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c1589d0 0x7f5a0c1345d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.894 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c158db0 con 0x7f5a0c0d18a0 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5a0c15f670 con 0x7f5a0c1589d0 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.892+0000 7f5a11f77640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5a0c158f30 con 0x7f5a0c15ec80 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0b1400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0b7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0b1400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56758/0 (socket says 172.21.15.152:56758) 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.895 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0b7fe640 1 -- 172.21.15.152:0/3173485815 learned_addr learned my addr 172.21.15.152:0/3173485815 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:25.896 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0affd640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c1589d0 0x7f5a0c1345d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 -- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c1589d0 msgr2=0x7f5a0c1345d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c1589d0 0x7f5a0c1345d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 -- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 msgr2=0x7f5a0c0b1400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:25.897 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0b1400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 -- 172.21.15.152:0/3173485815 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a0c134b10 con 0x7f5a0c15ec80 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.893+0000 7f5a0bfff640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15a0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007db0 tx=0x7f5a0400d4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.894+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a0401a070 con 0x7f5a0c15ec80 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.894+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a04003990 con 0x7f5a0c15ec80 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.894+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a0c146a50 con 0x7f5a0c15ec80 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.894+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a04003d80 con 0x7f5a0c15ec80 2024-03-18T22:40:25.898 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.894+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a0c15b4d0 con 0x7f5a0c15ec80 2024-03-18T22:40:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.896+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5a0401d070 con 0x7f5a0c15ec80 2024-03-18T22:40:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.896+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a0c1423f0 con 0x7f5a0c15ec80 2024-03-18T22:40:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.896+0000 7f59f3fff640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 0x7f59f806e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:25.899 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.897+0000 7f5a0b7fe640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 0x7f59f806e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.897+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f5a0408a9b0 con 0x7f5a0c15ec80 2024-03-18T22:40:25.900 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.898+0000 7f5a0b7fe640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 0x7f59f806e0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001840 tx=0x7f59fc009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:25.903 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:25.901+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f5a04010070 con 0x7f5a0c15ec80 2024-03-18T22:40:26.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.439+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f5a0c04f5b0 con 0x7f59f806bc00 2024-03-18T22:40:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.440+0000 7f59f3fff640 1 -- 172.21.15.152:0/3173485815 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5a0c04f5b0 con 0x7f59f806bc00 2024-03-18T22:40:26.442 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 2 to deep-scrub 2024-03-18T22:40:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 msgr2=0x7f59f806e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 0x7f59f806e0c0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f59fc001840 tx=0x7f59fc009040 comp rx=0 tx=0).stop 2024-03-18T22:40:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 msgr2=0x7f5a0c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15a0f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5a04007db0 tx=0x7f5a0400d4a0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 shutdown_connections 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f59f806bc00 0x7f59f806e0c0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5a0c15ec80 0x7f5a0c15a0f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5a0c1589d0 0x7f5a0c1345d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 --2- 172.21.15.152:0/3173485815 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5a0c0d18a0 0x7f5a0c0b1400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.445+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 >> 172.21.15.152:0/3173485815 conn(0x7f5a0c06c4b0 msgr2=0x7f5a0c14e620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.446+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 shutdown_connections 2024-03-18T22:40:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.446+0000 7f5a11f77640 1 -- 172.21.15.152:0/3173485815 wait complete. 2024-03-18T22:40:26.474 INFO:tasks.ceph:Scrubbing osd.3 2024-03-18T22:40:26.475 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.755+0000 7fa196908640 1 Processor -- start 2024-03-18T22:40:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.756+0000 7fa196908640 1 -- start start 2024-03-18T22:40:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa196908640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa19015e490 0x7fa1900cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa196908640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 0x7fa1900d2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa196908640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa19015e870 con 0x7fa1900d16c0 2024-03-18T22:40:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa196908640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fa1900d06b0 con 0x7fa1900cfbe0 2024-03-18T22:40:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa196908640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fa1900d1230 con 0x7fa19015e490 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa18f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 0x7fa1900d2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa18f7fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 0x7fa1900d2660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56766/0 (socket says 172.21.15.152:56766) 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa18f7fe640 1 -- 172.21.15.152:0/3629988174 learned_addr learned my addr 172.21.15.152:0/3629988174 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.758+0000 7fa18ffff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fa19015e490 0x7fa1900cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18effd640 1 -- 172.21.15.152:0/3629988174 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1710829708 0 0) 0x7fa19015e870 con 0x7fa1900d16c0 2024-03-18T22:40:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18effd640 1 -- 172.21.15.152:0/3629988174 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa178003520 con 0x7fa1900d16c0 2024-03-18T22:40:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18ffff640 1 -- 172.21.15.152:0/3629988174 >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 msgr2=0x7fa1900d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18ffff640 1 --2- 172.21.15.152:0/3629988174 >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 0x7fa1900d2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18ffff640 1 -- 172.21.15.152:0/3629988174 >> v1:172.21.15.186:6789/0 conn(0x7fa1900d16c0 legacy=0x7fa190161f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.759+0000 7fa18ffff640 1 -- 172.21.15.152:0/3629988174 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1900d0900 con 0x7fa19015e490 2024-03-18T22:40:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.761+0000 7fa18ffff640 1 --2- 172.21.15.152:0/3629988174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa19015e490 0x7fa1900cf6a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b6bc0 tx=0x7fa18002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f75b20fb224bf15 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.761+0000 7fa18effd640 1 -- 172.21.15.152:0/3629988174 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1800315a0 con 0x7fa19015e490 2024-03-18T22:40:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.761+0000 7fa18effd640 1 -- 172.21.15.152:0/3629988174 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa180037070 con 0x7fa19015e490 2024-03-18T22:40:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.761+0000 7fa18effd640 1 -- 172.21.15.152:0/3629988174 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa180031940 con 0x7fa19015e490 2024-03-18T22:40:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 -- 172.21.15.152:0/3629988174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa19015e490 msgr2=0x7fa1900cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 --2- 172.21.15.152:0/3629988174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa19015e490 0x7fa1900cf6a0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa1900b6bc0 tx=0x7fa18002b840 comp rx=0 tx=0).stop 2024-03-18T22:40:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 -- 172.21.15.152:0/3629988174 shutdown_connections 2024-03-18T22:40:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 --2- 172.21.15.152:0/3629988174 >> v2:172.21.15.152:3300/0 conn(0x7fa1900cfbe0 0x7fa1900d2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 --2- 172.21.15.152:0/3629988174 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa19015e490 0x7fa1900cf6a0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.762+0000 7fa196908640 1 -- 172.21.15.152:0/3629988174 >> 172.21.15.152:0/3629988174 conn(0x7fa1900d4080 msgr2=0x7fa1900d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.763+0000 7fa196908640 1 -- 172.21.15.152:0/3629988174 shutdown_connections 2024-03-18T22:40:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.763+0000 7fa196908640 1 -- 172.21.15.152:0/3629988174 wait complete. 2024-03-18T22:40:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.766+0000 7fa196908640 1 Processor -- start 2024-03-18T22:40:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.766+0000 7fa196908640 1 -- start start 2024-03-18T22:40:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1900cfbe0 0x7fa1901595c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1900d16c0 0x7fa1900a01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 0x7fa1900cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900d2220 con 0x7fa19015e490 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fa1900d0ec0 con 0x7fa1900cfbe0 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa196908640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fa1900d23a0 con 0x7fa1900d16c0 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.768+0000 7fa194ea5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 0x7fa1900cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 0x7fa1900cc920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56768/0 (socket says 172.21.15.152:56768) 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 -- 172.21.15.152:0/3103866578 learned_addr learned my addr 172.21.15.152:0/3103866578 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa18ffff640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1900cfbe0 0x7fa1901595c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa18f7fe640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1900d16c0 0x7fa1900a01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 -- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1900d16c0 msgr2=0x7fa1900a01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1900d16c0 0x7fa1900a01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 -- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1900cfbe0 msgr2=0x7fa1901595c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fa1900cfbe0 0x7fa1901595c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1900cd3c0 con 0x7fa19015e490 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa18f7fe640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fa1900d16c0 0x7fa1900a01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.769+0000 7fa194ea5640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 0x7fa1900cc920 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c790 tx=0x7fa18800cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.770+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa188003b70 con 0x7fa19015e490 2024-03-18T22:40:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.770+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa188003d10 con 0x7fa19015e490 2024-03-18T22:40:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.770+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa18800aa50 con 0x7fa19015e490 2024-03-18T22:40:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.770+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1900cd6a0 con 0x7fa19015e490 2024-03-18T22:40:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.770+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa19009dff0 con 0x7fa19015e490 2024-03-18T22:40:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.772+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1900cd8e0 con 0x7fa19015e490 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.772+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fa18800abf0 con 0x7fa19015e490 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18cff9640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa17c06bbd0 0x7fa17c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fa18808a500 con 0x7fa19015e490 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18cff9640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fa17c071a90 0x7fa17c073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa188010e50 con 0x7fa17c071a90 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7fa188091050 con 0x7fa19015e490 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18ffff640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa17c06bbd0 0x7fa17c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.773+0000 7fa18f7fe640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fa17c071a90 0x7fa17c073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.774+0000 7fa18f7fe640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fa17c071a90 0x7fa17c073eb0 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.774+0000 7fa18ffff640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa17c06bbd0 0x7fa17c06e090 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa180036000 tx=0x7fa18003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.776+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== osd.3 v2:172.21.15.152:6824/602992539 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa188010e50 con 0x7fa17c071a90 2024-03-18T22:40:26.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.814+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 --> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa190068710 con 0x7fa17c071a90 2024-03-18T22:40:26.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.814+0000 7fa18cff9640 1 -- 172.21.15.152:0/3103866578 <== osd.3 v2:172.21.15.152:6824/602992539 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa184016420 con 0x7fa17c071a90 2024-03-18T22:40:26.816 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:26.816 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:26.816 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fa17c071a90 msgr2=0x7fa17c073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6824/602992539,v1:172.21.15.152:6825/602992539] conn(0x7fa17c071a90 0x7fa17c073eb0 crc :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:26.817 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa17c06bbd0 msgr2=0x7fa17c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fa17c06bbd0 0x7fa17c06e090 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fa180036000 tx=0x7fa18003d040 comp rx=0 tx=0).stop 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 msgr2=0x7fa1900cc920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 --2- 172.21.15.152:0/3103866578 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fa19015e490 0x7fa1900cc920 secure :-1 s=READY pgs=3303 cs=0 l=1 rev1=1 crypto rx=0x7fa18800c790 tx=0x7fa18800cc50 comp rx=0 tx=0).stop 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa194ea5640 1 -- 172.21.15.152:0/3103866578 reap_dead start 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 shutdown_connections 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 >> 172.21.15.152:0/3103866578 conn(0x7fa1900d4080 msgr2=0x7fa1900b2270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 shutdown_connections 2024-03-18T22:40:26.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:26.815+0000 7fa196908640 1 -- 172.21.15.152:0/3103866578 wait complete. 2024-03-18T22:40:26.840 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-03-18T22:40:27.112 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.110+0000 7fd6a2508640 1 Processor -- start 2024-03-18T22:40:27.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.111+0000 7fd6a2508640 1 -- start start 2024-03-18T22:40:27.113 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.111+0000 7fd6a2508640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7fd69c14bdf0 0x7fd69c0b2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a2508640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 0x7fd69c0b34e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a2508640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd69c0ad9e0 con 0x7fd69c0d00e0 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a2508640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7fd69c0ad790 con 0x7fd69c14bdf0 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a2508640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c0adcc0 con 0x7fd69c0aea80 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a0aa5640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fd69c0d00e0 0x7fd69c06cc70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60326/0 (socket says 172.21.15.152:60326) 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd6a0aa5640 1 -- 172.21.15.152:0/3249802325 learned_addr learned my addr 172.21.15.152:0/3249802325 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd69bfff640 1 --2- 172.21.15.152:0/3249802325 >> v2:172.21.15.186:3300/0 conn(0x7fd69c14bdf0 0x7fd69c0b2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.114 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.112+0000 7fd69b7fe640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 0x7fd69c0b34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69affd640 1 -- 172.21.15.152:0/3249802325 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3204796222 0 0) 0x7fd69c0ad9e0 con 0x7fd69c0d00e0 2024-03-18T22:40:27.115 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69affd640 1 -- 172.21.15.152:0/3249802325 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd684003520 con 0x7fd69c0d00e0 2024-03-18T22:40:27.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69bfff640 1 -- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 msgr2=0x7fd69c0b34e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:27.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69bfff640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 0x7fd69c0b34e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69bfff640 1 -- 172.21.15.152:0/3249802325 >> v1:172.21.15.152:6789/0 conn(0x7fd69c0d00e0 legacy=0x7fd69c06cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69bfff640 1 -- 172.21.15.152:0/3249802325 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c0adfa0 con 0x7fd69c14bdf0 2024-03-18T22:40:27.116 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.113+0000 7fd69b7fe640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 0x7fd69c0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:27.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.115+0000 7fd69bfff640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c14bdf0 0x7fd69c0b2fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0097a0 tx=0x7fd68c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e44678b00c24af2a server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.115+0000 7fd69affd640 1 -- 172.21.15.152:0/3249802325 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c035020 con 0x7fd69c14bdf0 2024-03-18T22:40:27.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.115+0000 7fd69affd640 1 -- 172.21.15.152:0/3249802325 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68c031830 con 0x7fd69c14bdf0 2024-03-18T22:40:27.117 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.115+0000 7fd69affd640 1 -- 172.21.15.152:0/3249802325 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c031be0 con 0x7fd69c14bdf0 2024-03-18T22:40:27.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 -- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c14bdf0 msgr2=0x7fd69c0b2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.121 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c14bdf0 0x7fd69c0b2fa0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd68c0097a0 tx=0x7fd68c02b8d0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 -- 172.21.15.152:0/3249802325 shutdown_connections 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0aea80 0x7fd69c0b34e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 --2- 172.21.15.152:0/3249802325 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c14bdf0 0x7fd69c0b2fa0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 -- 172.21.15.152:0/3249802325 >> 172.21.15.152:0/3249802325 conn(0x7fd69c06b5e0 msgr2=0x7fd69c06b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 -- 172.21.15.152:0/3249802325 shutdown_connections 2024-03-18T22:40:27.122 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.117+0000 7fd6a2508640 1 -- 172.21.15.152:0/3249802325 wait complete. 2024-03-18T22:40:27.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.120+0000 7fd6a2508640 1 Processor -- start 2024-03-18T22:40:27.123 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 -- start start 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 0x7fd69c145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 0x7fd69c1f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 0x7fd69c1487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c14c1d0 con 0x7fd69c14bdf0 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fd69c0ae560 con 0x7fd69c0aea80 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.121+0000 7fd6a2508640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fd69c14c350 con 0x7fd69c0d00e0 2024-03-18T22:40:27.124 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd6a0aa5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 0x7fd69c1487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd6a0aa5640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 0x7fd69c1487c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56778/0 (socket says 172.21.15.152:56778) 2024-03-18T22:40:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 0x7fd69c145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69b7fe640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 0x7fd69c1f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.125 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd6a0aa5640 1 -- 172.21.15.152:0/1684763678 learned_addr learned my addr 172.21.15.152:0/1684763678 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:27.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 -- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 msgr2=0x7fd69c1f8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 0x7fd69c1f8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.126 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 -- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 msgr2=0x7fd69c1487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 0x7fd69c1487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69bfff640 1 -- 172.21.15.152:0/1684763678 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd69c1f93e0 con 0x7fd69c0aea80 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.122+0000 7fd69b7fe640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 0x7fd69c1f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd69bfff640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 0x7fd69c145400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033000 tx=0x7fd68c0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c035040 con 0x7fd69c0aea80 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd68c03b840 con 0x7fd69c0aea80 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd69c164170 con 0x7fd69c0aea80 2024-03-18T22:40:27.127 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd68c03bbf0 con 0x7fd69c0aea80 2024-03-18T22:40:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.123+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd69c1f86a0 con 0x7fd69c0aea80 2024-03-18T22:40:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.126+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd69c1f8490 con 0x7fd69c0aea80 2024-03-18T22:40:27.128 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.127+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fd68c038020 con 0x7fd69c0aea80 2024-03-18T22:40:27.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.127+0000 7fd698ff9640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 0x7fd68806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.129 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.128+0000 7fd69b7fe640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 0x7fd68806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.128+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fd68c0ac610 con 0x7fd69c0aea80 2024-03-18T22:40:27.130 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.128+0000 7fd69b7fe640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 0x7fd68806e090 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd69c14a970 tx=0x7fd690009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.132+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fd69c1f93e0 con 0x7fd69c0aea80 2024-03-18T22:40:27.664 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.663+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fd69c04f5b0 con 0x7fd68806bbd0 2024-03-18T22:40:27.665 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.663+0000 7fd698ff9640 1 -- 172.21.15.152:0/1684763678 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd69c04f5b0 con 0x7fd68806bbd0 2024-03-18T22:40:27.665 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 3 to deep-scrub 2024-03-18T22:40:27.669 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.667+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 msgr2=0x7fd68806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.667+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 0x7fd68806e090 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fd69c14a970 tx=0x7fd690009190 comp rx=0 tx=0).stop 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.667+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 msgr2=0x7fd69c145400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.667+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 0x7fd69c145400 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd68c033000 tx=0x7fd68c0046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 shutdown_connections 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fd69c14bdf0 0x7fd69c1487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fd68806bbd0 0x7fd68806e090 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.670 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fd69c0d00e0 0x7fd69c1f8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 --2- 172.21.15.152:0/1684763678 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fd69c0aea80 0x7fd69c145400 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 >> 172.21.15.152:0/1684763678 conn(0x7fd69c06b5e0 msgr2=0x7fd69c0b0510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:27.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 shutdown_connections 2024-03-18T22:40:27.671 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.668+0000 7fd6a2508640 1 -- 172.21.15.152:0/1684763678 wait complete. 2024-03-18T22:40:27.697 INFO:tasks.ceph:Scrubbing osd.4 2024-03-18T22:40:27.697 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:27.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.971+0000 7f5affc14640 1 Processor -- start 2024-03-18T22:40:27.973 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.972+0000 7f5affc14640 1 -- start start 2024-03-18T22:40:27.975 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5affc14640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 0x7f5af80cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5affc14640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5affc14640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5af815e870 con 0x7f5af80cfbe0 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5affc14640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f5af80d06b0 con 0x7f5af815e490 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5affc14640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5af80d1230 con 0x7f5af80d2d70 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afe1b1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afe1b1640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:45810/0 (socket says 172.21.15.152:45810) 2024-03-18T22:40:27.976 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afd9b0640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 0x7f5af80cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2387869757 learned_addr learned my addr 172.21.15.152:0/2387869757 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:27.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afd1af640 1 --1- 172.21.15.152:0/2387869757 >> v1:172.21.15.186:6789/0 conn(0x7f5af80cfbe0 0x7f5af80d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59730/0 (socket says 172.21.15.152:59730) 2024-03-18T22:40:27.977 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.974+0000 7f5afc9ae640 1 -- 172.21.15.152:0/2387869757 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977020738 0 0) 0x7f5af815e870 con 0x7f5af80cfbe0 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afc9ae640 1 -- 172.21.15.152:0/2387869757 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5ae4003520 con 0x7f5af80cfbe0 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2387869757 >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 msgr2=0x7f5af80cf6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afe1b1640 1 --2- 172.21.15.152:0/2387869757 >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 0x7f5af80cf6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2387869757 >> v1:172.21.15.186:6789/0 conn(0x7f5af80cfbe0 legacy=0x7f5af80d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2387869757 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af80d0900 con 0x7f5af80d2d70 2024-03-18T22:40:27.978 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.975+0000 7f5afd9b0640 1 --2- 172.21.15.152:0/2387869757 >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 0x7f5af80cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:27.979 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.977+0000 7f5afe1b1640 1 --2- 172.21.15.152:0/2387869757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d1e6c044411a0919 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.977+0000 7f5afc9ae640 1 -- 172.21.15.152:0/2387869757 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af002ca70 con 0x7f5af80d2d70 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.977+0000 7f5afc9ae640 1 -- 172.21.15.152:0/2387869757 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af002cc10 con 0x7f5af80d2d70 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.977+0000 7f5afc9ae640 1 -- 172.21.15.152:0/2387869757 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af00343f0 con 0x7f5af80d2d70 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 -- 172.21.15.152:0/2387869757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 msgr2=0x7f5af80b39b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 --2- 172.21.15.152:0/2387869757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5af0009e50 tx=0x7f5af002bed0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 -- 172.21.15.152:0/2387869757 shutdown_connections 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 --2- 172.21.15.152:0/2387869757 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af80b39b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.980 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 --2- 172.21.15.152:0/2387869757 >> v2:172.21.15.186:3300/0 conn(0x7f5af815e490 0x7f5af80cf6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 -- 172.21.15.152:0/2387869757 >> 172.21.15.152:0/2387869757 conn(0x7f5af80d4080 msgr2=0x7f5af80d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:27.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 -- 172.21.15.152:0/2387869757 shutdown_connections 2024-03-18T22:40:27.981 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.978+0000 7f5affc14640 1 -- 172.21.15.152:0/2387869757 wait complete. 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.979+0000 7f5affc14640 1 Processor -- start 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.979+0000 7f5affc14640 1 -- start start 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af80cfbe0 0x7f5af80cb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af815a5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 0x7f5af814c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f5af80d2220 con 0x7f5af80cfbe0 2024-03-18T22:40:27.983 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f5af80d0ec0 con 0x7f5af815e490 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5affc14640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f5af80d23a0 con 0x7f5af80d2d70 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5afe1b1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 0x7f5af814c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5afd9b0640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af80cfbe0 0x7f5af80cb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5afe1b1640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 0x7f5af814c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58738/0 (socket says 172.21.15.152:58738) 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2163776963 learned_addr learned my addr 172.21.15.152:0/2163776963 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.980+0000 7f5afd1af640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af815a5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 msgr2=0x7f5af815a5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.984 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f5af80d2d70 0x7f5af815a5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af80cfbe0 msgr2=0x7f5af80cb640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f5af80cfbe0 0x7f5af80cb640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af80ce1b0 con 0x7f5af815e490 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5afe1b1640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 0x7f5af814c7e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5af0036040 tx=0x7f5af0004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0043020 con 0x7f5af815e490 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5af0003e10 con 0x7f5af815e490 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af80ce490 con 0x7f5af815e490 2024-03-18T22:40:27.985 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5af0009510 con 0x7f5af815e490 2024-03-18T22:40:27.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.981+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af814aad0 con 0x7f5af815e490 2024-03-18T22:40:27.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.983+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5af8068710 con 0x7f5af815e490 2024-03-18T22:40:27.986 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.984+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f5af0046020 con 0x7f5af815e490 2024-03-18T22:40:27.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5aee7fc640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5adc06bbd0 0x7f5adc06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f5af00ac9f0 con 0x7f5af815e490 2024-03-18T22:40:27.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5aee7fc640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f5adc071a90 0x7f5adc073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:27.987 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5af003ce50 con 0x7f5adc071a90 2024-03-18T22:40:27.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f5af00774c0 con 0x7f5af815e490 2024-03-18T22:40:27.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5afd9b0640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5adc06bbd0 0x7f5adc06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.985+0000 7f5afd1af640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f5adc071a90 0x7f5adc073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:27.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.986+0000 7f5afd9b0640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5adc06bbd0 0x7f5adc06e090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5af80cb400 tx=0x7f5af4009190 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.986+0000 7f5afd1af640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f5adc071a90 0x7f5adc073eb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:27.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:27.987+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== osd.4 v2:172.21.15.186:6800/4143159879 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5af003ce50 con 0x7f5adc071a90 2024-03-18T22:40:28.026 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.025+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 --> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f5af804f540 con 0x7f5adc071a90 2024-03-18T22:40:28.027 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.025+0000 7f5aee7fc640 1 -- 172.21.15.152:0/2163776963 <== osd.4 v2:172.21.15.186:6800/4143159879 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f5af804f540 con 0x7f5adc071a90 2024-03-18T22:40:28.027 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:28.027 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:28.028 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f5adc071a90 msgr2=0x7f5adc073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:6800/4143159879,v1:172.21.15.186:6801/4143159879] conn(0x7f5adc071a90 0x7f5adc073eb0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.029 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5adc06bbd0 msgr2=0x7f5adc06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f5adc06bbd0 0x7f5adc06e090 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f5af80cb400 tx=0x7f5af4009190 comp rx=0 tx=0).stop 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 msgr2=0x7f5af814c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5affc14640 1 --2- 172.21.15.152:0/2163776963 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f5af815e490 0x7f5af814c7e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f5af0036040 tx=0x7f5af0004a40 comp rx=0 tx=0).stop 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.026+0000 7f5afe1b1640 1 -- 172.21.15.152:0/2163776963 reap_dead start 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.027+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 shutdown_connections 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.027+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 >> 172.21.15.152:0/2163776963 conn(0x7f5af80d4080 msgr2=0x7f5af80b5410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.027+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 shutdown_connections 2024-03-18T22:40:28.030 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.027+0000 7f5affc14640 1 -- 172.21.15.152:0/2163776963 wait complete. 2024-03-18T22:40:28.052 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-03-18T22:40:28.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.325+0000 7f8e50fa7640 1 Processor -- start 2024-03-18T22:40:28.327 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.325+0000 7f8e50fa7640 1 -- start start 2024-03-18T22:40:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.327+0000 7f8e50fa7640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 0x7f8e4c15f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.329 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.327+0000 7f8e50fa7640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8e4c067270 0x7f8e4c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.327+0000 7f8e50fa7640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8e4c15f720 con 0x7f8e4c0b3aa0 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.327+0000 7f8e50fa7640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c0cff80 con 0x7f8e4c158a00 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.327+0000 7f8e50fa7640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f8e4c06e4d0 con 0x7f8e4c067270 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e4a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 0x7f8e4c15f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8e4c067270 0x7f8e4c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e4a59c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 0x7f8e4c15f1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56800/0 (socket says 172.21.15.152:56800) 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f8e4c067270 0x7f8e4c0b3560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3300/0 says I am v2:172.21.15.152:58740/0 (socket says 172.21.15.152:58740) 2024-03-18T22:40:28.330 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 -- 172.21.15.152:0/1249651620 learned_addr learned my addr 172.21.15.152:0/1249651620 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:28.331 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 -- 172.21.15.152:0/1249651620 >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 msgr2=0x7f8e4c15f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/1249651620 >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 0x7f8e4c15f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 -- 172.21.15.152:0/1249651620 >> v1:172.21.15.186:6789/0 conn(0x7f8e4c0b3aa0 legacy=0x7f8e4c161da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.328+0000 7f8e41d9b640 1 -- 172.21.15.152:0/1249651620 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c06d8c0 con 0x7f8e4c067270 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.329+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/1249651620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c067270 0x7f8e4c0b3560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0714a0 tx=0x7f8e3402b880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ed57d2de8c4e9568 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.329+0000 7f8e49d9b640 1 -- 172.21.15.152:0/1249651620 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3402e070 con 0x7f8e4c067270 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.330+0000 7f8e49d9b640 1 -- 172.21.15.152:0/1249651620 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e34037070 con 0x7f8e4c067270 2024-03-18T22:40:28.332 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.330+0000 7f8e49d9b640 1 -- 172.21.15.152:0/1249651620 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e34031a00 con 0x7f8e4c067270 2024-03-18T22:40:28.333 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 -- 172.21.15.152:0/1249651620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c067270 msgr2=0x7f8e4c0b3560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/1249651620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c067270 0x7f8e4c0b3560 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8e4c0714a0 tx=0x7f8e3402b880 comp rx=0 tx=0).stop 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 -- 172.21.15.152:0/1249651620 shutdown_connections 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/1249651620 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c067270 0x7f8e4c0b3560 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/1249651620 >> v2:172.21.15.152:3300/0 conn(0x7f8e4c158a00 0x7f8e4c15f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 -- 172.21.15.152:0/1249651620 >> 172.21.15.152:0/1249651620 conn(0x7f8e4c0d04d0 msgr2=0x7f8e4c0d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 -- 172.21.15.152:0/1249651620 shutdown_connections 2024-03-18T22:40:28.334 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.331+0000 7f8e50fa7640 1 -- 172.21.15.152:0/1249651620 wait complete. 2024-03-18T22:40:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.335+0000 7f8e50fa7640 1 Processor -- start 2024-03-18T22:40:28.337 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.336+0000 7f8e50fa7640 1 -- start start 2024-03-18T22:40:28.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 0x7f8e4c0b0f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.339 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e4c158a00 0x7f8e4c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c06de80 con 0x7f8e4c158a00 2024-03-18T22:40:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f8e4c0b3ed0 con 0x7f8e4c0b3aa0 2024-03-18T22:40:28.340 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e50fa7640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f8e4c06e160 con 0x7f8e4c067270 2024-03-18T22:40:28.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4ad9d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e4c158a00 0x7f8e4c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.341 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:45826/0 (socket says 172.21.15.152:45826) 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 -- 172.21.15.152:0/3018485859 learned_addr learned my addr 172.21.15.152:0/3018485859 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 0x7f8e4c0b0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 -- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 msgr2=0x7f8e4c0b0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 0x7f8e4c0b0f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 -- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e4c158a00 msgr2=0x7f8e4c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.338+0000 7f8e4a59c640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e4c158a00 0x7f8e4c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e4a59c640 1 -- 172.21.15.152:0/3018485859 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e4c0aeec0 con 0x7f8e4c067270 2024-03-18T22:40:28.342 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 0x7f8e4c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T22:40:28.343 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e4a59c640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00e870 tx=0x7f8e3c00ed30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:28.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c017070 con 0x7f8e4c067270 2024-03-18T22:40:28.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8e3c00c940 con 0x7f8e4c067270 2024-03-18T22:40:28.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e3c00cd30 con 0x7f8e4c067270 2024-03-18T22:40:28.345 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e4c0afdd0 con 0x7f8e4c067270 2024-03-18T22:40:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.339+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e4c0b0390 con 0x7f8e4c067270 2024-03-18T22:40:28.346 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.341+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f8e3c01a070 con 0x7f8e4c067270 2024-03-18T22:40:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.342+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e4c04f5b0 con 0x7f8e4c067270 2024-03-18T22:40:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.342+0000 7f8e437fe640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 0x7f8e2c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.342+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 0x7f8e2c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.342+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f8e3c08aa00 con 0x7f8e4c067270 2024-03-18T22:40:28.347 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.343+0000 7f8e41d9b640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 0x7f8e2c06e090 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8e34036000 tx=0x7f8e3403d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:28.349 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.347+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mon.2 v2:172.21.15.186:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f8e3c059100 con 0x7f8e4c067270 2024-03-18T22:40:28.879 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.878+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7f8e4c15a460 con 0x7f8e2c06bbd0 2024-03-18T22:40:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.879+0000 7f8e437fe640 1 -- 172.21.15.152:0/3018485859 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8e4c15a460 con 0x7f8e2c06bbd0 2024-03-18T22:40:28.880 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 4 to deep-scrub 2024-03-18T22:40:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 msgr2=0x7f8e2c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 0x7f8e2c06e090 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8e34036000 tx=0x7f8e3403d040 comp rx=0 tx=0).stop 2024-03-18T22:40:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 msgr2=0x7f8e4c14c0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8e3c00e870 tx=0x7f8e3c00ed30 comp rx=0 tx=0).stop 2024-03-18T22:40:28.885 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 shutdown_connections 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f8e4c158a00 0x7f8e4c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f8e4c0b3aa0 0x7f8e4c0b0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f8e2c06bbd0 0x7f8e2c06e090 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 --2- 172.21.15.152:0/3018485859 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f8e4c067270 0x7f8e4c14c0b0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 >> 172.21.15.152:0/3018485859 conn(0x7f8e4c0d04d0 msgr2=0x7f8e4c06c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 shutdown_connections 2024-03-18T22:40:28.886 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:28.883+0000 7f8e50fa7640 1 -- 172.21.15.152:0/3018485859 wait complete. 2024-03-18T22:40:28.912 INFO:tasks.ceph:Scrubbing osd.5 2024-03-18T22:40:28.912 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:29.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.201+0000 7f1dade26640 1 Processor -- start 2024-03-18T22:40:29.203 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.201+0000 7f1dade26640 1 -- start start 2024-03-18T22:40:29.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.202+0000 7f1dade26640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1da815a8f0 0x7f1da80cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.202+0000 7f1dade26640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da80ca640 con 0x7f1da806e650 2024-03-18T22:40:29.204 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.202+0000 7f1dade26640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1da80ca8e0 con 0x7f1da806d670 2024-03-18T22:40:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.202+0000 7f1dade26640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f1da80cb210 con 0x7f1da815a8f0 2024-03-18T22:40:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da77fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f1da815a8f0 0x7f1da80cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da6ffd640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f1da806e650 0x7f1da80cbe20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60328/0 (socket says 172.21.15.152:60328) 2024-03-18T22:40:29.205 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da6ffd640 1 -- 172.21.15.152:0/3875311140 learned_addr learned my addr 172.21.15.152:0/3875311140 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 419749167 0 0) 0x7f1da80ca640 con 0x7f1da806e650 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1d94003520 con 0x7f1da806e650 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1191227957 0 0) 0x7f1da80ca8e0 con 0x7f1da806d670 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da77fe640 1 -- 172.21.15.152:0/3875311140 >> v1:172.21.15.186:6789/0 conn(0x7f1da806d670 legacy=0x7f1da806da80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da77fe640 1 -- 172.21.15.152:0/3875311140 >> v1:172.21.15.152:6789/0 conn(0x7f1da806e650 legacy=0x7f1da80cbe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.206 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.203+0000 7f1da77fe640 1 -- 172.21.15.152:0/3875311140 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da80cabc0 con 0x7f1da815a8f0 2024-03-18T22:40:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.205+0000 7f1da77fe640 1 --2- 172.21.15.152:0/3875311140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da815a8f0 0x7f1da80cb6a0 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 crypto rx=0x7f1d980097a0 tx=0x7f1d9802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b721853c16e10061 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.207 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.206+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98034070 con 0x7f1da815a8f0 2024-03-18T22:40:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.206+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d98030610 con 0x7f1da815a8f0 2024-03-18T22:40:29.208 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.206+0000 7f1da67fc640 1 -- 172.21.15.152:0/3875311140 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d980309e0 con 0x7f1da815a8f0 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 -- 172.21.15.152:0/3875311140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da815a8f0 msgr2=0x7f1da80cb6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 --2- 172.21.15.152:0/3875311140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da815a8f0 0x7f1da80cb6a0 secure :-1 s=READY pgs=3306 cs=0 l=1 rev1=1 crypto rx=0x7f1d980097a0 tx=0x7f1d9802b960 comp rx=0 tx=0).stop 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 -- 172.21.15.152:0/3875311140 shutdown_connections 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 --2- 172.21.15.152:0/3875311140 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da815a8f0 0x7f1da80cb6a0 unknown :-1 s=CLOSED pgs=3306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 -- 172.21.15.152:0/3875311140 >> 172.21.15.152:0/3875311140 conn(0x7f1da80cfc60 msgr2=0x7f1da80d0070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 -- 172.21.15.152:0/3875311140 shutdown_connections 2024-03-18T22:40:29.209 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.207+0000 7f1dade26640 1 -- 172.21.15.152:0/3875311140 wait complete. 2024-03-18T22:40:29.211 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.210+0000 7f1dade26640 1 Processor -- start 2024-03-18T22:40:29.212 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.211+0000 7f1dade26640 1 -- start start 2024-03-18T22:40:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 0x7f1da80c6d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1da806e650 0x7f1da8141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1da815a8f0 0x7f1da812af30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f1da806cde0 con 0x7f1da806d670 2024-03-18T22:40:29.215 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f1da815acd0 con 0x7f1da815a8f0 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1dade26640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f1da806cf60 con 0x7f1da806e650 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 0x7f1da80c6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 0x7f1da80c6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56816/0 (socket says 172.21.15.152:56816) 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 -- 172.21.15.152:0/2650087116 learned_addr learned my addr 172.21.15.152:0/2650087116 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da6ffd640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1da806e650 0x7f1da8141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da7fff640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1da815a8f0 0x7f1da812af30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 -- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1da806e650 msgr2=0x7f1da8141460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.216 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f1da806e650 0x7f1da8141460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 -- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1da815a8f0 msgr2=0x7f1da812af30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f1da815a8f0 0x7f1da812af30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.213+0000 7f1da77fe640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da80c94b0 con 0x7f1da806d670 2024-03-18T22:40:29.217 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1da77fe640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 0x7f1da80c6d30 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7f1d9802bf70 tx=0x7f1d980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98049070 con 0x7f1da806d670 2024-03-18T22:40:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d9803a890 con 0x7f1da806d670 2024-03-18T22:40:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da80c7310 con 0x7f1da806d670 2024-03-18T22:40:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d98034040 con 0x7f1da806d670 2024-03-18T22:40:29.218 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.214+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da80c9a30 con 0x7f1da806d670 2024-03-18T22:40:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.216+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1da804f540 con 0x7f1da806d670 2024-03-18T22:40:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.216+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f1d9804c070 con 0x7f1da806d670 2024-03-18T22:40:29.219 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.217+0000 7f1d9ffff640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d8806bbd0 0x7f1d8806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.218+0000 7f1da6ffd640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d8806bbd0 0x7f1d8806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.218+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f1d980ac4b0 con 0x7f1da806d670 2024-03-18T22:40:29.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.218+0000 7f1d9ffff640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f1d88071a90 0x7f1d88073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.220 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.218+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1d9803be50 con 0x7f1d88071a90 2024-03-18T22:40:29.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.219+0000 7f1da7fff640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f1d88071a90 0x7f1d88073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.219+0000 7f1da6ffd640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d8806bbd0 0x7f1d8806e090 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1da80cdd80 tx=0x7f1d90009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.221 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.219+0000 7f1da7fff640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f1d88071a90 0x7f1d88073eb0 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.222 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.220+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== osd.5 v2:172.21.15.186:6824/1793138665 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1d9803be50 con 0x7f1d88071a90 2024-03-18T22:40:29.223 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.221+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f1d980b3050 con 0x7f1da806d670 2024-03-18T22:40:29.261 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.259+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 --> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1da80d0850 con 0x7f1d88071a90 2024-03-18T22:40:29.262 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.260+0000 7f1d9ffff640 1 -- 172.21.15.152:0/2650087116 <== osd.5 v2:172.21.15.186:6824/1793138665 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1da80d0850 con 0x7f1d88071a90 2024-03-18T22:40:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:29.262 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:29.262 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:29.263 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f1d88071a90 msgr2=0x7f1d88073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.186:6824/1793138665,v1:172.21.15.186:6825/1793138665] conn(0x7f1d88071a90 0x7f1d88073eb0 crc :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d8806bbd0 msgr2=0x7f1d8806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f1d8806bbd0 0x7f1d8806e090 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f1da80cdd80 tx=0x7f1d90009040 comp rx=0 tx=0).stop 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 msgr2=0x7f1da80c6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 --2- 172.21.15.152:0/2650087116 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f1da806d670 0x7f1da80c6d30 secure :-1 s=READY pgs=3307 cs=0 l=1 rev1=1 crypto rx=0x7f1d9802bf70 tx=0x7f1d980046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1da7fff640 1 -- 172.21.15.152:0/2650087116 reap_dead start 2024-03-18T22:40:29.264 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 shutdown_connections 2024-03-18T22:40:29.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 >> 172.21.15.152:0/2650087116 conn(0x7f1da80cfc60 msgr2=0x7f1da8072550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:29.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.261+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 shutdown_connections 2024-03-18T22:40:29.265 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.262+0000 7f1dade26640 1 -- 172.21.15.152:0/2650087116 wait complete. 2024-03-18T22:40:29.289 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-03-18T22:40:29.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.574+0000 7f229031d640 1 Processor -- start 2024-03-18T22:40:29.576 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.574+0000 7f229031d640 1 -- start start 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f229031d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228806bb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f229031d640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f2288071ca0 0x7f2288072120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f229031d640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f228815b3b0 con 0x7f22880b3a10 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f229031d640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f228806b6d0 con 0x7f2288071ca0 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f229031d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f228815b660 con 0x7f22880b46a0 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f228d8b8640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f22880b3a10 0x7f228815aca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:60336/0 (socket says 172.21.15.152:60336) 2024-03-18T22:40:29.579 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f228d8b8640 1 -- 172.21.15.152:0/2922056519 learned_addr learned my addr 172.21.15.152:0/2922056519 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:29.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f228e0b9640 1 --2- 172.21.15.152:0/2922056519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228806bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.577+0000 7f228e8ba640 1 --2- 172.21.15.152:0/2922056519 >> v2:172.21.15.186:3300/0 conn(0x7f2288071ca0 0x7f2288072120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.578+0000 7f228d0b7640 1 -- 172.21.15.152:0/2922056519 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1889260712 0 0) 0x7f228815b3b0 con 0x7f22880b3a10 2024-03-18T22:40:29.580 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.578+0000 7f228e0b9640 1 -- 172.21.15.152:0/2922056519 >> v2:172.21.15.186:3300/0 conn(0x7f2288071ca0 msgr2=0x7f2288072120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:29.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.578+0000 7f228e0b9640 1 --2- 172.21.15.152:0/2922056519 >> v2:172.21.15.186:3300/0 conn(0x7f2288071ca0 0x7f2288072120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.578+0000 7f228e0b9640 1 -- 172.21.15.152:0/2922056519 >> v1:172.21.15.152:6789/0 conn(0x7f22880b3a10 legacy=0x7f228815aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.578+0000 7f228e0b9640 1 -- 172.21.15.152:0/2922056519 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228815b940 con 0x7f22880b46a0 2024-03-18T22:40:29.581 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.580+0000 7f228e0b9640 1 --2- 172.21.15.152:0/2922056519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228806bb60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2284009d90 tx=0x7f228402cf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c84081c3650feae9 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.580+0000 7f228d0b7640 1 -- 172.21.15.152:0/2922056519 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f228403a070 con 0x7f22880b46a0 2024-03-18T22:40:29.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.581+0000 7f228d0b7640 1 -- 172.21.15.152:0/2922056519 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f228402dcd0 con 0x7f22880b46a0 2024-03-18T22:40:29.582 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.581+0000 7f228d0b7640 1 -- 172.21.15.152:0/2922056519 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2284035660 con 0x7f22880b46a0 2024-03-18T22:40:29.583 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 -- 172.21.15.152:0/2922056519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 msgr2=0x7f228806bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 --2- 172.21.15.152:0/2922056519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228806bb60 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2284009d90 tx=0x7f228402cf20 comp rx=0 tx=0).stop 2024-03-18T22:40:29.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 -- 172.21.15.152:0/2922056519 shutdown_connections 2024-03-18T22:40:29.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 --2- 172.21.15.152:0/2922056519 >> v2:172.21.15.186:3300/0 conn(0x7f2288071ca0 0x7f2288072120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 --2- 172.21.15.152:0/2922056519 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228806bb60 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.584 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 -- 172.21.15.152:0/2922056519 >> 172.21.15.152:0/2922056519 conn(0x7f22880b2680 msgr2=0x7f22880b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:29.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 -- 172.21.15.152:0/2922056519 shutdown_connections 2024-03-18T22:40:29.585 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.582+0000 7f229031d640 1 -- 172.21.15.152:0/2922056519 wait complete. 2024-03-18T22:40:29.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.585+0000 7f229031d640 1 Processor -- start 2024-03-18T22:40:29.587 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.585+0000 7f229031d640 1 -- start start 2024-03-18T22:40:29.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2288071ca0 0x7f22881563e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.589 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228814de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f228806c0a0 con 0x7f22880b3a10 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f22880b4a80 con 0x7f2288071ca0 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.587+0000 7f229031d640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f2288066f10 con 0x7f22880b46a0 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56820/0 (socket says 172.21.15.152:56820) 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 -- 172.21.15.152:0/3100597813 learned_addr learned my addr 172.21.15.152:0/3100597813 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228e8ba640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228814de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.590 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228e0b9640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2288071ca0 0x7f22881563e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 -- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 msgr2=0x7f228814de70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228814de70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 -- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2288071ca0 msgr2=0x7f22881563e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2288071ca0 0x7f22881563e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228d8b8640 1 -- 172.21.15.152:0/3100597813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22880ac220 con 0x7f22880b3a10 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.588+0000 7f228e8ba640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:29.592 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f228d8b8640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 secure :-1 s=READY pgs=3309 cs=0 l=1 rev1=1 crypto rx=0x7f227800c4b0 tx=0x7f227800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278018070 con 0x7f22880b3a10 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2278007500 con 0x7f22880b3a10 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22880ac500 con 0x7f22880b3a10 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2278004a20 con 0x7f22880b3a10 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.589+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22880acac0 con 0x7f22880b3a10 2024-03-18T22:40:29.593 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.592+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228804f5b0 con 0x7f22880b3a10 2024-03-18T22:40:29.594 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.593+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f227801b070 con 0x7f22880b3a10 2024-03-18T22:40:29.595 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.594+0000 7f227effd640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 0x7f226c06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:29.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.594+0000 7f228e0b9640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 0x7f226c06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:29.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.594+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f22780899d0 con 0x7f22880b3a10 2024-03-18T22:40:29.596 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.595+0000 7f228e0b9640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 0x7f226c06e090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2284037000 tx=0x7f228400d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:29.600 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:29.599+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f2278058230 con 0x7f22880b3a10 2024-03-18T22:40:30.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.132+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7f22880abf30 con 0x7f226c06bbd0 2024-03-18T22:40:30.134 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.133+0000 7f227effd640 1 -- 172.21.15.152:0/3100597813 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f22880abf30 con 0x7f226c06bbd0 2024-03-18T22:40:30.135 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 5 to deep-scrub 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 msgr2=0x7f226c06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 0x7f226c06e090 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f2284037000 tx=0x7f228400d040 comp rx=0 tx=0).stop 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 msgr2=0x7f22880ab9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 secure :-1 s=READY pgs=3309 cs=0 l=1 rev1=1 crypto rx=0x7f227800c4b0 tx=0x7f227800c970 comp rx=0 tx=0).stop 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 shutdown_connections 2024-03-18T22:40:30.139 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f226c06bbd0 0x7f226c06e090 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f22880b46a0 0x7f228814de70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f22880b3a10 0x7f22880ab9f0 unknown :-1 s=CLOSED pgs=3309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 --2- 172.21.15.152:0/3100597813 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f2288071ca0 0x7f22881563e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 >> 172.21.15.152:0/3100597813 conn(0x7f22880b2680 msgr2=0x7f22881588c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 shutdown_connections 2024-03-18T22:40:30.140 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.137+0000 7f229031d640 1 -- 172.21.15.152:0/3100597813 wait complete. 2024-03-18T22:40:30.165 INFO:tasks.ceph:Scrubbing osd.6 2024-03-18T22:40:30.166 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:30.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.449+0000 7f83f670a640 1 Processor -- start 2024-03-18T22:40:30.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.449+0000 7f83f670a640 1 -- start start 2024-03-18T22:40:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f670a640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83f015e490 0x7f83f00cf6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f670a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 0x7f83f00b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f670a640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f83f015e870 con 0x7f83f00cfbe0 2024-03-18T22:40:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f670a640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f83f00d06b0 con 0x7f83f015e490 2024-03-18T22:40:30.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f670a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f83f00d1230 con 0x7f83f00d2d70 2024-03-18T22:40:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83effff640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f83f015e490 0x7f83f00cf6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83f4ca7640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 0x7f83f00b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.451+0000 7f83ef7fe640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f83f00cfbe0 0x7f83f00d2660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:59762/0 (socket says 172.21.15.152:59762) 2024-03-18T22:40:30.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83ef7fe640 1 -- 172.21.15.152:0/158753461 learned_addr learned my addr 172.21.15.152:0/158753461 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83effff640 1 -- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 msgr2=0x7f83f00b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83effff640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 0x7f83f00b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83effff640 1 -- 172.21.15.152:0/158753461 >> v1:172.21.15.186:6789/0 conn(0x7f83f00cfbe0 legacy=0x7f83f00d2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83effff640 1 -- 172.21.15.152:0/158753461 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f00d0900 con 0x7f83f015e490 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83f4ca7640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 0x7f83f00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:30.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.452+0000 7f83eeffd640 1 -- 172.21.15.152:0/158753461 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2709485135 0 0) 0x7f83f015e870 con 0x7f83f00cfbe0 2024-03-18T22:40:30.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.454+0000 7f83effff640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f015e490 0x7f83f00cf6a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83e00097a0 tx=0x7f83e002b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=11cd62743ec06717 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.454+0000 7f83eeffd640 1 -- 172.21.15.152:0/158753461 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0031780 con 0x7f83f015e490 2024-03-18T22:40:30.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.454+0000 7f83eeffd640 1 -- 172.21.15.152:0/158753461 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e0037070 con 0x7f83f015e490 2024-03-18T22:40:30.456 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.455+0000 7f83eeffd640 1 -- 172.21.15.152:0/158753461 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e0031b40 con 0x7f83f015e490 2024-03-18T22:40:30.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 -- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f015e490 msgr2=0x7f83f00cf6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f015e490 0x7f83f00cf6a0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f83e00097a0 tx=0x7f83e002b820 comp rx=0 tx=0).stop 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 -- 172.21.15.152:0/158753461 shutdown_connections 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f00d2d70 0x7f83f00b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 --2- 172.21.15.152:0/158753461 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f015e490 0x7f83f00cf6a0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 -- 172.21.15.152:0/158753461 >> 172.21.15.152:0/158753461 conn(0x7f83f00d4080 msgr2=0x7f83f00d4490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 -- 172.21.15.152:0/158753461 shutdown_connections 2024-03-18T22:40:30.458 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.456+0000 7f83f670a640 1 -- 172.21.15.152:0/158753461 wait complete. 2024-03-18T22:40:30.460 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.459+0000 7f83f670a640 1 Processor -- start 2024-03-18T22:40:30.461 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.460+0000 7f83f670a640 1 -- start start 2024-03-18T22:40:30.464 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.461+0000 7f83f670a640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f00cfbe0 0x7f83f0158fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.461+0000 7f83f670a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 0x7f83f015b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.461+0000 7f83f670a640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f015e490 0x7f83f00cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83f670a640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f83f00d2220 con 0x7f83f00d2d70 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83f670a640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f83f00d0ec0 con 0x7f83f00cfbe0 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83f670a640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f83f00d23a0 con 0x7f83f015e490 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 0x7f83f015b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.465 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 0x7f83f015b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:56822/0 (socket says 172.21.15.152:56822) 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 -- 172.21.15.152:0/484499068 learned_addr learned my addr 172.21.15.152:0/484499068 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83effff640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f00cfbe0 0x7f83f0158fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83f4ca7640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f015e490 0x7f83f00cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 -- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f015e490 msgr2=0x7f83f00cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f83f015e490 0x7f83f00cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 -- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f00cfbe0 msgr2=0x7f83f0158fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f00cfbe0 0x7f83f0158fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.466 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83f0159500 con 0x7f83f00d2d70 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83effff640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f83f00cfbe0 0x7f83f0158fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.462+0000 7f83ef7fe640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 0x7f83f015b1e0 secure :-1 s=READY pgs=3310 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c4d0 tx=0x7f83e400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.463+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4018070 con 0x7f83f00d2d70 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.463+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f83e4007500 con 0x7f83f00d2d70 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.463+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83f00cb4a0 con 0x7f83f00d2d70 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.463+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83e4004a20 con 0x7f83f00d2d70 2024-03-18T22:40:30.467 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.463+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83f00cba60 con 0x7f83f00d2d70 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.465+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f83e401b070 con 0x7f83f00d2d70 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.465+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f83f0068710 con 0x7f83f00d2d70 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83ecff9640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83dc06bc00 0x7f83dc06e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83effff640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83dc06bc00 0x7f83dc06e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f83e40899e0 con 0x7f83f00d2d70 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83ecff9640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f83dc071ac0 0x7f83dc073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.469 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f83dc074590 con 0x7f83dc071ac0 2024-03-18T22:40:30.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.466+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f83e408e2c0 con 0x7f83f00d2d70 2024-03-18T22:40:30.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.467+0000 7f83f4ca7640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f83dc071ac0 0x7f83dc073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.467+0000 7f83effff640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83dc06bc00 0x7f83dc06e0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f83e0036000 tx=0x7f83e003d040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.467+0000 7f83f4ca7640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f83dc071ac0 0x7f83dc073ee0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.470 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.468+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== osd.6 v2:172.21.15.186:6808/2621081910 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f83dc074590 con 0x7f83dc071ac0 2024-03-18T22:40:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.507+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 --> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f83f004f540 con 0x7f83dc071ac0 2024-03-18T22:40:30.509 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.507+0000 7f83ecff9640 1 -- 172.21.15.152:0/484499068 <== osd.6 v2:172.21.15.186:6808/2621081910 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f83f004f540 con 0x7f83dc071ac0 2024-03-18T22:40:30.510 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:30.510 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:30.510 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f83dc071ac0 msgr2=0x7f83dc073ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.186:6808/2621081910,v1:172.21.15.186:6809/2621081910] conn(0x7f83dc071ac0 0x7f83dc073ee0 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83dc06bc00 msgr2=0x7f83dc06e0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.511 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f83dc06bc00 0x7f83dc06e0c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f83e0036000 tx=0x7f83e003d040 comp rx=0 tx=0).stop 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 msgr2=0x7f83f015b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 --2- 172.21.15.152:0/484499068 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f83f00d2d70 0x7f83f015b1e0 secure :-1 s=READY pgs=3310 cs=0 l=1 rev1=1 crypto rx=0x7f83e400c4d0 tx=0x7f83e400c990 comp rx=0 tx=0).stop 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f4ca7640 1 -- 172.21.15.152:0/484499068 reap_dead start 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 shutdown_connections 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 >> 172.21.15.152:0/484499068 conn(0x7f83f00d4080 msgr2=0x7f83f015c370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 shutdown_connections 2024-03-18T22:40:30.512 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.508+0000 7f83f670a640 1 -- 172.21.15.152:0/484499068 wait complete. 2024-03-18T22:40:30.534 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-03-18T22:40:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.810+0000 7fe8eb3c6640 1 Processor -- start 2024-03-18T22:40:30.812 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.810+0000 7fe8eb3c6640 1 -- start start 2024-03-18T22:40:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8eb3c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 0x7fe8e40d00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8eb3c6640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e40ad9e0 con 0x7fe8e414bdf0 2024-03-18T22:40:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8eb3c6640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8e40adcc0 con 0x7fe8e40aea80 2024-03-18T22:40:30.813 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8eb3c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e40ad790 con 0x7fe8e40b36b0 2024-03-18T22:40:30.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8e9162640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fe8e414bdf0 0x7fe8e40b2fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56052/0 (socket says 172.21.15.152:56052) 2024-03-18T22:40:30.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.811+0000 7fe8e9162640 1 -- 172.21.15.152:0/3301240199 learned_addr learned my addr 172.21.15.152:0/3301240199 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:30.814 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8e8961640 1 --2- 172.21.15.152:0/3301240199 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 0x7fe8e40d00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1043063759 0 0) 0x7fe8e40adcc0 con 0x7fe8e40aea80 2024-03-18T22:40:30.815 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8d0003520 con 0x7fe8e40aea80 2024-03-18T22:40:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3577715829 0 0) 0x7fe8e40ad9e0 con 0x7fe8e414bdf0 2024-03-18T22:40:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe8e40adcc0 con 0x7fe8e414bdf0 2024-03-18T22:40:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8e8961640 1 -- 172.21.15.152:0/3301240199 >> v1:172.21.15.186:6789/0 conn(0x7fe8e40aea80 legacy=0x7fe8e4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8e8961640 1 -- 172.21.15.152:0/3301240199 >> v1:172.21.15.152:6789/0 conn(0x7fe8e414bdf0 legacy=0x7fe8e40b2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.816 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.812+0000 7fe8e8961640 1 -- 172.21.15.152:0/3301240199 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e40adfa0 con 0x7fe8e40b36b0 2024-03-18T22:40:30.818 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.814+0000 7fe8e8961640 1 --2- 172.21.15.152:0/3301240199 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 0x7fe8e40d00e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40ad910 tx=0x7fe8d402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fa1ed6001492d09 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.815+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4035020 con 0x7fe8e40b36b0 2024-03-18T22:40:30.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.815+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8d4031890 con 0x7fe8e40b36b0 2024-03-18T22:40:30.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.815+0000 7fe8dbfff640 1 -- 172.21.15.152:0/3301240199 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8d4031c40 con 0x7fe8e40b36b0 2024-03-18T22:40:30.819 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/3301240199 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 msgr2=0x7fe8e40d00e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/3301240199 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 0x7fe8e40d00e0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40ad910 tx=0x7fe8d402b930 comp rx=0 tx=0).stop 2024-03-18T22:40:30.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/3301240199 shutdown_connections 2024-03-18T22:40:30.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/3301240199 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40b36b0 0x7fe8e40d00e0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/3301240199 >> 172.21.15.152:0/3301240199 conn(0x7fe8e406b5e0 msgr2=0x7fe8e406b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:30.820 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.816+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/3301240199 shutdown_connections 2024-03-18T22:40:30.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.817+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/3301240199 wait complete. 2024-03-18T22:40:30.821 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.820+0000 7fe8eb3c6640 1 Processor -- start 2024-03-18T22:40:30.822 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.820+0000 7fe8eb3c6640 1 -- start start 2024-03-18T22:40:30.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40aea80 0x7fe8e4161c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 0x7fe8e40b1990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 0x7fe8e4139460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.824 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e414c1d0 con 0x7fe8e414bdf0 2024-03-18T22:40:30.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e40ae560 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8eb3c6640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fe8e414c350 con 0x7fe8e40aea80 2024-03-18T22:40:30.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8e8961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 0x7fe8e40b1990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.825 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8e8961640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 0x7fe8e40b1990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44294/0 (socket says 172.21.15.152:44294) 2024-03-18T22:40:30.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8e9963640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 0x7fe8e4139460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8e8961640 1 -- 172.21.15.152:0/2022445647 learned_addr learned my addr 172.21.15.152:0/2022445647 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:30.826 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.822+0000 7fe8e9162640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40aea80 0x7fe8e4161c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 -- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40aea80 msgr2=0x7fe8e4161c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40aea80 0x7fe8e4161c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 -- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 msgr2=0x7fe8e40b1990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 0x7fe8e40b1990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 -- 172.21.15.152:0/2022445647 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e413a1c0 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.823+0000 7fe8e9963640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 0x7fe8e4139460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c700 tx=0x7fe8dc00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.828 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.824+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc003b70 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.824+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8dc003d10 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.824+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc0052f0 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.824+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e413a4a0 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.829 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.824+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e413aa60 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.826+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e404f5b0 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.827+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fe8dc005490 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.830 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.827+0000 7fe8d9ffb640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 0x7fe8c806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:30.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.828+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fe8dc08a570 con 0x7fe8e40b1ed0 2024-03-18T22:40:30.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.828+0000 7fe8e9162640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 0x7fe8c806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:30.831 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.828+0000 7fe8e9162640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 0x7fe8c806e090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00011e0 tx=0x7fe8e0007d30 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:30.834 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:30.833+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fe8dc058c70 con 0x7fe8e40b1ed0 2024-03-18T22:40:31.367 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.365+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fe8e40731b0 con 0x7fe8c806bbd0 2024-03-18T22:40:31.368 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.366+0000 7fe8d9ffb640 1 -- 172.21.15.152:0/2022445647 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fe8e40731b0 con 0x7fe8c806bbd0 2024-03-18T22:40:31.368 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 6 to deep-scrub 2024-03-18T22:40:31.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 msgr2=0x7fe8c806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 0x7fe8c806e090 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00011e0 tx=0x7fe8e0007d30 comp rx=0 tx=0).stop 2024-03-18T22:40:31.372 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 msgr2=0x7fe8e4139460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 0x7fe8e4139460 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00c700 tx=0x7fe8dc00cbc0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 shutdown_connections 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fe8e40b1ed0 0x7fe8e4139460 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fe8e414bdf0 0x7fe8e40b1990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fe8c806bbd0 0x7fe8c806e090 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 --2- 172.21.15.152:0/2022445647 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fe8e40aea80 0x7fe8e4161c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 >> 172.21.15.152:0/2022445647 conn(0x7fe8e406b5e0 msgr2=0x7fe8e406b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:31.373 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.370+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 shutdown_connections 2024-03-18T22:40:31.374 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.371+0000 7fe8eb3c6640 1 -- 172.21.15.152:0/2022445647 wait complete. 2024-03-18T22:40:31.399 INFO:tasks.ceph:Scrubbing osd.7 2024-03-18T22:40:31.399 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-03-18T22:40:31.697 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.695+0000 7f7b88909640 1 Processor -- start 2024-03-18T22:40:31.698 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.696+0000 7f7b88909640 1 -- start start 2024-03-18T22:40:31.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.698+0000 7f7b88909640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 0x7f7b840cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.698+0000 7f7b88909640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b840cf740 con 0x7f7b840cf240 2024-03-18T22:40:31.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.698+0000 7f7b88909640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7b840ccbf0 con 0x7f7b8415c230 2024-03-18T22:40:31.700 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.698+0000 7f7b88909640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840cc9c0 con 0x7f7b840d05b0 2024-03-18T22:40:31.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b82d9d640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f7b840cf240 0x7f7b840b4c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56056/0 (socket says 172.21.15.152:56056) 2024-03-18T22:40:31.701 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b81d9b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 0x7f7b840cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b82d9d640 1 -- 172.21.15.152:0/664408231 learned_addr learned my addr 172.21.15.152:0/664408231 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b8259c640 1 --1- 172.21.15.152:0/664408231 >> v1:172.21.15.186:6789/0 conn(0x7f7b8415c230 0x7f7b840cfea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:57116/0 (socket says 172.21.15.152:57116) 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3951452275 0 0) 0x7f7b840ccbf0 con 0x7f7b8415c230 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7b6c003520 con 0x7f7b8415c230 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3121390955 0 0) 0x7f7b840cf740 con 0x7f7b840cf240 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b81d9b640 1 -- 172.21.15.152:0/664408231 >> v1:172.21.15.186:6789/0 conn(0x7f7b8415c230 legacy=0x7f7b840cfea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b81d9b640 1 -- 172.21.15.152:0/664408231 >> v1:172.21.15.152:6789/0 conn(0x7f7b840cf240 legacy=0x7f7b840b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.702 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.699+0000 7f7b81d9b640 1 -- 172.21.15.152:0/664408231 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b840cced0 con 0x7f7b840d05b0 2024-03-18T22:40:31.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.702+0000 7f7b81d9b640 1 --2- 172.21.15.152:0/664408231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 0x7f7b840cd9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b780097d0 tx=0x7f7b7802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4b30c2f3afdc489c server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:31.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.702+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78035020 con 0x7f7b840d05b0 2024-03-18T22:40:31.703 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.702+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b78031800 con 0x7f7b840d05b0 2024-03-18T22:40:31.704 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.702+0000 7f7b8159a640 1 -- 172.21.15.152:0/664408231 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b78031bb0 con 0x7f7b840d05b0 2024-03-18T22:40:31.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 -- 172.21.15.152:0/664408231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 msgr2=0x7f7b840cd9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 --2- 172.21.15.152:0/664408231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 0x7f7b840cd9b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7b780097d0 tx=0x7f7b7802b8a0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.706 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 -- 172.21.15.152:0/664408231 shutdown_connections 2024-03-18T22:40:31.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 --2- 172.21.15.152:0/664408231 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b840d05b0 0x7f7b840cd9b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 -- 172.21.15.152:0/664408231 >> 172.21.15.152:0/664408231 conn(0x7f7b840d1e20 msgr2=0x7f7b840d2230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:31.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.703+0000 7f7b88909640 1 -- 172.21.15.152:0/664408231 shutdown_connections 2024-03-18T22:40:31.707 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.704+0000 7f7b88909640 1 -- 172.21.15.152:0/664408231 wait complete. 2024-03-18T22:40:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.707+0000 7f7b88909640 1 Processor -- start 2024-03-18T22:40:31.709 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.707+0000 7f7b88909640 1 -- start start 2024-03-18T22:40:31.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b840cf240 0x7f7b840c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b840d05b0 0x7f7b8406c2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.713 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b8415c230 0x7f7b8415c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840d0b80 con 0x7f7b840d05b0 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f7b840cd490 con 0x7f7b840cf240 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.709+0000 7f7b88909640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f7b840d0d00 con 0x7f7b8415c230 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b81d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b840d05b0 0x7f7b8406c2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b840cf240 0x7f7b840c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b82d9d640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b8415c230 0x7f7b8415c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.714 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b81d9b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b840d05b0 0x7f7b8406c2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44308/0 (socket says 172.21.15.152:44308) 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b81d9b640 1 -- 172.21.15.152:0/1976018105 learned_addr learned my addr 172.21.15.152:0/1976018105 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 -- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b8415c230 msgr2=0x7f7b8415c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f7b8415c230 0x7f7b8415c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 -- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b840d05b0 msgr2=0x7f7b8406c2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f7b840d05b0 0x7f7b8406c2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b84158e60 con 0x7f7b840cf240 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.710+0000 7f7b8259c640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b840cf240 0x7f7b840c9f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c650 tx=0x7f7b7400cb10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:31.715 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.711+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b74018070 con 0x7f7b840cf240 2024-03-18T22:40:31.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.711+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7b74004d60 con 0x7f7b840cf240 2024-03-18T22:40:31.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.711+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b840ca800 con 0x7f7b840cf240 2024-03-18T22:40:31.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.711+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b7400a860 con 0x7f7b840cf240 2024-03-18T22:40:31.716 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.711+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b840cadc0 con 0x7f7b840cf240 2024-03-18T22:40:31.717 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.713+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7b84159200 con 0x7f7b840cf240 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.713+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f7b7401b070 con 0x7f7b840cf240 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b72ffd640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7b6406bbd0 0x7f7b6406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f7b74089b70 con 0x7f7b840cf240 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b81d9b640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7b6406bbd0 0x7f7b6406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b72ffd640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7f7b64071a90 0x7f7b64073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:31.718 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7b74017ec0 con 0x7f7b64071a90 2024-03-18T22:40:31.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) ==== 24+0+0 (secure 0 0 0) 0x7f7b7408e2a0 con 0x7f7b840cf240 2024-03-18T22:40:31.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.714+0000 7f7b82d9d640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7f7b64071a90 0x7f7b64073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:31.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.715+0000 7f7b82d9d640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7f7b64071a90 0x7f7b64073eb0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:31.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.715+0000 7f7b81d9b640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7b6406bbd0 0x7f7b6406e090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7b840b2ff0 tx=0x7f7b78008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:31.719 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.716+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== osd.7 v2:172.21.15.186:6816/2838791468 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7b74017ec0 con 0x7f7b64071a90 2024-03-18T22:40:31.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.754+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 --> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f7b8404f540 con 0x7f7b64071a90 2024-03-18T22:40:31.756 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.755+0000 7f7b72ffd640 1 -- 172.21.15.152:0/1976018105 <== osd.7 v2:172.21.15.186:6816/2838791468 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f7b8404f540 con 0x7f7b64071a90 2024-03-18T22:40:31.757 INFO:teuthology.orchestra.run.smithi152.stdout:{ 2024-03-18T22:40:31.757 INFO:teuthology.orchestra.run.smithi152.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-03-18T22:40:31.757 INFO:teuthology.orchestra.run.smithi152.stdout:} 2024-03-18T22:40:31.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7f7b64071a90 msgr2=0x7f7b64073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.758 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:6816/2838791468,v1:172.21.15.186:6817/2838791468] conn(0x7f7b64071a90 0x7f7b64073eb0 crc :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7b6406bbd0 msgr2=0x7f7b6406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f7b6406bbd0 0x7f7b6406e090 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f7b840b2ff0 tx=0x7f7b78008030 comp rx=0 tx=0).stop 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b840cf240 msgr2=0x7f7b840c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 --2- 172.21.15.152:0/1976018105 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f7b840cf240 0x7f7b840c9f40 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400c650 tx=0x7f7b7400cb10 comp rx=0 tx=0).stop 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b82d9d640 1 -- 172.21.15.152:0/1976018105 reap_dead start 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 shutdown_connections 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 >> 172.21.15.152:0/1976018105 conn(0x7f7b840d1e20 msgr2=0x7f7b8415ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:31.759 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 shutdown_connections 2024-03-18T22:40:31.760 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:31.756+0000 7f7b88909640 1 -- 172.21.15.152:0/1976018105 wait complete. 2024-03-18T22:40:31.785 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-03-18T22:40:32.064 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.062+0000 7f6e8c60b640 1 Processor -- start 2024-03-18T22:40:32.065 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.063+0000 7f6e8c60b640 1 -- start start 2024-03-18T22:40:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.065+0000 7f6e8c60b640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f6e840b4450 0x7f6e8406e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.065+0000 7f6e8c60b640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e840b0000 con 0x7f6e840b4070 2024-03-18T22:40:32.067 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.065+0000 7f6e8c60b640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e8406b530 con 0x7f6e8406eb80 2024-03-18T22:40:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.065+0000 7f6e8c60b640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f6e8406c140 con 0x7f6e840b4450 2024-03-18T22:40:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e8a3a7640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f6e840b4070 0x7f6e8406c5d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56062/0 (socket says 172.21.15.152:56062) 2024-03-18T22:40:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e8a3a7640 1 -- 172.21.15.152:0/367303907 learned_addr learned my addr 172.21.15.152:0/367303907 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:32.068 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e89ba6640 1 --2- 172.21.15.152:0/367303907 >> v2:172.21.15.186:3300/0 conn(0x7f6e840b4450 0x7f6e8406e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 <== mon.1 v1:172.21.15.186:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1276632828 0 0) 0x7f6e8406b530 con 0x7f6e8406eb80 2024-03-18T22:40:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 --> v1:172.21.15.186:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e70003520 con 0x7f6e8406eb80 2024-03-18T22:40:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2443431159 0 0) 0x7f6e840b0000 con 0x7f6e840b4070 2024-03-18T22:40:32.069 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6e8406b530 con 0x7f6e840b4070 2024-03-18T22:40:32.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e89ba6640 1 -- 172.21.15.152:0/367303907 >> v1:172.21.15.186:6789/0 conn(0x7f6e8406eb80 legacy=0x7f6e8415bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e89ba6640 1 -- 172.21.15.152:0/367303907 >> v1:172.21.15.152:6789/0 conn(0x7f6e840b4070 legacy=0x7f6e8406c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.066+0000 7f6e89ba6640 1 -- 172.21.15.152:0/367303907 --> v2:172.21.15.186:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e8406b810 con 0x7f6e840b4450 2024-03-18T22:40:32.070 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.068+0000 7f6e89ba6640 1 --2- 172.21.15.152:0/367303907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e840b4450 0x7f6e8406e640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e740097a0 tx=0x7f6e7402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cf090fab7ba6aeee server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.069+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74034070 con 0x7f6e840b4450 2024-03-18T22:40:32.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.069+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e74030610 con 0x7f6e840b4450 2024-03-18T22:40:32.071 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.069+0000 7f6e893a5640 1 -- 172.21.15.152:0/367303907 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e740309e0 con 0x7f6e840b4450 2024-03-18T22:40:32.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 -- 172.21.15.152:0/367303907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e840b4450 msgr2=0x7f6e8406e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/367303907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e840b4450 0x7f6e8406e640 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e740097a0 tx=0x7f6e7402b960 comp rx=0 tx=0).stop 2024-03-18T22:40:32.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 -- 172.21.15.152:0/367303907 shutdown_connections 2024-03-18T22:40:32.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/367303907 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e840b4450 0x7f6e8406e640 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.072 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 -- 172.21.15.152:0/367303907 >> 172.21.15.152:0/367303907 conn(0x7f6e840d04d0 msgr2=0x7f6e840d08b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:32.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 -- 172.21.15.152:0/367303907 shutdown_connections 2024-03-18T22:40:32.073 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.070+0000 7f6e8c60b640 1 -- 172.21.15.152:0/367303907 wait complete. 2024-03-18T22:40:32.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.073+0000 7f6e8c60b640 1 Processor -- start 2024-03-18T22:40:32.075 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.074+0000 7f6e8c60b640 1 -- start start 2024-03-18T22:40:32.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 0x7f6e84151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.078 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e840b4450 0x7f6e8413dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8406b1c0 con 0x7f6e840b4070 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f6e8406bdd0 con 0x7f6e8406eb80 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8c60b640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f6e840b48e0 con 0x7f6e840b4450 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e89ba6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e89ba6640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44314/0 (socket says 172.21.15.152:44314) 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e89ba6640 1 -- 172.21.15.152:0/363698556 learned_addr learned my addr 172.21.15.152:0/363698556 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:32.079 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8a3a7640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 0x7f6e84151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.076+0000 7f6e8aba8640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e840b4450 0x7f6e8413dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 -- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e840b4450 msgr2=0x7f6e8413dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e840b4450 0x7f6e8413dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 -- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 msgr2=0x7f6e84151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 0x7f6e84151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 -- 172.21.15.152:0/363698556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e840cdc60 con 0x7f6e840b4070 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e8a3a7640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 0x7f6e84151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:32.080 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e89ba6640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098c0 tx=0x7f6e740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74034040 con 0x7f6e840b4070 2024-03-18T22:40:32.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e8415a570 con 0x7f6e840b4070 2024-03-18T22:40:32.081 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e74030410 con 0x7f6e840b4070 2024-03-18T22:40:32.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.077+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e74006e10 con 0x7f6e840b4070 2024-03-18T22:40:32.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.078+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e840cf9c0 con 0x7f6e840b4070 2024-03-18T22:40:32.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.080+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e8404f5b0 con 0x7f6e840b4070 2024-03-18T22:40:32.082 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.081+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f6e74037070 con 0x7f6e840b4070 2024-03-18T22:40:32.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.081+0000 7f6e7affd640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 0x7f6e6806e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.081+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f6e740ac580 con 0x7f6e840b4070 2024-03-18T22:40:32.083 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.082+0000 7f6e8a3a7640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 0x7f6e6806e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.084 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.082+0000 7f6e8a3a7640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 0x7f6e6806e090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e80005880 tx=0x7f6e80009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.096 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.095+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f6e740305e0 con 0x7f6e840b4070 2024-03-18T22:40:32.626 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.625+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f6e840d09c0 con 0x7f6e6806bbd0 2024-03-18T22:40:32.627 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.625+0000 7f6e7affd640 1 -- 172.21.15.152:0/363698556 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f6e840d09c0 con 0x7f6e6806bbd0 2024-03-18T22:40:32.627 INFO:teuthology.orchestra.run.smithi152.stderr:instructed osd(s) 7 to deep-scrub 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 msgr2=0x7f6e6806e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 0x7f6e6806e090 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f6e80005880 tx=0x7f6e80009040 comp rx=0 tx=0).stop 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 msgr2=0x7f6e84156ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 secure :-1 s=READY pgs=3314 cs=0 l=1 rev1=1 crypto rx=0x7f6e740098c0 tx=0x7f6e740046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 shutdown_connections 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f6e6806bbd0 0x7f6e6806e090 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f6e840b4450 0x7f6e8413dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.632 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f6e840b4070 0x7f6e84156ee0 unknown :-1 s=CLOSED pgs=3314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 --2- 172.21.15.152:0/363698556 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f6e8406eb80 0x7f6e84151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 >> 172.21.15.152:0/363698556 conn(0x7f6e840d04d0 msgr2=0x7f6e8406c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 shutdown_connections 2024-03-18T22:40:32.633 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.630+0000 7f6e8c60b640 1 -- 172.21.15.152:0/363698556 wait complete. 2024-03-18T22:40:32.659 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T22:40:32.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.938+0000 7fc90e4e8640 1 Processor -- start 2024-03-18T22:40:32.940 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.938+0000 7fc90e4e8640 1 -- start start 2024-03-18T22:40:32.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.940+0000 7fc90e4e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080d10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.940+0000 7fc90e4e8640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc908162690 0x7fc908162af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.940+0000 7fc90e4e8640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080b3440 con 0x7fc9080cec80 2024-03-18T22:40:32.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.940+0000 7fc90e4e8640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7fc9080d16c0 con 0x7fc908162690 2024-03-18T22:40:32.942 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.940+0000 7fc90e4e8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc9080d2660 con 0x7fc9081622b0 2024-03-18T22:40:32.943 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc9077fe640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7fc908162690 0x7fc908162af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc90ca85640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7fc9080cec80 0x7fc9080cf110 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:56064/0 (socket says 172.21.15.152:56064) 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc90ca85640 1 -- 172.21.15.152:0/2804441628 learned_addr learned my addr 172.21.15.152:0/2804441628 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc907fff640 1 --2- 172.21.15.152:0/2804441628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080d10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc906ffd640 1 -- 172.21.15.152:0/2804441628 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3667173635 0 0) 0x7fc9080b3440 con 0x7fc9080cec80 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc906ffd640 1 -- 172.21.15.152:0/2804441628 --> v1:172.21.15.152:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f0003520 con 0x7fc9080cec80 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc907fff640 1 -- 172.21.15.152:0/2804441628 >> v2:172.21.15.152:3300/0 conn(0x7fc908162690 msgr2=0x7fc908162af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:32.944 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.941+0000 7fc907fff640 1 --2- 172.21.15.152:0/2804441628 >> v2:172.21.15.152:3300/0 conn(0x7fc908162690 0x7fc908162af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.942+0000 7fc907fff640 1 -- 172.21.15.152:0/2804441628 >> v1:172.21.15.152:6789/0 conn(0x7fc9080cec80 legacy=0x7fc9080cf110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.942+0000 7fc907fff640 1 -- 172.21.15.152:0/2804441628 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080d20a0 con 0x7fc9081622b0 2024-03-18T22:40:32.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.944+0000 7fc907fff640 1 --2- 172.21.15.152:0/2804441628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080d10d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80097a0 tx=0x7fc8f802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=258f4730acd90f58 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.945 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.944+0000 7fc906ffd640 1 -- 172.21.15.152:0/2804441628 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8038070 con 0x7fc9081622b0 2024-03-18T22:40:32.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.944+0000 7fc906ffd640 1 -- 172.21.15.152:0/2804441628 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f8031700 con 0x7fc9081622b0 2024-03-18T22:40:32.946 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.944+0000 7fc906ffd640 1 -- 172.21.15.152:0/2804441628 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8031ad0 con 0x7fc9081622b0 2024-03-18T22:40:32.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.945+0000 7fc90e4e8640 1 -- 172.21.15.152:0/2804441628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 msgr2=0x7fc9080d10d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.947 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.945+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/2804441628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080d10d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc8f80097a0 tx=0x7fc8f802b7a0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 -- 172.21.15.152:0/2804441628 shutdown_connections 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/2804441628 >> v2:172.21.15.152:3300/0 conn(0x7fc908162690 0x7fc908162af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/2804441628 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080d10d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 -- 172.21.15.152:0/2804441628 >> 172.21.15.152:0/2804441628 conn(0x7fc9080d4070 msgr2=0x7fc9080d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 -- 172.21.15.152:0/2804441628 shutdown_connections 2024-03-18T22:40:32.948 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.946+0000 7fc90e4e8640 1 -- 172.21.15.152:0/2804441628 wait complete. 2024-03-18T22:40:32.950 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.949+0000 7fc90e4e8640 1 Processor -- start 2024-03-18T22:40:32.951 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.949+0000 7fc90e4e8640 1 -- start start 2024-03-18T22:40:32.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.951+0000 7fc90e4e8640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 0x7fc9080b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.953 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.951+0000 7fc90e4e8640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080b6ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.951+0000 7fc90e4e8640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 0x7fc9080b4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.951+0000 7fc90e4e8640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7fc90815faa0 con 0x7fc9080cec80 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.951+0000 7fc90e4e8640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080d2ab0 con 0x7fc908162690 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90e4e8640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7fc90815fc20 con 0x7fc9081622b0 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc907fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 0x7fc9080b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc907fff640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 0x7fc9080b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:44334/0 (socket says 172.21.15.152:44334) 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc907fff640 1 -- 172.21.15.152:0/1378121430 learned_addr learned my addr 172.21.15.152:0/1378121430 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:32.954 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc9077fe640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080b6ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.955 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90ca85640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 0x7fc9080b4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90ca85640 1 -- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 msgr2=0x7fc9080b6ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90ca85640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080b6ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90ca85640 1 -- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 msgr2=0x7fc9080b92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:32.956 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.952+0000 7fc90ca85640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 0x7fc9080b92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc90ca85640 1 -- 172.21.15.152:0/1378121430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080cbe00 con 0x7fc908162690 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc9077fe640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc90ca85640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 0x7fc9080b4680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc90000caa0 tx=0x7fc90000cea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900017070 con 0x7fc908162690 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc90000ab40 con 0x7fc908162690 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900012400 con 0x7fc908162690 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.953+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9080cc0e0 con 0x7fc908162690 2024-03-18T22:40:32.957 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.954+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9080b7530 con 0x7fc908162690 2024-03-18T22:40:32.958 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.955+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc90804f5b0 con 0x7fc908162690 2024-03-18T22:40:32.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.955+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7fc90001a070 con 0x7fc908162690 2024-03-18T22:40:32.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.956+0000 7fc904ff9640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 0x7fc8f406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:32.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.956+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7fc90008a2c0 con 0x7fc908162690 2024-03-18T22:40:32.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.956+0000 7fc907fff640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 0x7fc8f406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:32.959 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.957+0000 7fc907fff640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 0x7fc8f406e090 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b5620 tx=0x7fc8f8008030 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:32.962 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:32.961+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7fc900058af0 con 0x7fc908162690 2024-03-18T22:40:33.135 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.133+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fc908068710 con 0x7fc8f406bbd0 2024-03-18T22:40:33.136 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.135+0000 7fc904ff9640 1 -- 172.21.15.152:0/1378121430 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13457 (secure 0 0 0) 0x7fc8f8031790 con 0x7fc8f406bbd0 2024-03-18T22:40:33.137 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:33.137 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 msgr2=0x7fc8f406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 0x7fc8f406e090 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fc9080b5620 tx=0x7fc8f8008030 comp rx=0 tx=0).stop 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 msgr2=0x7fc9080b4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 0x7fc9080b4680 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fc90000caa0 tx=0x7fc90000cea0 comp rx=0 tx=0).stop 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 shutdown_connections 2024-03-18T22:40:33.141 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7fc908162690 0x7fc9080b4680 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7fc8f406bbd0 0x7fc8f406e090 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7fc9081622b0 0x7fc9080b6ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 --2- 172.21.15.152:0/1378121430 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7fc9080cec80 0x7fc9080b92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 >> 172.21.15.152:0/1378121430 conn(0x7fc9080d4070 msgr2=0x7fc9080d0a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 shutdown_connections 2024-03-18T22:40:33.142 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:33.139+0000 7fc90e4e8640 1 -- 172.21.15.152:0/1378121430 wait complete. 2024-03-18T22:40:33.165 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":13826,"stamp":"2024-03-18T22:40:31.771556+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10783768,"kb_used_data":4552,"kb_used_omap":38165,"kb_used_meta":10740970,"kb_avail":744190952,"statfs":{"total":773094113280,"available":762051534848,"internally_reserved":0,"allocated":4661248,"data_stored":2551736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39081677,"internal_metadata":10998753587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003247"},"pg_stats":[{"pgid":"1.0","version":"17'117","reported_seq":427,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-18T22:40:11.172698+0000","last_change":"2024-03-18T15:00:37.800842+0000","last_active":"2024-03-18T22:40:11.172698+0000","last_peered":"2024-03-18T22:40:11.172698+0000","last_clean":"2024-03-18T22:40:11.172698+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T22:40:11.172698+0000","last_undegraded":"2024-03-18T22:40:11.172698+0000","last_fullsized":"2024-03-18T22:40:11.172698+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-18T15:00:36.525589+0000","last_clean_scrub_stamp":"2024-03-18T15:00:36.525589+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-03-19T16:14:55.297805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424514868,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1792496,"kb_used_data":424,"kb_used_omap":7727,"kb_used_meta":1784336,"kb_avail":92579344,"statfs":{"total":96636764160,"available":94801248256,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7912914,"internal_metadata":1827160622},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424514916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1638512,"kb_used_data":424,"kb_used_omap":2359,"kb_used_meta":1635720,"kb_avail":92733328,"statfs":{"total":96636764160,"available":94958927872,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2416376,"internal_metadata":1674977544},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424514899,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1423920,"kb_used_data":424,"kb_used_omap":6735,"kb_used_meta":1416752,"kb_avail":92947920,"statfs":{"total":96636764160,"available":95178670080,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6897302,"internal_metadata":1450754410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547663,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1275960,"kb_used_data":1004,"kb_used_omap":3582,"kb_used_meta":1271361,"kb_avail":93095880,"statfs":{"total":96636764160,"available":95330181120,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3668584,"internal_metadata":1301874072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129547666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1262644,"kb_used_data":424,"kb_used_omap":4191,"kb_used_meta":1258016,"kb_avail":93109196,"statfs":{"total":96636764160,"available":95343816704,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4292009,"internal_metadata":1288208983},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129547661,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":917300,"kb_used_data":424,"kb_used_omap":4365,"kb_used_meta":912498,"kb_avail":93454540,"statfs":{"total":96636764160,"available":95697448960,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4469946,"internal_metadata":934398790},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547662,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":807732,"kb_used_data":424,"kb_used_omap":7263,"kb_used_meta":800032,"kb_avail":93564108,"statfs":{"total":96636764160,"available":95809646592,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7437455,"internal_metadata":819233649},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580341,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1665204,"kb_used_data":1004,"kb_used_omap":1940,"kb_used_meta":1662251,"kb_avail":92706636,"statfs":{"total":96636764160,"available":94931595264,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1987091,"internal_metadata":1702145517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T22:40:33.168 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-03-18T15:00:36.525589+0000 time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=15, tm_min=0, tm_sec=36, tm_wday=0, tm_yday=78, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=3, tm_mday=18, tm_hour=22, tm_min=40, tm_sec=21, tm_wday=0, tm_yday=78, tm_isdst=0) 2024-03-18T22:40:33.168 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-03-18T22:40:47.573 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:40:47.580 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:40:53.169 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-03-18T22:40:53.440 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.439+0000 7f9407a6e640 1 Processor -- start 2024-03-18T22:40:53.441 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.440+0000 7f9407a6e640 1 -- start start 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9407a6e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 0x7f94000b3740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9407a6e640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 0x7f94000ae850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9407a6e640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f940015fc70 con 0x7f94001598e0 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9407a6e640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f94000b3c80 con 0x7f9400159cc0 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9407a6e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f940015ff50 con 0x7f94000d07f0 2024-03-18T22:40:53.443 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f940580a640 1 --1- >> v1:172.21.15.152:6789/0 conn(0x7f94001598e0 0x7f94000d00e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.152:6789/0 says I am v1:172.21.15.152:50542/0 (socket says 172.21.15.152:50542) 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f940580a640 1 -- 172.21.15.152:0/1096722608 learned_addr learned my addr 172.21.15.152:0/1096722608 (peer_addr_for_me v1:172.21.15.152:0/0) 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f9405009640 1 --2- 172.21.15.152:0/1096722608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 0x7f94000b3740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.441+0000 7f940600b640 1 --2- 172.21.15.152:0/1096722608 >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 0x7f94000ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f9404808640 1 -- 172.21.15.152:0/1096722608 <== mon.0 v1:172.21.15.152:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 523439568 0 0) 0x7f940015fc70 con 0x7f94001598e0 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f9405009640 1 -- 172.21.15.152:0/1096722608 >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 msgr2=0x7f94000ae850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f9405009640 1 --2- 172.21.15.152:0/1096722608 >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 0x7f94000ae850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f9405009640 1 -- 172.21.15.152:0/1096722608 >> v1:172.21.15.152:6789/0 conn(0x7f94001598e0 legacy=0x7f94000d00e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.444 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f9405009640 1 -- 172.21.15.152:0/1096722608 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9400160230 con 0x7f94000d07f0 2024-03-18T22:40:53.445 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.442+0000 7f940600b640 1 --2- 172.21.15.152:0/1096722608 >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 0x7f94000ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.444+0000 7f9405009640 1 --2- 172.21.15.152:0/1096722608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 0x7f94000b3740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097a0 tx=0x7f93f402b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0caa9e4cf891453 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.444+0000 7f9404808640 1 -- 172.21.15.152:0/1096722608 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4035020 con 0x7f94000d07f0 2024-03-18T22:40:53.446 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.444+0000 7f9404808640 1 -- 172.21.15.152:0/1096722608 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f4031810 con 0x7f94000d07f0 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.444+0000 7f9404808640 1 -- 172.21.15.152:0/1096722608 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4031be0 con 0x7f94000d07f0 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 -- 172.21.15.152:0/1096722608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 msgr2=0x7f94000b3740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 --2- 172.21.15.152:0/1096722608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 0x7f94000b3740 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f93f40097a0 tx=0x7f93f402b8b0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 -- 172.21.15.152:0/1096722608 shutdown_connections 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 --2- 172.21.15.152:0/1096722608 >> v2:172.21.15.186:3300/0 conn(0x7f9400159cc0 0x7f94000ae850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.447 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 --2- 172.21.15.152:0/1096722608 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f94000d07f0 0x7f94000b3740 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 -- 172.21.15.152:0/1096722608 >> 172.21.15.152:0/1096722608 conn(0x7f940006b5e0 msgr2=0x7f940006b9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:53.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 -- 172.21.15.152:0/1096722608 shutdown_connections 2024-03-18T22:40:53.448 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.445+0000 7f9407a6e640 1 -- 172.21.15.152:0/1096722608 wait complete. 2024-03-18T22:40:53.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.446+0000 7f9407a6e640 1 Processor -- start 2024-03-18T22:40:53.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.446+0000 7f9407a6e640 1 -- start start 2024-03-18T22:40:53.450 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 0x7f940009bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 0x7f94000ae850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9400159cc0 0x7f94000aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f940006cc70 con 0x7f94000d07f0 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f94001607f0 con 0x7f94001598e0 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9407a6e640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f940006cdf0 con 0x7f9400159cc0 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f940580a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 0x7f940009bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.451 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f940580a640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 0x7f940009bdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48082/0 (socket says 172.21.15.152:48082) 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f940580a640 1 -- 172.21.15.152:0/2764197737 learned_addr learned my addr 172.21.15.152:0/2764197737 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f9405009640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 0x7f94000ae850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.447+0000 7f940600b640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9400159cc0 0x7f94000aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 -- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9400159cc0 msgr2=0x7f94000aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9400159cc0 0x7f94000aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 -- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 msgr2=0x7f940009bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.452 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 0x7f940009bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 -- 172.21.15.152:0/2764197737 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f940009c300 con 0x7f94001598e0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9405009640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 0x7f94000ae850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f93f4033000 tx=0x7f93f40046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4041070 con 0x7f94001598e0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f93f403ad00 con 0x7f94001598e0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f940014d360 con 0x7f94001598e0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93f4035040 con 0x7f94001598e0 2024-03-18T22:40:53.453 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.448+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94001f7540 con 0x7f94001598e0 2024-03-18T22:40:53.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.450+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f940014a000 con 0x7f94001598e0 2024-03-18T22:40:53.454 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.451+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f93f404c060 con 0x7f94001598e0 2024-03-18T22:40:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.452+0000 7f93fe7fc640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 0x7f93ec06e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.453+0000 7f940580a640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 0x7f93ec06e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.453+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f93f40ac200 con 0x7f94001598e0 2024-03-18T22:40:53.455 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.454+0000 7f940580a640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 0x7f93ec06e090 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f93f8000f60 tx=0x7f93f8007e10 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:53.457 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.457+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f940014a000 con 0x7f94001598e0 2024-03-18T22:40:53.988 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.988+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 --> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f940004f5b0 con 0x7f93ec06bbd0 2024-03-18T22:40:53.989 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.989+0000 7f93fe7fc640 1 -- 172.21.15.152:0/2764197737 <== mgr.4104 v2:172.21.15.152:6832/1694187494 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13465 (secure 0 0 0) 0x7f940004f5b0 con 0x7f93ec06bbd0 2024-03-18T22:40:53.990 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:53.990 INFO:teuthology.orchestra.run.smithi152.stderr:dumped all 2024-03-18T22:40:53.994 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.993+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 msgr2=0x7f93ec06e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.993+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 0x7f93ec06e090 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f93f8000f60 tx=0x7f93f8007e10 comp rx=0 tx=0).stop 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.993+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 msgr2=0x7f94000ae850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.993+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 0x7f94000ae850 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f93f4033000 tx=0x7f93f40046c0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 shutdown_connections 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f93ec06bbd0 0x7f93ec06e090 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9400159cc0 0x7f94000aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.995 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f94001598e0 0x7f94000ae850 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 --2- 172.21.15.152:0/2764197737 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f94000d07f0 0x7f940009bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:53.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 >> 172.21.15.152:0/2764197737 conn(0x7f940006b5e0 msgr2=0x7f94000ace10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:53.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 shutdown_connections 2024-03-18T22:40:53.996 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:53.994+0000 7f9407a6e640 1 -- 172.21.15.152:0/2764197737 wait complete. 2024-03-18T22:40:54.020 INFO:teuthology.orchestra.run.smithi152.stdout:{"pg_ready":true,"pg_map":{"version":13837,"stamp":"2024-03-18T22:40:53.777355+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":10783764,"kb_used_data":4552,"kb_used_omap":38165,"kb_used_meta":10740970,"kb_avail":744190956,"statfs":{"total":773094113280,"available":762051538944,"internally_reserved":0,"allocated":4661248,"data_stored":2551736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39081677,"internal_metadata":10998753587},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003168"},"pg_stats":[{"pgid":"1.0","version":"38'119","reported_seq":438,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-03-18T22:40:33.447254+0000","last_change":"2024-03-18T22:40:33.447319+0000","last_active":"2024-03-18T22:40:33.447254+0000","last_peered":"2024-03-18T22:40:33.447254+0000","last_clean":"2024-03-18T22:40:33.447254+0000","last_became_active":"2024-03-18T15:00:37.799948+0000","last_became_peered":"2024-03-18T15:00:37.799948+0000","last_unstale":"2024-03-18T22:40:33.447254+0000","last_undegraded":"2024-03-18T22:40:33.447254+0000","last_fullsized":"2024-03-18T22:40:33.447254+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"38'119","last_scrub_stamp":"2024-03-18T22:40:33.447118+0000","last_deep_scrub":"38'119","last_deep_scrub_stamp":"2024-03-18T22:40:33.447118+0000","last_clean_scrub_stamp":"2024-03-18T22:40:33.447118+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-03-20T08:46:21.102669+0000","scrub_duration":100,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":15,"seq":64424514872,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1792496,"kb_used_data":424,"kb_used_omap":7727,"kb_used_meta":1784336,"kb_avail":92579344,"statfs":{"total":96636764160,"available":94801248256,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7912914,"internal_metadata":1827160622},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424514920,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1638512,"kb_used_data":424,"kb_used_omap":2359,"kb_used_meta":1635720,"kb_avail":92733328,"statfs":{"total":96636764160,"available":94958927872,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2416376,"internal_metadata":1674977544},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424514903,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1423920,"kb_used_data":424,"kb_used_omap":6735,"kb_used_meta":1416752,"kb_avail":92947920,"statfs":{"total":96636764160,"available":95178670080,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6897302,"internal_metadata":1450754410},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":14,"seq":60129547667,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1275956,"kb_used_data":1004,"kb_used_omap":3582,"kb_used_meta":1271361,"kb_avail":93095884,"statfs":{"total":96636764160,"available":95330185216,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3668584,"internal_metadata":1301874072},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":14,"seq":60129547670,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":1262644,"kb_used_data":424,"kb_used_omap":4191,"kb_used_meta":1258016,"kb_avail":93109196,"statfs":{"total":96636764160,"available":95343816704,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4292009,"internal_metadata":1288208983},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129547665,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":917300,"kb_used_data":424,"kb_used_omap":4365,"kb_used_meta":912498,"kb_avail":93454540,"statfs":{"total":96636764160,"available":95697448960,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4469946,"internal_metadata":934398790},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":14,"seq":60129547666,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":807732,"kb_used_data":424,"kb_used_omap":7263,"kb_used_meta":800032,"kb_avail":93564108,"statfs":{"total":96636764160,"available":95809646592,"internally_reserved":0,"allocated":434176,"data_stored":171375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":7437455,"internal_metadata":819233649},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834580345,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1665204,"kb_used_data":1004,"kb_used_omap":1940,"kb_used_meta":1662251,"kb_avail":92706636,"statfs":{"total":96636764160,"available":94931595264,"internally_reserved":0,"allocated":1028096,"data_stored":761743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1987091,"internal_metadata":1702145517},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-18T22:40:54.022 DEBUG:teuthology.orchestra.run.smithi152:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-03-18T22:40:54.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.288+0000 7f38ad019640 1 Processor -- start 2024-03-18T22:40:54.289 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.288+0000 7f38ad019640 1 -- start start 2024-03-18T22:40:54.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.290+0000 7f38ad019640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38a80d1070 0x7f38a80d4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:54.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.290+0000 7f38ad019640 1 -- --> v1:172.21.15.152:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a80cffe0 con 0x7f38a80b4ec0 2024-03-18T22:40:54.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.290+0000 7f38ad019640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f38a80cfa20 con 0x7f38a8161890 2024-03-18T22:40:54.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.290+0000 7f38ad019640 1 -- --> v2:172.21.15.152:3300/0 -- mon_getmap magic: 0 -- 0x7f38a80cfd00 con 0x7f38a80d1070 2024-03-18T22:40:54.291 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.290+0000 7f38a659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38a80d1070 0x7f38a80d4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:54.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.291+0000 7f38a659c640 1 --2- >> v2:172.21.15.152:3300/0 conn(0x7f38a80d1070 0x7f38a80d4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48090/0 (socket says 172.21.15.152:48090) 2024-03-18T22:40:54.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.291+0000 7f38a659c640 1 -- 172.21.15.152:0/3302084143 learned_addr learned my addr 172.21.15.152:0/3302084143 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:54.292 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.291+0000 7f38a659c640 1 -- 172.21.15.152:0/3302084143 >> v1:172.21.15.186:6789/0 conn(0x7f38a8161890 legacy=0x7f38a80d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.291+0000 7f38a659c640 1 -- 172.21.15.152:0/3302084143 >> v1:172.21.15.152:6789/0 conn(0x7f38a80b4ec0 legacy=0x7f38a80d2220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.291+0000 7f38a659c640 1 -- 172.21.15.152:0/3302084143 --> v2:172.21.15.152:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a80cf710 con 0x7f38a80d1070 2024-03-18T22:40:54.293 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.293+0000 7f38a659c640 1 --2- 172.21.15.152:0/3302084143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a80d4bb0 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e2b4ac7ffcc814 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:54.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.293+0000 7f38a5d9b640 1 -- 172.21.15.152:0/3302084143 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c02f840 con 0x7f38a80d1070 2024-03-18T22:40:54.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.293+0000 7f38a5d9b640 1 -- 172.21.15.152:0/3302084143 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389c02f9e0 con 0x7f38a80d1070 2024-03-18T22:40:54.294 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.293+0000 7f38a5d9b640 1 -- 172.21.15.152:0/3302084143 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f389c02fdb0 con 0x7f38a80d1070 2024-03-18T22:40:54.295 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 -- 172.21.15.152:0/3302084143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 msgr2=0x7f38a80d4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 --2- 172.21.15.152:0/3302084143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a80d4bb0 secure :-1 s=READY pgs=3318 cs=0 l=1 rev1=1 crypto rx=0x7f389c009870 tx=0x7f389c02ba20 comp rx=0 tx=0).stop 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 -- 172.21.15.152:0/3302084143 shutdown_connections 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 --2- 172.21.15.152:0/3302084143 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a80d4bb0 unknown :-1 s=CLOSED pgs=3318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 -- 172.21.15.152:0/3302084143 >> 172.21.15.152:0/3302084143 conn(0x7f38a80d4090 msgr2=0x7f38a80d44a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 -- 172.21.15.152:0/3302084143 shutdown_connections 2024-03-18T22:40:54.296 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.295+0000 7f38ad019640 1 -- 172.21.15.152:0/3302084143 wait complete. 2024-03-18T22:40:54.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.298+0000 7f38ad019640 1 Processor -- start 2024-03-18T22:40:54.299 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.299+0000 7f38ad019640 1 -- start start 2024-03-18T22:40:54.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.300+0000 7f38ad019640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38a80b4ec0 0x7f38a815f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:54.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.300+0000 7f38ad019640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a815fb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:54.303 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38ad019640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 0x7f38a815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38ad019640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f38a80b6ee0 con 0x7f38a80d1070 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38ad019640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f38a80b5580 con 0x7f38a8161890 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38ad019640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f38a80b7060 con 0x7f38a80b4ec0 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a815fb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a659c640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a815fb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48100/0 (socket says 172.21.15.152:48100) 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a659c640 1 -- 172.21.15.152:0/1068132432 learned_addr learned my addr 172.21.15.152:0/1068132432 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 0x7f38a815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a6d9d640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38a80b4ec0 0x7f38a815f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:54.304 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 -- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38a80b4ec0 msgr2=0x7f38a815f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38a80b4ec0 0x7f38a815f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 -- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 msgr2=0x7f38a815fb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a815fb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.301+0000 7f38a759e640 1 -- 172.21.15.152:0/1068132432 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a815cb60 con 0x7f38a8161890 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f38a759e640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 0x7f38a815be30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c690 tx=0x7f38a000cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0003b70 con 0x7f38a8161890 2024-03-18T22:40:54.305 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38a0003d10 con 0x7f38a8161890 2024-03-18T22:40:54.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a80ca700 con 0x7f38a8161890 2024-03-18T22:40:54.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38a0005310 con 0x7f38a8161890 2024-03-18T22:40:54.306 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.302+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a815b350 con 0x7f38a8161890 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.304+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f38a00054b0 con 0x7f38a8161890 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.304+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a804f540 con 0x7f38a8161890 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.304+0000 7f388f7fe640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 0x7f389406e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.305+0000 7f38a6d9d640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 0x7f389406e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.305+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f38a008a540 con 0x7f38a8161890 2024-03-18T22:40:54.307 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.306+0000 7f38a6d9d640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 0x7f389406e090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f38980016e0 tx=0x7f3898009040 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:54.310 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.309+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f38a0058c40 con 0x7f38a8161890 2024-03-18T22:40:54.840 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.839+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f38a808d7e0 con 0x7f38a8161890 2024-03-18T22:40:54.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.846+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 7 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f38a005cce0 con 0x7f38a8161890 2024-03-18T22:40:54.847 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.846+0000 7f388f7fe640 1 -- 172.21.15.152:0/1068132432 <== mon.1 v2:172.21.15.186:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v12)=0 v12) ==== 123+0+0 (secure 0 0 0) 0x7f38a00612a0 con 0x7f38a8161890 2024-03-18T22:40:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 msgr2=0x7f389406e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 0x7f389406e090 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f38980016e0 tx=0x7f3898009040 comp rx=0 tx=0).stop 2024-03-18T22:40:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 msgr2=0x7f38a815be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:54.854 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 0x7f38a815be30 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f38a000c690 tx=0x7f38a000cb50 comp rx=0 tx=0).stop 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 shutdown_connections 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f38a8161890 0x7f38a815be30 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f38a80d1070 0x7f38a815fb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f389406bbd0 0x7f389406e090 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 --2- 172.21.15.152:0/1068132432 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f38a80b4ec0 0x7f38a815f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 >> 172.21.15.152:0/1068132432 conn(0x7f38a80d4090 msgr2=0x7f38a80b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.852+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 shutdown_connections 2024-03-18T22:40:54.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:54.853+0000 7f38ad019640 1 -- 172.21.15.152:0/1068132432 wait complete. 2024-03-18T22:40:54.879 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-03-18T22:40:54.880 DEBUG:teuthology.orchestra.run.smithi152:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-18T22:40:55.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.160+0000 7f9b43b12640 1 Processor -- start 2024-03-18T22:40:55.161 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.161+0000 7f9b43b12640 1 -- start start 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.163+0000 7f9b43b12640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9b3c0d10d0 0x7f9b3c162da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.163+0000 7f9b43b12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.163+0000 7f9b43b12640 1 -- --> v1:172.21.15.186:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b3c0b3440 con 0x7f9b3c1622b0 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.163+0000 7f9b43b12640 1 -- --> v2:172.21.15.186:3300/0 -- mon_getmap magic: 0 -- 0x7f9b3c0d16c0 con 0x7f9b3c0d10d0 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.163+0000 7f9b43b12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0d2660 con 0x7f9b3c15ea90 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.165 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b410ad640 1 --2- >> v2:172.21.15.186:3300/0 conn(0x7f9b3c0d10d0 0x7f9b3c162da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.186:3301/0 says I am v2:172.21.15.152:43680/0 (socket says 172.21.15.152:43680) 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b418ae640 1 --1- >> v1:172.21.15.186:6789/0 conn(0x7f9b3c1622b0 0x7f9b3c162690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.186:6789/0 says I am v1:172.21.15.152:41152/0 (socket says 172.21.15.152:41152) 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 -- 172.21.15.152:0/1589440050 learned_addr learned my addr 172.21.15.152:0/1589440050 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 -- 172.21.15.152:0/1589440050 >> v2:172.21.15.186:3300/0 conn(0x7f9b3c0d10d0 msgr2=0x7f9b3c162da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 --2- 172.21.15.152:0/1589440050 >> v2:172.21.15.186:3300/0 conn(0x7f9b3c0d10d0 0x7f9b3c162da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 -- 172.21.15.152:0/1589440050 >> v1:172.21.15.186:6789/0 conn(0x7f9b3c1622b0 legacy=0x7f9b3c162690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.166 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.164+0000 7f9b420af640 1 -- 172.21.15.152:0/1589440050 --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c0d20a0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.165+0000 7f9b420af640 1 --2- 172.21.15.152:0/1589440050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009e80 tx=0x7f9b3402be20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3a189e87643de88f server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.165+0000 7f9b408ac640 1 -- 172.21.15.152:0/1589440050 <== mon.2 v2:172.21.15.186:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b3402c9c0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.165+0000 7f9b408ac640 1 -- 172.21.15.152:0/1589440050 <== mon.2 v2:172.21.15.186:3301/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9b3402cb60 con 0x7f9b3c15ea90 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.165+0000 7f9b408ac640 1 -- 172.21.15.152:0/1589440050 <== mon.2 v2:172.21.15.186:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b340343f0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 -- 172.21.15.152:0/1589440050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 msgr2=0x7f9b3c15ef20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.168 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 --2- 172.21.15.152:0/1589440050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9b34009e80 tx=0x7f9b3402be20 comp rx=0 tx=0).stop 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 -- 172.21.15.152:0/1589440050 shutdown_connections 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 --2- 172.21.15.152:0/1589440050 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c15ea90 0x7f9b3c15ef20 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 --2- 172.21.15.152:0/1589440050 >> v2:172.21.15.186:3300/0 conn(0x7f9b3c0d10d0 0x7f9b3c162da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 -- 172.21.15.152:0/1589440050 >> 172.21.15.152:0/1589440050 conn(0x7f9b3c0d4070 msgr2=0x7f9b3c0d4480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 -- 172.21.15.152:0/1589440050 shutdown_connections 2024-03-18T22:40:55.169 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.167+0000 7f9b43b12640 1 -- 172.21.15.152:0/1589440050 wait complete. 2024-03-18T22:40:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.170+0000 7f9b43b12640 1 Processor -- start 2024-03-18T22:40:55.171 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.171+0000 7f9b43b12640 1 -- start start 2024-03-18T22:40:55.173 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 --2- >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c0d10d0 0x7f9b3c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 --2- >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 0x7f9b3c1f4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 -- --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0cfc90 con 0x7f9b3c15ea90 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 -- --> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] -- mon_getmap magic: 0 -- 0x7f9b3c0d2ab0 con 0x7f9b3c1622b0 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b43b12640 1 -- --> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] -- mon_getmap magic: 0 -- 0x7f9b3c0cfe10 con 0x7f9b3c0d10d0 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.174 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 --2- >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.152:3300/0 says I am v2:172.21.15.152:48106/0 (socket says 172.21.15.152:48106) 2024-03-18T22:40:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 -- 172.21.15.152:0/3770680415 learned_addr learned my addr 172.21.15.152:0/3770680415 (peer_addr_for_me v2:172.21.15.152:0/0) 2024-03-18T22:40:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b420af640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 0x7f9b3c1f4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.175 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b418ae640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c0d10d0 0x7f9b3c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 -- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c0d10d0 msgr2=0x7f9b3c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c0d10d0 0x7f9b3c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 -- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 msgr2=0x7f9b3c1f4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.173+0000 7f9b410ad640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 0x7f9b3c1f4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.176 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b410ad640 1 -- 172.21.15.152:0/3770680415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b3c1f7cb0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b420af640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 0x7f9b3c1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b410ad640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00e870 tx=0x7f9b2c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c017070 con 0x7f9b3c15ea90 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9b2c00c940 con 0x7f9b3c15ea90 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b3c1f5010 con 0x7f9b3c15ea90 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.174+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b2c00cd50 con 0x7f9b3c15ea90 2024-03-18T22:40:55.177 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.175+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3c1f58d0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.178 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.177+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b3c04f5b0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.179 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.178+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 4 ==== mgrmap(e 5) ==== 90136+0+0 (secure 0 0 0) 0x7f9b2c01a070 con 0x7f9b3c15ea90 2024-03-18T22:40:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.179+0000 7f9b327fc640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 0x7f9b2006e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-03-18T22:40:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.180+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4943+0+0 (secure 0 0 0) 0x7f9b2c08a590 con 0x7f9b3c15ea90 2024-03-18T22:40:55.180 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.180+0000 7f9b418ae640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 0x7f9b2006e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-18T22:40:55.181 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.181+0000 7f9b418ae640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 0x7f9b2006e090 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007fd0 tx=0x7f9b38007e80 comp rx=0 tx=0).ready entity=mgr.4104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-18T22:40:55.194 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.193+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+185025 (secure 0 0 0) 0x7f9b3c1f7cb0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.848 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.847+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 --> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b3c0d18d0 con 0x7f9b3c15ea90 2024-03-18T22:40:55.849 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.848+0000 7f9b327fc640 1 -- 172.21.15.152:0/3770680415 <== mon.0 v2:172.21.15.152:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+3878 (secure 0 0 0) 0x7f9b2c058d30 con 0x7f9b3c15ea90 2024-03-18T22:40:55.849 INFO:teuthology.orchestra.run.smithi152.stdout: 2024-03-18T22:40:55.849 INFO:teuthology.orchestra.run.smithi152.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4691,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6835/2082576907","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6833","nonce":2082576907},{"type":"v1","addr":"172.21.15.186:6835","nonce":2082576907}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4865,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6837/1616738745","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6835","nonce":1616738745},{"type":"v1","addr":"172.21.15.152:6837","nonce":1616738745}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":15},{"gid":4888,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.186:6834/989065543","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.186:6832","nonce":989065543},{"type":"v1","addr":"172.21.15.186:6834","nonce":989065543}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":5145,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.152:6836/1624739594","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.152:6834","nonce":1624739594},{"type":"v1","addr":"172.21.15.152:6836","nonce":1624739594}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-03-18T22:40:55.850 INFO:teuthology.orchestra.run.smithi152.stderr:dumped fsmap epoch 15 2024-03-18T22:40:55.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 msgr2=0x7f9b2006e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 0x7f9b2006e090 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f9b38007fd0 tx=0x7f9b38007e80 comp rx=0 tx=0).stop 2024-03-18T22:40:55.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 msgr2=0x7f9b3c15a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-18T22:40:55.855 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 secure :-1 s=READY pgs=3319 cs=0 l=1 rev1=1 crypto rx=0x7f9b2c00e870 tx=0x7f9b2c00ed30 comp rx=0 tx=0).stop 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 shutdown_connections 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3300/0,v1:172.21.15.186:6789/0] conn(0x7f9b3c1622b0 0x7f9b3c1f4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:3300/0,v1:172.21.15.152:6789/0] conn(0x7f9b3c15ea90 0x7f9b3c15a0f0 unknown :-1 s=CLOSED pgs=3319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.152:6832/1694187494,v1:172.21.15.152:6833/1694187494] conn(0x7f9b2006bbd0 0x7f9b2006e090 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 --2- 172.21.15.152:0/3770680415 >> [v2:172.21.15.186:3301/0,v1:172.21.15.186:6790/0] conn(0x7f9b3c0d10d0 0x7f9b3c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 >> 172.21.15.152:0/3770680415 conn(0x7f9b3c0d4070 msgr2=0x7f9b3c06bd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 shutdown_connections 2024-03-18T22:40:55.856 INFO:teuthology.orchestra.run.smithi152.stderr:2024-03-18T22:40:55.854+0000 7f9b43b12640 1 -- 172.21.15.152:0/3770680415 wait complete. 2024-03-18T22:40:55.882 DEBUG:tasks.cephfs.filesystem:already dead... 2024-03-18T22:40:55.882 INFO:teuthology.misc:Shutting down mds daemons... 2024-03-18T22:40:55.882 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-03-18T22:40:55.883 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:40:55.904 INFO:tasks.ceph.mds.a:Stopped 2024-03-18T22:40:55.904 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-03-18T22:40:55.904 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:40:55.966 INFO:tasks.ceph.mds.c:Stopped 2024-03-18T22:40:55.966 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-03-18T22:40:55.966 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:40:55.979 INFO:tasks.ceph.mds.b:Stopped 2024-03-18T22:40:55.979 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-03-18T22:40:55.979 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:40:56.032 INFO:tasks.ceph.mds.d:Stopped 2024-03-18T22:40:56.032 INFO:teuthology.misc:Shutting down osd daemons... 2024-03-18T22:40:56.033 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-03-18T22:40:56.033 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:40:57.351 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-03-18T22:41:02.135 INFO:tasks.ceph.osd.0:Stopped 2024-03-18T22:41:02.136 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-03-18T22:41:02.136 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:03.476 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-03-18T22:41:03.477 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-03-18T22:41:08.238 INFO:tasks.ceph.osd.1:Stopped 2024-03-18T22:41:08.238 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-03-18T22:41:08.238 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:09.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2024-03-18T22:41:09.486 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-03-18T22:41:14.341 INFO:tasks.ceph.osd.2:Stopped 2024-03-18T22:41:14.341 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-03-18T22:41:14.341 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:15.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-03-18T22:41:15.433 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2024-03-18T22:41:17.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:17.709 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:20.443 INFO:tasks.ceph.osd.3:Stopped 2024-03-18T22:41:20.444 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-03-18T22:41:20.444 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.524 INFO:tasks.ceph.osd.4:Stopped 2024-03-18T22:41:20.524 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-03-18T22:41:20.524 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.618 INFO:tasks.ceph.osd.5:Stopped 2024-03-18T22:41:20.618 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-03-18T22:41:20.618 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.718 INFO:tasks.ceph.osd.6:Stopped 2024-03-18T22:41:20.718 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-03-18T22:41:20.718 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.805 INFO:tasks.ceph.osd.7:Stopped 2024-03-18T22:41:20.805 INFO:teuthology.misc:Shutting down mgr daemons... 2024-03-18T22:41:20.806 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-03-18T22:41:20.806 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.898 INFO:tasks.ceph.mgr.y:Stopped 2024-03-18T22:41:20.898 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-03-18T22:41:20.899 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.926 INFO:tasks.ceph.mgr.x:Stopped 2024-03-18T22:41:20.926 INFO:teuthology.misc:Shutting down mon daemons... 2024-03-18T22:41:20.927 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-03-18T22:41:20.927 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:20.986 INFO:tasks.ceph.mon.a:Stopped 2024-03-18T22:41:20.987 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-03-18T22:41:20.987 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:21.006 INFO:tasks.ceph.mon.b:Stopped 2024-03-18T22:41:21.006 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-03-18T22:41:21.006 INFO:teuthology.orchestra.run:waiting for 300 2024-03-18T22:41:21.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~6s 2024-03-18T22:41:21.067 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2024-03-18T22:41:21.068 INFO:tasks.ceph.mon.c:Stopped 2024-03-18T22:41:21.069 INFO:tasks.ceph:Checking cluster log for badness... 2024-03-18T22:41:21.069 DEBUG:teuthology.orchestra.run.smithi152:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'mons down, quorum' | egrep -v 'out of quorum' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | head -n 1 2024-03-18T22:41:21.229 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T22:41:21.229 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-03-18T22:41:21.492 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T22:41:21.492 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-03-18T22:41:21.705 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T22:41:21.705 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-03-18T22:41:21.878 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T22:41:21.878 DEBUG:teuthology.orchestra.run.smithi152:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-03-18T22:41:22.081 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T22:41:22.081 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-03-18T22:41:22.502 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T22:41:22.502 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-03-18T22:41:22.636 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T22:41:22.636 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-03-18T22:41:22.802 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T22:41:22.802 DEBUG:teuthology.orchestra.run.smithi186:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-03-18T22:41:22.923 INFO:tasks.ceph:Archiving mon data... 2024-03-18T22:41:22.925 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/data/mon.a.tgz 2024-03-18T22:41:22.925 DEBUG:teuthology.orchestra.run.smithi152:> mktemp 2024-03-18T22:41:22.962 INFO:teuthology.orchestra.run.smithi152.stdout:/tmp/tmp.7hYxhlbpo9 2024-03-18T22:41:22.962 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.7hYxhlbpo9 2024-03-18T22:41:23.182 DEBUG:teuthology.orchestra.run.smithi152:> sudo chmod 0666 /tmp/tmp.7hYxhlbpo9 2024-03-18T22:41:23.353 DEBUG:teuthology.orchestra.remote:smithi152:/tmp/tmp.7hYxhlbpo9 is 574KB 2024-03-18T22:41:23.443 DEBUG:teuthology.orchestra.run.smithi152:> rm -fr /tmp/tmp.7hYxhlbpo9 2024-03-18T22:41:23.476 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/data/mon.b.tgz 2024-03-18T22:41:23.476 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-03-18T22:41:23.499 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.iNIQxk15bn 2024-03-18T22:41:23.499 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.iNIQxk15bn 2024-03-18T22:41:23.714 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.iNIQxk15bn 2024-03-18T22:41:23.832 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.iNIQxk15bn is 579KB 2024-03-18T22:41:23.931 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.iNIQxk15bn 2024-03-18T22:41:23.955 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/data/mon.c.tgz 2024-03-18T22:41:23.955 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-03-18T22:41:24.009 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.HzeHr835tH 2024-03-18T22:41:24.010 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.HzeHr835tH 2024-03-18T22:41:24.158 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.HzeHr835tH 2024-03-18T22:41:24.244 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.HzeHr835tH is 579KB 2024-03-18T22:41:24.344 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.HzeHr835tH 2024-03-18T22:41:24.358 INFO:tasks.ceph:Cleaning ceph cluster... 2024-03-18T22:41:24.359 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T22:41:24.362 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-03-18T22:41:24.723 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T22:41:24.740 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-03-18T22:41:24.740 INFO:tasks.ceph:Archiving crash dumps... 2024-03-18T22:41:24.742 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi152/crash 2024-03-18T22:41:24.743 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T22:41:24.833 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi186/crash 2024-03-18T22:41:24.834 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-03-18T22:41:24.861 INFO:tasks.ceph:Shutting down logrotate 2024-03-18T22:41:24.861 DEBUG:teuthology.orchestra.run.smithi152:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:24.865 DEBUG:teuthology.orchestra.run.smithi186:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:24.991 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:25.084 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-03-18T22:41:25.115 INFO:tasks.ceph:Compressing logs... 2024-03-18T22:41:25.115 DEBUG:teuthology.orchestra.run.smithi152:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T22:41:25.118 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-03-18T22:41:25.194 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43172.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37918.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.1.43172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37878.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.43172.log.gz 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37838.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37878.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37838.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-03-18T22:41:25.200 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5/var/log/ceph/ceph-osd.4.log: --verbose -- /var/log/ceph/ceph-osd.5.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37758.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37718.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37798.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43569.log 2024-03-18T22:41:25.201 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37798.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.3.43569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37678.log 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.43569.log.gz 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37638.log 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37678.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.admin.37638.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-03-18T22:41:25.202 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-03-18T22:41:25.203 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147213.log 2024-03-18T22:41:25.203 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723709.log 2024-03-18T22:41:25.203 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732682.log 2024-03-18T22:41:25.204 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615486.log 2024-03-18T22:41:25.205 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269676.log 2024-03-18T22:41:25.205 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261429.log 2024-03-18T22:41:25.206 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240725.log 2024-03-18T22:41:25.207 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714615.log 2024-03-18T22:41:25.207 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-mds.d.log: /var/log/ceph/ceph-mon.c.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.37918.log.gz 2024-03-18T22:41:25.207 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151564.log 2024-03-18T22:41:25.208 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343000.log 2024-03-18T22:41:25.209 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394806.log 2024-03-18T22:41:25.209 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244451.log 2024-03-18T22:41:25.210 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232449.log 2024-03-18T22:41:25.210 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347730.log 2024-03-18T22:41:25.211 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723709.log: /var/log/ceph/ceph-client.admin.732682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591184.log 2024-03-18T22:41:25.212 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634915.log 2024-03-18T22:41:25.212 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200074.log 2024-03-18T22:41:25.213 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851084.log 2024-03-18T22:41:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244986.log 2024-03-18T22:41:25.215 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714615.log: /var/log/ceph/ceph-client.admin.343000.log: /var/log/ceph/ceph-client.admin.147213.log: /var/log/ceph/ceph-client.admin.615486.log: /var/log/ceph/ceph-client.admin.261429.log: /var/log/ceph/ceph-client.admin.200074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732682.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723709.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261429.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714615.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851084.log: /var/log/ceph/ceph-client.admin.151564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147213.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394806.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.151564.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.216525.log 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394806.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851084.log.gz 2024-03-18T22:41:25.216 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200074.log.gz 2024-03-18T22:41:25.217 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697673.log 2024-03-18T22:41:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572925.log 2024-03-18T22:41:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224821.log 2024-03-18T22:41:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842431.log 2024-03-18T22:41:25.218 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167537.log 2024-03-18T22:41:25.219 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856933.log 2024-03-18T22:41:25.219 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126960.log 2024-03-18T22:41:25.220 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44114.log 2024-03-18T22:41:25.220 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126686.log 2024-03-18T22:41:25.221 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111404.log 2024-03-18T22:41:25.224 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244451.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253915.log/var/log/ceph/ceph-client.admin.269676.log: 2024-03-18T22:41:25.224 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.347730.log: /var/log/ceph/ceph-client.admin.591184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244451.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347730.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.343000.log.gz 0.0%/var/log/ceph/ceph-client.admin.634915.log: 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.591184.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269676.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615486.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240725.log.gz 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126686.log: /var/log/ceph/ceph-client.admin.697673.log: /var/log/ceph/ceph-client.admin.842431.log: /var/log/ceph/ceph-client.admin.856933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568973.log 2024-03-18T22:41:25.225 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634915.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126686.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126960.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697673.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224821.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.856933.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244259.log/var/log/ceph/ceph-client.admin.216525.log: 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842431.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.167537.log: /var/log/ceph/ceph-client.admin.568973.log: -- replaced with /var/log/ceph/ceph-client.admin.224821.log.gz 2024-03-18T22:41:25.226 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.44114.log: -- replaced with /var/log/ceph/ceph-client.admin.216525.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.572925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568973.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232449.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167537.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244986.log: /var/log/ceph/ceph-client.admin.253915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244986.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572925.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732154.log 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253915.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111404.log.gz 2024-03-18T22:41:25.227 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352172.log 2024-03-18T22:41:25.228 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244259.log: /var/log/ceph/ceph-client.admin.732154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732154.log.gz 2024-03-18T22:41:25.228 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244259.log.gz 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211367.log 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288239.log 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352172.log.gz 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624179.log 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211367.log: /var/log/ceph/ceph-client.admin.288239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288239.log.gz 2024-03-18T22:41:25.234 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211367.log.gz 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359875.log 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.624179.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730392.log 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624179.log.gz 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730405.log 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359875.log: /var/log/ceph/ceph-client.admin.730392.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730392.log.gz 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359875.log.gz 2024-03-18T22:41:25.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316326.log 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.730405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147471.log 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730405.log.gz 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387632.log 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316326.log: /var/log/ceph/ceph-client.admin.147471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147471.log.gz 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316326.log.gz 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612333.log 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703522.log 2024-03-18T22:41:25.236 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387632.log.gz 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702844.log 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612333.log: /var/log/ceph/ceph-client.admin.703522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703522.log.gz 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612333.log.gz 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192606.log 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44114.log.gz 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323737.log 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702844.log.gz 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321580.log 2024-03-18T22:41:25.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192606.log: /var/log/ceph/ceph-client.admin.323737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323737.log.gz 2024-03-18T22:41:25.238 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192606.log.gz 2024-03-18T22:41:25.238 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226566.log 2024-03-18T22:41:25.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395795.log 2024-03-18T22:41:25.245 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321580.log.gz 2024-03-18T22:41:25.245 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681361.log 2024-03-18T22:41:25.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226566.log: /var/log/ceph/ceph-client.admin.395795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395795.log.gz 2024-03-18T22:41:25.245 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226566.log.gz 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637178.log 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623289.log 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681361.log.gz 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157172.log 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.637178.log: /var/log/ceph/ceph-client.admin.623289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623289.log.gz 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637178.log.gz 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226775.log 2024-03-18T22:41:25.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150682.log 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157172.log.gz 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695496.log 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226775.log: /var/log/ceph/ceph-client.admin.150682.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150682.log.gz 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226775.log.gz 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242572.log 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.695496.log: /var/log/ceph/ceph-client.admin.242572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242572.log.gz 2024-03-18T22:41:25.247 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695496.log.gz 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726931.log 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194453.log 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726931.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699199.log 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726931.log.gz 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291319.log 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194453.log: /var/log/ceph/ceph-client.admin.699199.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194453.log.gz 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699199.log.gz 2024-03-18T22:41:25.248 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124381.log 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341537.log 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291319.log: /var/log/ceph/ceph-client.admin.124381.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124381.log.gz 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291319.log.gz 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632887.log 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.341537.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.233854.log 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341537.log.gz 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635207.log 2024-03-18T22:41:25.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632887.log: /var/log/ceph/ceph-client.admin.233854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233854.log.gz 2024-03-18T22:41:25.250 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632887.log.gz 2024-03-18T22:41:25.250 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281977.log 2024-03-18T22:41:25.251 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-18T22:41:25.251 INFO:teuthology.orchestra.run.smithi186.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.37758.log.gz 2024-03-18T22:41:25.257 INFO:teuthology.orchestra.run.smithi186.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37638.log.gz 2024-03-18T22:41:25.257 INFO:teuthology.orchestra.run.smithi186.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.37678.log.gz 2024-03-18T22:41:25.257 INFO:teuthology.orchestra.run.smithi186.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.37718.log.gz 2024-03-18T22:41:25.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635207.log.gz 2024-03-18T22:41:25.262 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231988.log 2024-03-18T22:41:25.262 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.281977.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.319158.log 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281977.log.gz 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612097.log 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231988.log: /var/log/ceph/ceph-client.admin.319158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319158.log.gz 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231988.log.gz 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349145.log 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721078.log 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612097.log.gz 2024-03-18T22:41:25.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229946.log 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721078.log: /var/log/ceph/ceph-client.admin.349145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721078.log.gz 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349145.log.gz 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338580.log 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.229946.log: /var/log/ceph/ceph-client.admin.114274.log 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229946.log.gz 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49687.log 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338580.log.gz 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149250.log 2024-03-18T22:41:25.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114274.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114274.log.gz 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324011.log 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149250.log: /var/log/ceph/ceph-client.admin.49687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149250.log.gz 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723491.log 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273128.log 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324011.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.324011.log.gz -- 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.144988.log 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.273128.log: /var/log/ceph/ceph-client.admin.723491.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273128.log.gz 2024-03-18T22:41:25.265 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723491.log.gz 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47553.log 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176721.log 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144988.log: /var/log/ceph/ceph-client.admin.47553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144988.log.gz 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207563.log 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600989.log 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176721.log.gz 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127257.log 2024-03-18T22:41:25.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207563.log: /var/log/ceph/ceph-client.admin.600989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600989.log.gz 2024-03-18T22:41:25.267 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207563.log.gz 2024-03-18T22:41:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575125.log 2024-03-18T22:41:25.267 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127257.log.gz 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47553.log.gz 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160243.log 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141294.log 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575125.log: /var/log/ceph/ceph-client.admin.160243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160243.log.gz 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575125.log.gz 2024-03-18T22:41:25.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251876.log 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110448.log 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251876.log.gz 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.141294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141294.log.gz 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308552.log 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110448.log.gz 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49687.log.gz 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42668.log 2024-03-18T22:41:25.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308552.log.gz 2024-03-18T22:41:25.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225779.log 2024-03-18T22:41:25.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.42668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309036.log 2024-03-18T22:41:25.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333088.log 2024-03-18T22:41:25.270 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225779.log.gz 2024-03-18T22:41:25.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309036.log.gz 2024-03-18T22:41:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322981.log 2024-03-18T22:41:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731781.log 2024-03-18T22:41:25.282 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333088.log.gz 2024-03-18T22:41:25.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282666.log 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322981.log.gz 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.731781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731781.log.gz 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338781.log 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252150.log 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338781.log: /var/log/ceph/ceph-client.admin.282666.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338781.log.gz 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.42668.log.gz 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282666.log.gz 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212832.log 2024-03-18T22:41:25.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252150.log.gz 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118183.log 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715097.log 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212832.log: /var/log/ceph/ceph-client.admin.118183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118183.log.gz 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212832.log.gz 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254325.log 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47958.log 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715097.log.gz 2024-03-18T22:41:25.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159745.log 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254325.log: /var/log/ceph/ceph-client.admin.47958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254325.log.gz 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244246.log 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.47958.log.gz 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557072.log 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159745.log.gz 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738045.log 2024-03-18T22:41:25.285 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244246.log.gz 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723970.log 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.557072.log: /var/log/ceph/ceph-client.admin.738045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738045.log.gz 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557072.log.gz 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306239.log 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252605.log 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723970.log: /var/log/ceph/ceph-client.admin.306239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306239.log.gz 2024-03-18T22:41:25.286 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723970.log.gz 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274977.log 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237670.log 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252605.log.gz 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44448.log 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274977.log.gz 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632711.log 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44448.log: /var/log/ceph/ceph-client.admin.237670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237670.log.gz 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636712.log 2024-03-18T22:41:25.287 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44448.log.gz 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632711.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555522.log 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632711.log.gz 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305067.log 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636712.log: /var/log/ceph/ceph-client.admin.555522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555522.log.gz 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636712.log.gz 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275896.log 2024-03-18T22:41:25.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216999.log 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275896.log: 0.0%/var/log/ceph/ceph-client.admin.305067.log: -- replaced with /var/log/ceph/ceph-client.admin.275896.log.gz 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305067.log.gz 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45424.log 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385516.log 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45424.log: /var/log/ceph/ceph-client.admin.216999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216999.log.gz 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328311.log 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45424.log.gz 2024-03-18T22:41:25.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724904.log 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385516.log.gz 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569450.log 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328311.log: /var/log/ceph/ceph-client.admin.724904.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724904.log.gz 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328311.log.gz 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239510.log 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589373.log 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.569450.log: /var/log/ceph/ceph-client.admin.239510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239510.log.gz 2024-03-18T22:41:25.290 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569450.log.gz 2024-03-18T22:41:25.292 INFO:teuthology.orchestra.run.smithi186.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.37798.log.gz 2024-03-18T22:41:25.292 INFO:teuthology.orchestra.run.smithi186.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37838.log.gz 2024-03-18T22:41:25.292 INFO:teuthology.orchestra.run.smithi186.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37878.log.gz 2024-03-18T22:41:25.303 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320037.log 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589373.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210476.log 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589373.log.gz 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325279.log 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320037.log: /var/log/ceph/ceph-client.admin.210476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210476.log.gz 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320037.log.gz 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311175.log 2024-03-18T22:41:25.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.325279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327527.log 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325279.log.gz 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192170.log 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311175.log: /var/log/ceph/ceph-client.admin.327527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327527.log.gz 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311175.log.gz 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231066.log 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192170.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192170.log.gz 2024-03-18T22:41:25.305 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733105.log 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599757.log 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231066.log: /var/log/ceph/ceph-client.admin.733105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733105.log.gz 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231066.log.gz 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630918.log 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599757.log.gz 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697494.log 2024-03-18T22:41:25.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43431.log 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630918.log.gz 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279615.log 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697494.log: /var/log/ceph/ceph-client.admin.43431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697494.log.gz 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854921.log 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43431.log.gz 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.279615.log: --verbose -- /var/log/ceph/ceph-client.admin.728307.log 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.854921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279615.log.gz 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.854921.log.gz 2024-03-18T22:41:25.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143611.log 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.728307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621213.log 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728307.log.gz 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739222.log 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143611.log: /var/log/ceph/ceph-client.admin.621213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143611.log.gz 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621213.log.gz 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854852.log 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739222.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47259.log 2024-03-18T22:41:25.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739222.log.gz 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215534.log 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.854852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.854852.log.gz 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157753.log 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47259.log.gz 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725197.log 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215534.log.gz 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844244.log 2024-03-18T22:41:25.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157753.log: /var/log/ceph/ceph-client.admin.725197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725197.log.gz 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157753.log.gz 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683448.log 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.844244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47427.log 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844244.log.gz 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50562.log 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.683448.log: /var/log/ceph/ceph-client.admin.47427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683448.log.gz 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47427.log.gz 2024-03-18T22:41:25.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847421.log 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50562.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332663.log 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303387.log 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.847421.log: /var/log/ceph/ceph-client.admin.332663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332663.log.gz 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847421.log.gz 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265486.log 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303387.log.gz 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44121.log 2024-03-18T22:41:25.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.265486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722054.log 2024-03-18T22:41:25.312 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265486.log.gz 2024-03-18T22:41:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44121.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158182.log 2024-03-18T22:41:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722054.log.gz 2024-03-18T22:41:25.312 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- 88.3% /var/log/ceph/ceph-client.admin.249063.log -- replaced with /var/log/ceph/ceph-client.admin.50562.log.gz 2024-03-18T22:41:25.312 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.327 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684579.log 2024-03-18T22:41:25.327 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249063.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249063.log.gz 2024-03-18T22:41:25.327 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158182.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44121.log.gz 2024-03-18T22:41:25.327 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154890.log 2024-03-18T22:41:25.327 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158182.log.gz 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.684579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684579.log.gz 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206367.log 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272625.log 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154890.log.gz 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50712.log 2024-03-18T22:41:25.328 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206367.log.gz 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272625.log.gz 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294732.log 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.50712.log: --verbose -- /var/log/ceph/ceph-client.admin.740318.log 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294732.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.294732.log.gz 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.724409.log 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.50712.log.gz 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.740318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.740318.log.gz 2024-03-18T22:41:25.329 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238347.log 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561016.log 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724409.log.gz 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576942.log 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238347.log: /var/log/ceph/ceph-client.admin.561016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238347.log.gz 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561016.log.gz 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226327.log 2024-03-18T22:41:25.330 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585074.log 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576942.log: /var/log/ceph/ceph-client.admin.226327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226327.log.gz 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576942.log.gz 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214681.log 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585074.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696437.log 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585074.log.gz 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586428.log 2024-03-18T22:41:25.331 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214681.log: /var/log/ceph/ceph-client.admin.696437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696437.log.gz 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214681.log.gz 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565126.log 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.586428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228298.log 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586428.log.gz 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329255.log 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565126.log: /var/log/ceph/ceph-client.admin.228298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228298.log.gz 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565126.log.gz 2024-03-18T22:41:25.332 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117996.log 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584388.log 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329255.log.gz 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312745.log 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117996.log: /var/log/ceph/ceph-client.admin.584388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584388.log.gz 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117996.log.gz 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567558.log 2024-03-18T22:41:25.333 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312745.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312745.log.gz 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304560.log 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852954.log 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567558.log: /var/log/ceph/ceph-client.admin.304560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699017.log 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567558.log.gz 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852954.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852954.log.gz 2024-03-18T22:41:25.334 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.304560.log.gz 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280570.log 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259362.log 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699017.log: /var/log/ceph/ceph-client.admin.280570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280570.log.gz 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699017.log.gz 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335636.log 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613073.log 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259362.log.gz 2024-03-18T22:41:25.335 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335636.log.gz 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152032.log 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274009.log 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613073.log: /var/log/ceph/ceph-client.admin.152032.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152032.log.gz 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613073.log.gz 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603716.log 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176490.log 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603716.log: /var/log/ceph/ceph-client.admin.274009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603716.log.gz 2024-03-18T22:41:25.336 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274009.log.gz 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554109.log 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687086.log 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176490.log: /var/log/ceph/ceph-client.admin.554109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554109.log.gz 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176490.log.gz 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589813.log 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.687086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687086.log.gz 2024-03-18T22:41:25.337 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275543.log 2024-03-18T22:41:25.362 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346255.log 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589813.log.gz 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310478.log 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275543.log: /var/log/ceph/ceph-client.admin.346255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346255.log.gz 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275543.log.gz 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339414.log 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241888.log 2024-03-18T22:41:25.363 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310478.log: /var/log/ceph/ceph-client.admin.339414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339414.log.gz 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310478.log.gz 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271667.log 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603450.log 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241888.log.gz 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208635.log 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271667.log: /var/log/ceph/ceph-client.admin.603450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603450.log.gz 2024-03-18T22:41:25.364 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271667.log.gz 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291332.log 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147012.log 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208635.log.gz 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116381.log 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291332.log: /var/log/ceph/ceph-client.admin.147012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147012.log.gz 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291332.log.gz 2024-03-18T22:41:25.365 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160680.log 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553675.log 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116381.log: /var/log/ceph/ceph-client.admin.160680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160680.log.gz 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116381.log.gz 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312333.log 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345404.log 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553675.log: /var/log/ceph/ceph-client.admin.312333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312333.log.gz 2024-03-18T22:41:25.366 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553675.log.gz 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118265.log 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.345404.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329186.log 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345404.log.gz 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155416.log 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118265.log: /var/log/ceph/ceph-client.admin.329186.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329186.log.gz 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118265.log.gz 2024-03-18T22:41:25.367 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218400.log 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348556.log 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155416.log.gz 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856763.log 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.218400.log: /var/log/ceph/ceph-client.admin.348556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348556.log.gz 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218400.log.gz 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729127.log 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578297.log 2024-03-18T22:41:25.368 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.729127.log: /var/log/ceph/ceph-client.admin.856763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729127.log.gz 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307592.log 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.856763.log.gz 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126454.log 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.578297.log: /var/log/ceph/ceph-client.admin.307592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307592.log.gz 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578297.log.gz 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622376.log 2024-03-18T22:41:25.369 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112344.log 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126454.log.gz 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241683.log 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622376.log: /var/log/ceph/ceph-client.admin.112344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112344.log.gz 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622376.log.gz 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151137.log 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142709.log 2024-03-18T22:41:25.370 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241683.log.gz 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146755.log 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151137.log: /var/log/ceph/ceph-client.admin.142709.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142709.log.gz 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151137.log.gz 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197198.log 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146755.log.gz 2024-03-18T22:41:25.371 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250008.log 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270289.log 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197198.log.gz 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217926.log 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250008.log: /var/log/ceph/ceph-client.admin.270289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270289.log.gz 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250008.log.gz 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169450.log 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347296.log 2024-03-18T22:41:25.372 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217926.log: /var/log/ceph/ceph-client.admin.169450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169450.log.gz 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217926.log.gz 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309999.log 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.347296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857162.log 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347296.log.gz 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.309999.log: /var/log/ceph/ceph-client.admin.728737.log 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309999.log.gz 2024-03-18T22:41:25.373 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857162.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.857162.log.gz 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284197.log 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.728737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49729.log 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728737.log.gz 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238360.log 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284197.log.gz 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240194.log 2024-03-18T22:41:25.374 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193567.log 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238360.log: /var/log/ceph/ceph-client.admin.240194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240194.log.gz 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238360.log.gz 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851989.log 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.49729.log.gz 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237018.log 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193567.log: /var/log/ceph/ceph-client.admin.851989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851989.log.gz 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193567.log.gz 2024-03-18T22:41:25.375 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198260.log 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237018.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237018.log.gz 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210002.log 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619249.log 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198260.log.gz 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210002.log: gzip -5 0.0% --verbose -- replaced with /var/log/ceph/ceph-client.admin.210002.log.gz 2024-03-18T22:41:25.376 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.115221.log 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155844.log 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619249.log.gz 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362322.log 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115221.log: /var/log/ceph/ceph-client.admin.155844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155844.log.gz 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115221.log.gz 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315681.log 2024-03-18T22:41:25.377 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48162.log 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362322.log.gz 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152487.log 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315681.log: /var/log/ceph/ceph-client.admin.48162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315681.log.gz 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273333.log 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.152487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152487.log.gz 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603176.log 2024-03-18T22:41:25.378 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.273333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633084.log 2024-03-18T22:41:25.379 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273333.log.gz 2024-03-18T22:41:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735029.log 2024-03-18T22:41:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603176.log: /var/log/ceph/ceph-client.admin.633084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633084.log.gz 2024-03-18T22:41:25.379 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603176.log.gz 2024-03-18T22:41:25.379 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588791.log 2024-03-18T22:41:25.413 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735029.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215155.log 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735029.log.gz 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736894.log 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588791.log: /var/log/ceph/ceph-client.admin.215155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215155.log.gz 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588791.log.gz 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146296.log 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730323.log 2024-03-18T22:41:25.414 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736894.log.gz 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632445.log 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146296.log: /var/log/ceph/ceph-client.admin.730323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730323.log.gz 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146296.log.gz 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625219.log 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632445.log.gz 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257428.log 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114261.log 2024-03-18T22:41:25.415 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625219.log.gz 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301211.log 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257428.log: /var/log/ceph/ceph-client.admin.114261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114261.log.gz 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257428.log.gz 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331650.log 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715866.log 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301211.log.gz 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858297.log 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331650.log.gz 2024-03-18T22:41:25.416 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555223.log 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715866.log: /var/log/ceph/ceph-client.admin.858297.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715866.log.gz 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.858297.log.gz 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228285.log 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48120.log 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555223.log.gz 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315241.log 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228285.log: /var/log/ceph/ceph-client.admin.48120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228285.log.gz 2024-03-18T22:41:25.417 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850542.log 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236826.log 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315241.log.gz 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258896.log 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.850542.log: /var/log/ceph/ceph-client.admin.236826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236826.log.gz 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.850542.log.gz 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147755.log 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.258896.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632900.log 2024-03-18T22:41:25.418 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258896.log.gz 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570621.log 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632900.log: /var/log/ceph/ceph-client.admin.147755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632900.log.gz 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147755.log.gz 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146095.log 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48162.log.gz 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318701.log 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146095.log: /var/log/ceph/ceph-client.admin.570621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146095.log.gz 2024-03-18T22:41:25.419 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570621.log.gz 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624192.log 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856637.log 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318701.log.gz 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336545.log 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856637.log: /var/log/ceph/ceph-client.admin.624192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284676.log 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% 87.6% -- replaced with /var/log/ceph/ceph-client.admin.624192.log.gz -- replaced with /var/log/ceph/ceph-client.admin.856637.log.gz 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336545.log.gz 2024-03-18T22:41:25.420 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48120.log.gz 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562429.log 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284676.log.gz 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48960.log 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285534.log 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.562429.log: /var/log/ceph/ceph-client.admin.48960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562429.log.gz 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561085.log 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285534.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285534.log.gz 2024-03-18T22:41:25.421 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260755.log 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.561085.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.561907.log 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561085.log.gz 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590724.log 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561907.log.gz 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260755.log.gz 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270740.log 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47874.log 2024-03-18T22:41:25.422 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590724.log.gz 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697211.log 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47874.log: /var/log/ceph/ceph-client.admin.270740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270740.log.gz 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411151.log 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47874.log.gz 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249050.log 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48960.log.gz 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411151.log: /var/log/ceph/ceph-client.admin.697211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411151.log.gz 2024-03-18T22:41:25.423 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697211.log.gz 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157671.log 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158195.log 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157671.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157671.log.gz 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249050.log.gz 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293978.log 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193779.log 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293978.log.gz 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158195.log.gz 2024-03-18T22:41:25.424 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107129.log 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564128.log 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107129.log.gz 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193779.log.gz 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570110.log 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564210.log 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570110.log.gz 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564128.log.gz 2024-03-18T22:41:25.425 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619828.log 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280086.log 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619828.log.gz 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564210.log.gz 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685399.log 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680842.log 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685399.log.gz 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280086.log.gz 2024-03-18T22:41:25.426 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350569.log 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272556.log 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.680842.log: /var/log/ceph/ceph-client.admin.350569.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350569.log.gz 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680842.log.gz 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635969.log 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308757.log 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635969.log.gz 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141363.log 2024-03-18T22:41:25.427 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272556.log.gz 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308757.log.gz 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233923.log 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722751.log 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233923.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233923.log.gz 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.141363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141363.log.gz 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603163.log 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43477.log 2024-03-18T22:41:25.428 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603163.log.gz 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722751.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722751.log.gz 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312814.log 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621405.log 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312814.log.gz 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303911.log 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240276.log 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303911.log.gz 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621405.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621405.log.gz 2024-03-18T22:41:25.429 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326228.log 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340706.log 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326228.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326228.log.gz 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240276.log.gz 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270658.log 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697988.log 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270658.log.gz 2024-03-18T22:41:25.430 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340706.log: gzip 0.0% -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.340706.log.gz -- 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.701250.log 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261703.log 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701250.log: /var/log/ceph/ceph-client.admin.697988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701250.log.gz 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292657.log 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697988.log.gz 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.261703.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261703.log.gz 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323942.log 2024-03-18T22:41:25.431 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292657.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292657.log.gz 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253029.log 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563763.log 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253029.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253029.log.gz 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299875.log 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323942.log.gz 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48036.log 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299875.log.gz 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.563763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563763.log.gz 2024-03-18T22:41:25.432 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278257.log 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48036.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215603.log 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43477.log.gz 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385158.log 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215603.log.gz 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.278257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278257.log.gz 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162040.log 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48036.log.gz 2024-03-18T22:41:25.433 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234415.log 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162040.log.gz 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385158.log.gz 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147673.log 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160667.log 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234415.log.gz 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247925.log 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.160667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160667.log.gz 2024-03-18T22:41:25.434 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.147673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717930.log 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147673.log.gz 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213280.log 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717930.log: /var/log/ceph/ceph-client.admin.247925.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717930.log.gz 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247925.log.gz 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556812.log 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208211.log 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556812.log: /var/log/ceph/ceph-client.admin.213280.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556812.log.gz 2024-03-18T22:41:25.435 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213280.log.gz 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723217.log 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320106.log 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723217.log.gz 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208211.log.gz 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341276.log 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357811.log 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320106.log.gz 2024-03-18T22:41:25.436 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112426.log 2024-03-18T22:41:25.437 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357811.log.gz 2024-03-18T22:41:25.437 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341276.log.gz 2024-03-18T22:41:25.437 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627189.log 2024-03-18T22:41:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340429.log 2024-03-18T22:41:25.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112426.log: /var/log/ceph/ceph-client.admin.627189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627189.log.gz 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112426.log.gz 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702574.log 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340429.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174254.log 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340429.log.gz 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44453.log 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702574.log: /var/log/ceph/ceph-client.admin.174254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702574.log.gz 2024-03-18T22:41:25.470 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174254.log.gz 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413480.log 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602344.log 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304194.log 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413480.log.gz 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602344.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602344.log.gz 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230674.log 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564406.log 2024-03-18T22:41:25.471 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44453.log.gz 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230674.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230674.log.gz 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304194.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304194.log.gz 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203144.log 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124755.log 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564406.log: /var/log/ceph/ceph-client.admin.203144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203144.log.gz 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564406.log.gz 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347661.log 2024-03-18T22:41:25.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324915.log 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.124755.log: /var/log/ceph/ceph-client.admin.347661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347661.log.gz 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124755.log.gz 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197672.log 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552680.log 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197672.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197672.log.gz 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324915.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324915.log.gz 2024-03-18T22:41:25.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111934.log 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613056.log 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.552680.log: /var/log/ceph/ceph-client.admin.111934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111934.log.gz 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552680.log.gz 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149712.log 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72211.log 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613056.log.gz 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176193.log 2024-03-18T22:41:25.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149712.log: /var/log/ceph/ceph-client.admin.72211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149712.log.gz 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285616.log 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176193.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176193.log.gz 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555236.log 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285616.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310970.log 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285616.log.gz 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733118.log 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310970.log.gz 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555236.log.gz 2024-03-18T22:41:25.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733552.log 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.733118.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733118.log.gz 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50184.log 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.733552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733552.log.gz 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719572.log 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159758.log 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719572.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719572.log.gz 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228766.log 2024-03-18T22:41:25.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686889.log 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159758.log: /var/log/ceph/ceph-client.admin.228766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228766.log.gz 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159758.log.gz 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584517.log 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686889.log.gz 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162952.log 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50184.log.gz 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294271.log 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584517.log: /var/log/ceph/ceph-client.admin.162952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162952.log.gz 2024-03-18T22:41:25.477 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584517.log.gz 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144460.log 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294271.log.gz 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339809.log 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362253.log 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144460.log.gz 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49560.log 2024-03-18T22:41:25.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.362253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362253.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339809.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559484.log 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.72211.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253928.log 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408867.log 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.559484.log: /var/log/ceph/ceph-client.admin.253928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253928.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559484.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49560.log.gz 2024-03-18T22:41:25.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289691.log 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130046.log 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408867.log.gz 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289691.log.gz 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360426.log 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702317.log 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130046.log.gz 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697412.log 2024-03-18T22:41:25.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360426.log: /var/log/ceph/ceph-client.admin.702317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360426.log.gz 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702317.log.gz 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.209933.log 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45088.log 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697412.log.gz 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.209933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329952.log 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.209933.log.gz 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309528.log 2024-03-18T22:41:25.481 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.45088.log.gz 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853160.log 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329952.log.gz 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302159.log 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309528.log: /var/log/ceph/ceph-client.admin.853160.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309528.log.gz 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853160.log.gz 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.326648.log 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223171.log 2024-03-18T22:41:25.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302159.log: /var/log/ceph/ceph-client.admin.326648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326648.log.gz 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302159.log.gz 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233201.log 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227336.log 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223171.log.gz 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146108.log 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233201.log.gz 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700409.log 2024-03-18T22:41:25.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227336.log.gz 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853882.log 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700409.log.gz 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146108.log.gz 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172684.log 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559189.log 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853882.log: /var/log/ceph/ceph-client.admin.172684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172684.log.gz 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853882.log.gz 2024-03-18T22:41:25.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613279.log 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.559189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318256.log 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559189.log.gz 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729862.log 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613279.log.gz 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318256.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318256.log.gz 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300316.log 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602331.log 2024-03-18T22:41:25.485 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300316.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300316.log.gz 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.729862.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729862.log.gz 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116003.log 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356750.log 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602331.log: /var/log/ceph/ceph-client.admin.116003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116003.log.gz 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602331.log.gz 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290771.log 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.356750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356750.log.gz 2024-03-18T22:41:25.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851545.log 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.290771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386495.log 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290771.log.gz 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320311.log 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851545.log: /var/log/ceph/ceph-client.admin.386495.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386495.log.gz 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851545.log.gz 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577435.log 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683247.log 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320311.log.gz 2024-03-18T22:41:25.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847408.log 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577435.log: /var/log/ceph/ceph-client.admin.683247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683247.log.gz 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577435.log.gz 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239305.log 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.847408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847408.log.gz 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252081.log 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349599.log 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239305.log.gz 2024-03-18T22:41:25.488 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733483.log 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349599.log: 0.0%/var/log/ceph/ceph-client.admin.252081.log: -- replaced with /var/log/ceph/ceph-client.admin.349599.log.gz 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252081.log.gz 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566924.log 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219770.log 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.733483.log: /var/log/ceph/ceph-client.admin.566924.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566924.log.gz 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733483.log.gz 2024-03-18T22:41:25.489 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226529.log 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.219770.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.326661.log 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219770.log.gz 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226529.log.gz 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723230.log 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280940.log 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326661.log: /var/log/ceph/ceph-client.admin.723230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723230.log.gz 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326661.log.gz 2024-03-18T22:41:25.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321064.log 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280940.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241409.log 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280940.log.gz 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573384.log 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321064.log: /var/log/ceph/ceph-client.admin.241409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241409.log.gz 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321064.log.gz 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269594.log 2024-03-18T22:41:25.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280304.log 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573384.log.gz 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.269594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308072.log 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269594.log.gz 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280304.log.gz 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699846.log 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261442.log 2024-03-18T22:41:25.492 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308072.log.gz 2024-03-18T22:41:25.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265874.log 2024-03-18T22:41:25.493 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699846.log: /var/log/ceph/ceph-client.admin.261442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261442.log.gz 2024-03-18T22:41:25.493 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699846.log.gz 2024-03-18T22:41:25.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126130.log 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172321.log 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.265874.log: /var/log/ceph/ceph-client.admin.126130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126130.log.gz 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265874.log.gz 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286779.log 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43603.log 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172321.log.gz 2024-03-18T22:41:25.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168493.log 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286779.log: /var/log/ceph/ceph-client.admin.43603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286779.log.gz 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350078.log 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168493.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43603.log.gz 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855122.log 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168493.log.gz 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350556.log 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350078.log: /var/log/ceph/ceph-client.admin.855122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855122.log.gz 2024-03-18T22:41:25.539 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350078.log.gz 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396300.log 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350556.log.gz 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339138.log 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.396300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845983.log 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396300.log.gz 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204802.log 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339138.log: /var/log/ceph/ceph-client.admin.845983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845983.log.gz 2024-03-18T22:41:25.540 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339138.log.gz 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413084.log 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576873.log 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204802.log.gz 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849218.log 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413084.log: /var/log/ceph/ceph-client.admin.576873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576873.log.gz 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413084.log.gz 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334324.log 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.849218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849218.log.gz 2024-03-18T22:41:25.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147742.log 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408449.log 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334324.log.gz 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.147742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147742.log.gz 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330432.log 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718696.log 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408449.log.gz 2024-03-18T22:41:25.542 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330432.log.gz 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208022.log 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623667.log 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718696.log: /var/log/ceph/ceph-client.admin.208022.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208022.log.gz 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718696.log.gz 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224342.log 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852941.log 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623667.log.gz 2024-03-18T22:41:25.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259101.log 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224342.log.gz 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852941.log.gz 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122643.log 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146824.log 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259101.log.gz 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237292.log 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122643.log: /var/log/ceph/ceph-client.admin.146824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146824.log.gz 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122643.log.gz 2024-03-18T22:41:25.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571081.log 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288252.log 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237292.log.gz 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684592.log 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571081.log: /var/log/ceph/ceph-client.admin.288252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288252.log.gz 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571081.log.gz 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408662.log 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.684592.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149794.log 2024-03-18T22:41:25.545 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684592.log.gz 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245522.log 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408662.log: /var/log/ceph/ceph-client.admin.149794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149794.log.gz 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408662.log.gz 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717176.log 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.245522.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245522.log.gz 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233188.log 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224903.log 2024-03-18T22:41:25.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717176.log: /var/log/ceph/ceph-client.admin.233188.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233188.log.gz 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717176.log.gz 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344943.log 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224903.log.gz 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699475.log 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304207.log 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.344943.log: /var/log/ceph/ceph-client.admin.699475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699475.log.gz 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344943.log.gz 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856456.log 2024-03-18T22:41:25.547 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635180.log 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304207.log.gz 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856456.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855109.log 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635180.log.gz 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.856456.log.gz 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607240.log 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198706.log 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855109.log.gz 2024-03-18T22:41:25.548 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254120.log 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607240.log: /var/log/ceph/ceph-client.admin.198706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198706.log.gz 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607240.log.gz 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223449.log 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254120.log.gz 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233936.log 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324024.log 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223449.log.gz 2024-03-18T22:41:25.549 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262614.log 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324024.log.gz 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233936.log.gz 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275264.log 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124394.log 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262614.log: /var/log/ceph/ceph-client.admin.275264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275264.log.gz 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262614.log.gz 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354864.log 2024-03-18T22:41:25.550 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.124394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43813.log 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124394.log.gz 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576392.log 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354864.log: /var/log/ceph/ceph-client.admin.43813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354864.log.gz 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240002.log 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721793.log 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576392.log.gz 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43813.log.gz 2024-03-18T22:41:25.551 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317810.log 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721793.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721793.log.gz 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240002.log.gz 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275461.log 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633605.log 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317810.log: /var/log/ceph/ceph-client.admin.275461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275461.log.gz 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317810.log.gz 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738319.log 2024-03-18T22:41:25.552 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50520.log 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633605.log: /var/log/ceph/ceph-client.admin.738319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738319.log.gz 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633605.log.gz 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44454.log 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635887.log 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698935.log 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174241.log 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635887.log.gz 2024-03-18T22:41:25.553 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.698935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731246.log 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698935.log.gz 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44454.log.gz 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174241.log.gz 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291250.log 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582144.log 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291250.log.gz 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.731246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731246.log.gz 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250021.log 2024-03-18T22:41:25.554 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277085.log 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.582144.log: /var/log/ceph/ceph-client.admin.250021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250021.log.gz 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582144.log.gz 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552598.log 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.277085.log: -- /var/log/ceph/ceph-client.admin.303898.log 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277085.log.gz 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199546.log 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303898.log.gz 2024-03-18T22:41:25.555 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.552598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552598.log.gz 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733036.log 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198693.log 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199546.log: /var/log/ceph/ceph-client.admin.733036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733036.log.gz 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199546.log.gz 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275965.log 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.50520.log.gz 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43561.log 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198693.log.gz 2024-03-18T22:41:25.556 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585540.log 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275965.log: /var/log/ceph/ceph-client.admin.43561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275965.log.gz 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43561.log.gz 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125722.log 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158631.log 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585540.log.gz 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149049.log 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.125722.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125722.log.gz 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158631.log.gz 2024-03-18T22:41:25.557 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256558.log 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201972.log 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149049.log.gz 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841523.log 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.256558.log: /var/log/ceph/ceph-client.admin.201972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201972.log.gz 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256558.log.gz 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201438.log 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211897.log 2024-03-18T22:41:25.558 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841523.log: /var/log/ceph/ceph-client.admin.201438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201438.log.gz 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841523.log.gz 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624658.log 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.496621.log 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211897.log.gz 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.624658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193792.log 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624658.log.gz 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.496621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.496621.log.gz 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579328.log 2024-03-18T22:41:25.559 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176515.log 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579328.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579328.log.gz 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193792.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193792.log.gz 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685884.log 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48666.log 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176515.log: /var/log/ceph/ceph-client.admin.685884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176515.log.gz 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685884.log.gz 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115234.log 2024-03-18T22:41:25.560 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258883.log 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198247.log 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115234.log: /var/log/ceph/ceph-client.admin.258883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258883.log.gz 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115234.log.gz 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720599.log 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726403.log 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720599.log.gz 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198247.log.gz 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582074.log 2024-03-18T22:41:25.561 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728320.log 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726403.log: /var/log/ceph/ceph-client.admin.582074.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582074.log.gz 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726403.log.gz 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122260.log 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.728320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728320.log.gz 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149781.log 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43729.log 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122260.log: /var/log/ceph/ceph-client.admin.149781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149781.log.gz 2024-03-18T22:41:25.562 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122260.log.gz 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224150.log 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629302.log 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685019.log 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224150.log: /var/log/ceph/ceph-client.admin.629302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629302.log.gz 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224150.log.gz 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334841.log 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685019.log.gz 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose 89.0% -- /var/log/ceph/ceph-client.admin.614237.log -- replaced with /var/log/ceph/ceph-client.admin.48666.log.gz 2024-03-18T22:41:25.563 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334841.log.gz 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43729.log.gz 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568794.log 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.614237.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359289.log 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614237.log.gz 0.0% 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.568794.log.gz 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240263.log 2024-03-18T22:41:25.564 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610398.log 2024-03-18T22:41:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359289.log: /var/log/ceph/ceph-client.admin.240263.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240263.log.gz 2024-03-18T22:41:25.565 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359289.log.gz 2024-03-18T22:41:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236744.log 2024-03-18T22:41:25.565 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610398.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610398.log.gz 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243767.log 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336340.log 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236744.log.gz 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300753.log 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243767.log: /var/log/ceph/ceph-client.admin.336340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336340.log.gz 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243767.log.gz 2024-03-18T22:41:25.614 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343502.log 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719654.log 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343502.log.gz 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287040.log 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300753.log.gz 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360796.log 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287040.log.gz 2024-03-18T22:41:25.615 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719654.log.gz 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629737.log 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167977.log 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360796.log.gz 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577627.log 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.629737.log: /var/log/ceph/ceph-client.admin.167977.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167977.log.gz 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629737.log.gz 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555031.log 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259821.log 2024-03-18T22:41:25.616 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555031.log: /var/log/ceph/ceph-client.admin.577627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555031.log.gz 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577627.log.gz 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241614.log 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48876.log 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259821.log: /var/log/ceph/ceph-client.admin.241614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241614.log.gz 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259821.log.gz 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727806.log 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583888.log 2024-03-18T22:41:25.617 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48876.log.gz 2024-03-18T22:41:25.618 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.727806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729196.log 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727806.log.gz 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335200.log 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.583888.log: /var/log/ceph/ceph-client.admin.729196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729196.log.gz 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583888.log.gz 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344255.log 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335200.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335200.log.gz 2024-03-18T22:41:25.619 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163384.log 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.344255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272638.log 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344255.log.gz 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49813.log 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272638.log.gz 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163384.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163384.log.gz 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45466.log 2024-03-18T22:41:25.620 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586930.log 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49813.log: /var/log/ceph/ceph-client.admin.45466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113813.log 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45466.log.gz 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.586930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43208.log 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49813.log.gz 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113813.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586930.log.gz -- replaced with /var/log/ceph/ceph-client.admin.113813.log.gz 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612767.log 2024-03-18T22:41:25.621 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625485.log 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43208.log: /var/log/ceph/ceph-client.admin.612767.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612767.log.gz 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600976.log 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154972.log 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.43208.log.gz 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600976.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600976.log.gz 2024-03-18T22:41:25.623 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625485.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625485.log.gz 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214612.log 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320324.log 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154972.log: /var/log/ceph/ceph-client.admin.214612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214612.log.gz 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154972.log.gz 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300684.log 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320324.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320324.log.gz 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573737.log 2024-03-18T22:41:25.624 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237031.log 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300684.log.gz 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385598.log 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573737.log: /var/log/ceph/ceph-client.admin.237031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237031.log.gz 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573737.log.gz 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273046.log 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173261.log 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.273046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273046.log.gz 2024-03-18T22:41:25.625 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385598.log.gz 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288731.log 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332650.log 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173261.log: /var/log/ceph/ceph-client.admin.288731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288731.log.gz 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173261.log.gz 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602815.log 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149332.log 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602815.log.gz 2024-03-18T22:41:25.626 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332650.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332650.log.gz 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580209.log 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174701.log 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149332.log: /var/log/ceph/ceph-client.admin.580209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580209.log.gz 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149332.log.gz 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725471.log 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328826.log 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.725471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725471.log.gz 2024-03-18T22:41:25.627 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174701.log.gz 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240656.log 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563681.log 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328826.log: /var/log/ceph/ceph-client.admin.240656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240656.log.gz 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328826.log.gz 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601794.log 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.563681.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563681.log.gz 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303374.log 2024-03-18T22:41:25.628 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262991.log 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303374.log: /var/log/ceph/ceph-client.admin.601794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303374.log.gz 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601794.log.gz 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626210.log 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227804.log 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262991.log: /var/log/ceph/ceph-client.admin.626210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626210.log.gz 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262991.log.gz 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341263.log 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227804.log.gz 2024-03-18T22:41:25.629 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636246.log 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587601.log 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341263.log.gz 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349132.log 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636246.log: /var/log/ceph/ceph-client.admin.587601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587601.log.gz 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636246.log.gz 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235563.log 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349132.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349132.log.gz 2024-03-18T22:41:25.630 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577901.log 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235563.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600702.log 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235563.log.gz 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214694.log 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600702.log.gz 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577901.log.gz 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679959.log 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274493.log 2024-03-18T22:41:25.631 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214694.log: /var/log/ceph/ceph-client.admin.679959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679959.log.gz 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214694.log.gz 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609891.log 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310957.log 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274493.log.gz 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293996.log 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609891.log: /var/log/ceph/ceph-client.admin.310957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310957.log.gz 2024-03-18T22:41:25.632 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609891.log.gz 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612849.log 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293996.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589386.log 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293996.log.gz 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718409.log 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612849.log: /var/log/ceph/ceph-client.admin.589386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589386.log.gz 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612849.log.gz 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329747.log 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226844.log 2024-03-18T22:41:25.633 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718409.log.gz 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680773.log 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329747.log: /var/log/ceph/ceph-client.admin.226844.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226844.log.gz 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329747.log.gz 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301643.log 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305436.log 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.680773.log: /var/log/ceph/ceph-client.admin.301643.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301643.log.gz 2024-03-18T22:41:25.634 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680773.log.gz 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562870.log 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129093.log 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305436.log: /var/log/ceph/ceph-client.admin.562870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562870.log.gz 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305436.log.gz 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243780.log 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233462.log 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129093.log.gz 2024-03-18T22:41:25.635 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360344.log 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243780.log: /var/log/ceph/ceph-client.admin.233462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233462.log.gz 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243780.log.gz 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715783.log 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260254.log 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360344.log.gz 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608136.log 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715783.log: /var/log/ceph/ceph-client.admin.260254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260254.log.gz 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715783.log.gz 2024-03-18T22:41:25.636 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573806.log 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.608136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701057.log 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608136.log.gz 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196163.log 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573806.log: /var/log/ceph/ceph-client.admin.701057.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701057.log.gz 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573806.log.gz 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45130.log 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196163.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251127.log 2024-03-18T22:41:25.637 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196163.log.gz 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152474.log 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45130.log: /var/log/ceph/ceph-client.admin.251127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251127.log.gz 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723901.log 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715372.log 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.152474.log: /var/log/ceph/ceph-client.admin.723901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723901.log.gz 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152474.log.gz 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321498.log 2024-03-18T22:41:25.638 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715372.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715372.log.gz 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.45130.log.gz 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247027.log 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320585.log 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321498.log: /var/log/ceph/ceph-client.admin.247027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247027.log.gz 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321498.log.gz 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332078.log 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320585.log.gz 2024-03-18T22:41:25.639 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150600.log 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628785.log 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332078.log: /var/log/ceph/ceph-client.admin.150600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150600.log.gz 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332078.log.gz 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206060.log 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163315.log 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628785.log.gz 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212358.log 2024-03-18T22:41:25.640 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206060.log: /var/log/ceph/ceph-client.admin.163315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163315.log.gz 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206060.log.gz 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858411.log 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218779.log 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212358.log.gz 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339094.log 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858411.log: /var/log/ceph/ceph-client.admin.218779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218779.log.gz 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243493.log 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.858411.log.gz 2024-03-18T22:41:25.641 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50096.log 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243493.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243493.log.gz 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339094.log.gz 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620299.log 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117281.log 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50096.log: /var/log/ceph/ceph-client.admin.620299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620299.log.gz 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410646.log 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574258.log 2024-03-18T22:41:25.642 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410646.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.50096.log.gz 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410646.log.gz 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117281.log.gz 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584540.log 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349804.log 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574258.log: /var/log/ceph/ceph-client.admin.584540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584540.log.gz 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574258.log.gz 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144718.log 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858129.log 2024-03-18T22:41:25.643 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349804.log.gz 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211449.log 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144718.log: /var/log/ceph/ceph-client.admin.858129.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144718.log.gz 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.858129.log.gz 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343584.log 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126425.log 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211449.log.gz 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728238.log 2024-03-18T22:41:25.644 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343584.log: /var/log/ceph/ceph-client.admin.126425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126425.log.gz 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343584.log.gz 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293412.log 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.728238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613717.log 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728238.log.gz 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289678.log 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293412.log: /var/log/ceph/ceph-client.admin.613717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613717.log.gz 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293412.log.gz 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.637165.log 2024-03-18T22:41:25.645 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289678.log.gz 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697888.log 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316979.log 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.637165.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.637165.log.gz 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697888.log.gz 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349612.log 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128654.log 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316979.log.gz 2024-03-18T22:41:25.646 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217396.log 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349612.log: /var/log/ceph/ceph-client.admin.128654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128654.log.gz 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349612.log.gz 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199615.log 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217396.log.gz 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561976.log 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303633.log 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199615.log.gz 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575138.log 2024-03-18T22:41:25.647 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561976.log: /var/log/ceph/ceph-client.admin.303633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561976.log.gz 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303633.log.gz 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603921.log 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609454.log 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575138.log: /var/log/ceph/ceph-client.admin.603921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603921.log.gz 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575138.log.gz 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228505.log 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609454.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309733.log 2024-03-18T22:41:25.648 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609454.log.gz 2024-03-18T22:41:25.649 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394326.log 2024-03-18T22:41:25.649 INFO:teuthology.orchestra.run.smithi186.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-03-18T22:41:25.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228505.log: /var/log/ceph/ceph-client.admin.309733.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228505.log.gz 2024-03-18T22:41:25.702 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309733.log.gz 2024-03-18T22:41:25.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329460.log 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144272.log 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394326.log.gz 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680399.log 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329460.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329460.log.gz 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144272.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144272.log.gz 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307112.log 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.680399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49476.log 2024-03-18T22:41:25.703 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680399.log.gz 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724491.log 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307112.log: /var/log/ceph/ceph-client.admin.49476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307112.log.gz 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851097.log 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49476.log.gz 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724491.log: gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.355854.log -- replaced with /var/log/ceph/ceph-client.admin.724491.log.gz 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848753.log 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851097.log.gz 2024-03-18T22:41:25.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321567.log 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.355854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355854.log.gz 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.848753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848753.log.gz 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858493.log 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226857.log 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321567.log.gz 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43347.log 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858493.log: /var/log/ceph/ceph-client.admin.226857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226857.log.gz 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42760.log 2024-03-18T22:41:25.705 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.858493.log.gz 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150669.log 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.42760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590253.log 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.42760.log.gz 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43347.log.gz 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254407.log 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590253.log.gz 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.150669.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150669.log.gz 2024-03-18T22:41:25.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409809.log 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144070.log 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254407.log: /var/log/ceph/ceph-client.admin.409809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409809.log.gz 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254407.log.gz 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612836.log 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144070.log.gz 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114686.log 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612836.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333958.log 2024-03-18T22:41:25.707 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612836.log.gz 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154446.log 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114686.log: /var/log/ceph/ceph-client.admin.333958.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333958.log.gz 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114686.log.gz 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197185.log 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311876.log 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154446.log.gz 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394408.log 2024-03-18T22:41:25.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197185.log: /var/log/ceph/ceph-client.admin.311876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311876.log.gz 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197185.log.gz 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110517.log 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394408.log.gz 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723983.log 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205319.log 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110517.log.gz 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570552.log 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205319.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205319.log.gz 2024-03-18T22:41:25.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723983.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723983.log.gz 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571483.log 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386025.log 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570552.log.gz 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571483.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571483.log.gz 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611892.log 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696954.log 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386025.log.gz 2024-03-18T22:41:25.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556894.log 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.611892.log: /var/log/ceph/ceph-client.admin.696954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696954.log.gz 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611892.log.gz 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126973.log 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556894.log.gz 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858171.log 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126973.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112413.log 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126973.log.gz 2024-03-18T22:41:25.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230207.log 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858171.log: /var/log/ceph/ceph-client.admin.112413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112413.log.gz 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172308.log 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.858171.log.gz 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44116.log 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.172308.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172308.log.gz 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230207.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230207.log.gz 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201985.log 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618975.log 2024-03-18T22:41:25.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44116.log: /var/log/ceph/ceph-client.admin.201985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201985.log.gz 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738332.log 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598020.log 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44116.log.gz 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738332.log.gz 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618975.log.gz 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616005.log 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237223.log 2024-03-18T22:41:25.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598020.log: /var/log/ceph/ceph-client.admin.616005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616005.log.gz 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598020.log.gz 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351826.log 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237223.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344060.log 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237223.log.gz 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356293.log 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351826.log: /var/log/ceph/ceph-client.admin.344060.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344060.log.gz 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351826.log.gz 2024-03-18T22:41:25.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207109.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.356293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50054.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356293.log.gz 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49273.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207109.log: /var/log/ceph/ceph-client.admin.50054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207109.log.gz 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.50054.log.gz 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345838.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141805.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736374.log 2024-03-18T22:41:25.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.345838.log: /var/log/ceph/ceph-client.admin.141805.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49771.log 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345838.log.gz 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141805.log.gz 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736374.log.gz 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.49273.log.gz 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628596.log 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339878.log 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.49771.log.gz 2024-03-18T22:41:25.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127326.log 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628596.log.gz 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698475.log 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127326.log: /var/log/ceph/ceph-client.admin.339878.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127326.log.gz 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339878.log.gz 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713424.log 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204789.log 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.713424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713424.log.gz 2024-03-18T22:41:25.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.698475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698475.log.gz 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242380.log 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724986.log 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204789.log: /var/log/ceph/ceph-client.admin.242380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155775.log 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204789.log.gz 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242380.log.gz 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724986.log.gz 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626680.log 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343082.log 2024-03-18T22:41:25.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155775.log: /var/log/ceph/ceph-client.admin.626680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626680.log.gz 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155775.log.gz 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339116.log 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272364.log 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343082.log.gz 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111417.log 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272364.log.gz 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339116.log.gz 2024-03-18T22:41:25.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45214.log 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577353.log 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111417.log: /var/log/ceph/ceph-client.admin.45214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111417.log.gz 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45214.log.gz 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696450.log 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717451.log 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577353.log.gz 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624939.log 2024-03-18T22:41:25.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.696450.log: /var/log/ceph/ceph-client.admin.717451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717451.log.gz 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696450.log.gz 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561532.log 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.624939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624939.log.gz 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278244.log 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210984.log 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561532.log.gz 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286574.log 2024-03-18T22:41:25.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210984.log.gz 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.278244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278244.log.gz 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614155.log 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611810.log 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286574.log: /var/log/ceph/ceph-client.admin.614155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614155.log.gz 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286574.log.gz 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151124.log 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.611810.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843350.log 2024-03-18T22:41:25.722 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611810.log.gz 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720612.log 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151124.log: /var/log/ceph/ceph-client.admin.843350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843350.log.gz 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151124.log.gz 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224629.log 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231527.log 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224629.log.gz 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720612.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720612.log.gz 2024-03-18T22:41:25.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680855.log 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163753.log 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231527.log.gz 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291058.log 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163753.log: /var/log/ceph/ceph-client.admin.680855.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163753.log.gz 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680855.log.gz 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858213.log 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175721.log 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291058.log.gz 2024-03-18T22:41:25.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156301.log 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858213.log: /var/log/ceph/ceph-client.admin.175721.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175721.log.gz 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553134.log 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.858213.log.gz -5 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.607702.log 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156301.log: /var/log/ceph/ceph-client.admin.553134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553134.log.gz 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156301.log.gz 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331581.log 2024-03-18T22:41:25.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313442.log 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607702.log: /var/log/ceph/ceph-client.admin.331581.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331581.log.gz 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607702.log.gz 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386038.log 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358326.log 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313442.log: /var/log/ceph/ceph-client.admin.386038.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386038.log.gz 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313442.log.gz 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273320.log 2024-03-18T22:41:25.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162939.log 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.273320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273320.log.gz 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358326.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358326.log.gz 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337064.log 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276811.log 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337064.log: /var/log/ceph/ceph-client.admin.162939.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337064.log.gz 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162939.log.gz 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225300.log 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.276811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276811.log.gz 2024-03-18T22:41:25.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229260.log 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224890.log 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225300.log.gz 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325712.log 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224890.log.gz 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229260.log.gz 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273594.log 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245604.log 2024-03-18T22:41:25.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.325712.log: /var/log/ceph/ceph-client.admin.273594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273594.log.gz 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325712.log.gz 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224616.log 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.245604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245604.log.gz 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172753.log 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736825.log 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224616.log: /var/log/ceph/ceph-client.admin.172753.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172753.log.gz 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224616.log.gz 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568236.log 2024-03-18T22:41:25.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116463.log 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568236.log.gz 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736825.log.gz 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260267.log 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349817.log 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116463.log: /var/log/ceph/ceph-client.admin.260267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260267.log.gz 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116463.log.gz 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306673.log 2024-03-18T22:41:25.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349817.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113374.log 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349817.log.gz 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109911.log 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113374.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306673.log.gz 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113374.log.gz 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856805.log 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563750.log 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856805.log: /var/log/ceph/ceph-client.admin.109911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109911.log.gz 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.856805.log.gz 2024-03-18T22:41:25.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568305.log 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43252.log 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568305.log: /var/log/ceph/ceph-client.admin.563750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568305.log.gz 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563750.log.gz 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578780.log 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620368.log 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43252.log: /var/log/ceph/ceph-client.admin.578780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578780.log.gz 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846969.log 2024-03-18T22:41:25.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575056.log 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620368.log: /var/log/ceph/ceph-client.admin.846969.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846969.log.gz 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620368.log.gz 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854934.log 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575056.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575056.log.gz 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326579.log 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43252.log.gz 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314814.log 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326579.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326579.log.gz 2024-03-18T22:41:25.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.854934.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.854934.log.gz 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.735458.log 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634984.log 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735458.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735458.log.gz 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.314814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314814.log.gz 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322102.log 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855837.log 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322102.log.gz 2024-03-18T22:41:25.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627202.log 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634984.log.gz 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48708.log 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.627202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627202.log.gz 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855837.log.gz 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358781.log 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413549.log 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358781.log.gz 2024-03-18T22:41:25.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327445.log 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342088.log 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327445.log.gz 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697224.log 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48708.log.gz 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413549.log.gz 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342088.log.gz 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167606.log 2024-03-18T22:41:25.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332160.log 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.167606.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167606.log.gz 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697224.log.gz 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620934.log 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567545.log 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620934.log.gz 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410281.log 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332160.log.gz 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567545.log.gz 2024-03-18T22:41:25.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395337.log 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287450.log 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395337.log.gz 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410281.log.gz 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587138.log 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843336.log 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287450.log.gz 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267048.log 2024-03-18T22:41:25.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.843336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843336.log.gz 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587138.log.gz 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606809.log 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143152.log 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.606809.log: /var/log/ceph/ceph-client.admin.267048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606809.log.gz 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267048.log.gz 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255757.log 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156760.log 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255757.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255757.log.gz 2024-03-18T22:41:25.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143152.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143152.log.gz 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292260.log 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.524244.log 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292260.log.gz 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156760.log.gz 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246088.log 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566842.log 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246088.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246088.log.gz 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.524244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.524244.log.gz 2024-03-18T22:41:25.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737771.log 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254133.log 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.737771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737771.log.gz 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.566842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632629.log 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.254133.log: -- replaced with /var/log/ceph/ceph-client.admin.566842.log.gz 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254133.log.gz 2024-03-18T22:41:25.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738058.log 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251889.log 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738058.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738058.log.gz 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632629.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.632629.log.gz -5 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.195617.log 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177475.log 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195617.log.gz 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251889.log.gz 2024-03-18T22:41:25.797 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613348.log 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43645.log 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613348.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613348.log.gz 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177475.log.gz 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625206.log 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350295.log 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625206.log.gz 2024-03-18T22:41:25.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734602.log 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238565.log 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734602.log: /var/log/ceph/ceph-client.admin.350295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734602.log.gz 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.43645.log.gz 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553662.log 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350295.log.gz 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238565.log.gz 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841975.log 2024-03-18T22:41:25.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686407.log 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841975.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841975.log.gz 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553662.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553662.log.gz 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313184.log 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341550.log 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313184.log.gz 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686407.log.gz 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286971.log 2024-03-18T22:41:25.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685686.log 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286971.log: /var/log/ceph/ceph-client.admin.341550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346337.log 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286971.log.gz 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341550.log.gz 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685686.log.gz 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716216.log 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.346337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346337.log.gz 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154515.log 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50394.log 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154515.log.gz 2024-03-18T22:41:25.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716216.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716216.log.gz 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329268.log 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44773.log 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329268.log.gz 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845531.log 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173723.log 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.845531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845531.log.gz 2024-03-18T22:41:25.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44773.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714335.log 2024-03-18T22:41:25.803 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173723.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.50394.log.gz 2024-03-18T22:41:25.803 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173723.log.gz 2024-03-18T22:41:25.805 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611325.log 2024-03-18T22:41:25.805 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44773.log.gz 2024-03-18T22:41:25.805 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333889.log 2024-03-18T22:41:25.805 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.611325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611325.log.gz 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714335.log.gz 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717943.log 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161607.log 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717943.log: /var/log/ceph/ceph-client.admin.333889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717943.log.gz 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333889.log.gz 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414225.log 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.710351.log 2024-03-18T22:41:25.806 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414225.log.gz 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161607.log.gz 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716765.log 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564688.log 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716765.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716765.log.gz 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.710351.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.710351.log.gz 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268636.log 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585527.log 2024-03-18T22:41:25.807 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.268636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268636.log.gz 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564688.log.gz 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255688.log 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606332.log 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255688.log.gz 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585527.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585527.log.gz 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212289.log 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.606332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162425.log 2024-03-18T22:41:25.808 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606332.log.gz 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116016.log 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162425.log: /var/log/ceph/ceph-client.admin.212289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162425.log.gz 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212289.log.gz 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289883.log 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559209.log 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289883.log.gz 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116016.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116016.log.gz 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246482.log 2024-03-18T22:41:25.809 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738776.log 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246482.log.gz 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.559209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559209.log.gz 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221155.log 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229740.log 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221155.log.gz 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738776.log.gz 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46245.log 2024-03-18T22:41:25.810 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343777.log 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46245.log: /var/log/ceph/ceph-client.admin.229740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229740.log.gz 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286013.log 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219240.log 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286013.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286013.log.gz 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343777.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343777.log.gz 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.31262.log 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.46245.log.gz 2024-03-18T22:41:25.811 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569748.log 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.tmp-client.admin.31262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219240.log.gz 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.31262.log.gz 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845600.log 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.569748.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336135.log 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569748.log.gz 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617380.log 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336135.log.gz 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.845600.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845600.log.gz 2024-03-18T22:41:25.812 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226258.log 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286492.log 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.617380.log: /var/log/ceph/ceph-client.admin.226258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226258.log.gz 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617380.log.gz 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625137.log 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286492.log.gz 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202437.log 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45256.log 2024-03-18T22:41:25.813 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625137.log: /var/log/ceph/ceph-client.admin.202437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202437.log.gz 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625137.log.gz 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685966.log 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288923.log 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685966.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685966.log.gz 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45256.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352859.log 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683260.log 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.288923.log: /var/log/ceph/ceph-client.admin.352859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352859.log.gz 2024-03-18T22:41:25.814 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288923.log.gz 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.45256.log.gzgzip 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.626197.log 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.683260.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683260.log.gz 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702775.log 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566478.log 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.626197.log: /var/log/ceph/ceph-client.admin.702775.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702775.log.gz 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626197.log.gz 2024-03-18T22:41:25.815 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194522.log 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.566478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566478.log.gz 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294745.log 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287258.log 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194522.log.gz 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238826.log 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294745.log.gz 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287258.log.gz 2024-03-18T22:41:25.816 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632432.log 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271872.log 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632432.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632432.log.gz 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238826.log.gz 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307798.log 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412826.log 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271872.log: /var/log/ceph/ceph-client.admin.307798.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307798.log.gz 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271872.log.gz 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384278.log 2024-03-18T22:41:25.817 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115729.log 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384278.log.gz 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412826.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412826.log.gz 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292273.log 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112853.log 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115729.log: /var/log/ceph/ceph-client.admin.292273.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292273.log.gz 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115729.log.gz 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569735.log 2024-03-18T22:41:25.818 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112853.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218387.log 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112853.log.gz 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633991.log 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.569735.log: /var/log/ceph/ceph-client.admin.218387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218387.log.gz 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569735.log.gz 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333971.log 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734589.log 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333971.log.gz 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633991.log.gz 2024-03-18T22:41:25.819 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214151.log 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344956.log 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734589.log.gz 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729944.log 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.344956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344956.log.gz 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214151.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214151.log.gz 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614224.log 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714905.log 2024-03-18T22:41:25.820 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.729944.log: /var/log/ceph/ceph-client.admin.614224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614224.log.gz 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729944.log.gz 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615031.log 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714905.log.gz 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199825.log 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570634.log 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615031.log: /var/log/ceph/ceph-client.admin.199825.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199825.log.gz 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615031.log.gz 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174909.log 2024-03-18T22:41:25.821 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570634.log.gz 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276409.log 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49959.log 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174909.log.gz 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265499.log 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49959.log: /var/log/ceph/ceph-client.admin.276409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276409.log.gz 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578379.log 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201520.log 2024-03-18T22:41:25.822 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.265499.log: /var/log/ceph/ceph-client.admin.578379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578379.log.gz 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265499.log.gz 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289211.log 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49959.log.gz 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168506.log 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289211.log.gz 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201520.log.gz 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721009.log 2024-03-18T22:41:25.823 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232518.log 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168506.log: /var/log/ceph/ceph-client.admin.721009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721009.log.gz 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168506.log.gz 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279533.log 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845148.log 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232518.log.gz 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282871.log 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279533.log: /var/log/ceph/ceph-client.admin.845148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845148.log.gz 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279533.log.gz 2024-03-18T22:41:25.824 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44110.log 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282871.log.gz 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843267.log 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735930.log 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44110.log: /var/log/ceph/ceph-client.admin.843267.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843267.log.gz 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854330.log 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342570.log 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735930.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44110.log.gz 2024-03-18T22:41:25.825 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162494.log 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735930.log.gz 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342570.log: 0.0%/var/log/ceph/ceph-client.admin.854330.log: -- replaced with /var/log/ceph/ceph-client.admin.342570.log.gz 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.854330.log.gz 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276601.log 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277732.log 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162494.log: /var/log/ceph/ceph-client.admin.276601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276601.log.gz 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162494.log.gz 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43897.log 2024-03-18T22:41:25.826 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.277732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277732.log.gz 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630647.log 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554961.log 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272077.log 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.554961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554961.log.gz 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145460.log 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630647.log.gz 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632165.log 2024-03-18T22:41:25.827 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145460.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43897.log.gz 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145460.log.gz 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569189.log 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272077.log: gzip 0.0% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.272077.log.gz /var/log/ceph/ceph-client.admin.584725.log 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.569189.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569189.log.gz 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.632165.log: /var/log/ceph/ceph-client.admin.556453.log 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.632165.log.gz /var/log/ceph/ceph-client.admin.308770.log 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.828 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556453.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556453.log.gz 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584725.log: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.584725.log.gz /var/log/ceph/ceph-client.admin.294284.log 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309446.log 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294284.log.gz 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619236.log 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308770.log.gz 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340442.log 2024-03-18T22:41:25.829 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619236.log.gz 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194535.log 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309446.log.gz 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302874.log 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340442.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411233.log 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340442.log.gz 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302874.log.gz 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274562.log 2024-03-18T22:41:25.830 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194535.log.gz 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634471.log 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274562.log.gz 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394614.log 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411233.log.gz 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715578.log 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634471.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634471.log.gz 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339072.log 2024-03-18T22:41:25.831 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394614.log: /var/log/ceph/ceph-client.admin.715578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715578.log.gz 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394614.log.gz 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568497.log 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270220.log 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336982.log 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339072.log.gz 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270220.log.gz 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684950.log 2024-03-18T22:41:25.832 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568497.log.gz 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583704.log 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.684950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684950.log.gz 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336982.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621474.log 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336982.log.gz 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48834.log 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621474.log.gz 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.583704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255061.log 2024-03-18T22:41:25.833 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583704.log.gz 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208621.log 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255061.log.gz 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348830.log 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326146.log 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208621.log: /var/log/ceph/ceph-client.admin.348830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348830.log.gz 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208621.log.gz 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48834.log.gz 2024-03-18T22:41:25.834 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47301.log 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326146.log.gz 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309930.log 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293442.log 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589744.log 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293442.log.gz 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309930.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.309930.log.gz --verbose 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- -- replaced with /var/log/ceph/ceph-client.admin.47301.log.gz 2024-03-18T22:41:25.835 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.47133.log 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569463.log 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589744.log.gz 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204261.log 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47133.log: /var/log/ceph/ceph-client.admin.569463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569463.log.gz 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621200.log 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604196.log 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621200.log: /var/log/ceph/ceph-client.admin.204261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621200.log.gz 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-03-18T22:41:25.836 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204261.log.gz 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112922.log 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.604196.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604196.log.gz 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.362335.log 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47832.log 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112922.log: /var/log/ceph/ceph-client.admin.362335.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.362335.log.gz 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112922.log.gz 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356211.log 2024-03-18T22:41:25.837 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145649.log 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47832.log: /var/log/ceph/ceph-client.admin.356211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356211.log.gz 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355333.log 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316138.log 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.47832.log.gz 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.355333.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355333.log.gz 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145649.log.gz 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200996.log 2024-03-18T22:41:25.838 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230605.log 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316138.log: /var/log/ceph/ceph-client.admin.200996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200996.log.gz 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316138.log.gz 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110959.log 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257497.log 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230605.log: /var/log/ceph/ceph-client.admin.110959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110959.log.gz 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230605.log.gz 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584197.log 2024-03-18T22:41:25.839 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257497.log.gz 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285342.log 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584197.log.gz 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222054.log 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-client.admin.285342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285342.log.gz 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258410.log 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705166.log 2024-03-18T22:41:25.840 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.258410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258410.log.gz 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222054.log.gz 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208224.log 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585971.log 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.705166.log: /var/log/ceph/ceph-client.admin.208224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208224.log.gz 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705166.log.gz 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47469.log 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585971.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585971.log.gz 2024-03-18T22:41:25.841 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271206.log 2024-03-18T22:41:25.842 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336627.log 2024-03-18T22:41:25.842 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337874.log 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271206.log.gz 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302848.log 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336627.log.gz 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47469.log.gz 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337874.log.gz 2024-03-18T22:41:25.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351452.log 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145447.log 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302848.log.gz 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228492.log 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145447.log.gz 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351452.log.gz 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847780.log 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235289.log 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228492.log: /var/log/ceph/ceph-client.admin.847780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847780.log.gz 2024-03-18T22:41:25.920 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228492.log.gz 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252960.log 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251602.log 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252960.log.gz 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235289.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235289.log.gz 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344874.log 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345322.log 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251602.log: /var/log/ceph/ceph-client.admin.344874.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344874.log.gz 2024-03-18T22:41:25.921 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251602.log.gz 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316125.log 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577914.log 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316125.log.gz 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.345322.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345322.log.gz 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157254.log 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585902.log 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577914.log.gz 2024-03-18T22:41:25.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257932.log 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157254.log: /var/log/ceph/ceph-client.admin.585902.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585902.log.gz 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157254.log.gz 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322758.log 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568986.log 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322758.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322758.log.gz 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257932.log.gz 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293206.log 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210971.log 2024-03-18T22:41:25.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568986.log: /var/log/ceph/ceph-client.admin.293206.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293206.log.gz 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568986.log.gz 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682716.log 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43166.log 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210971.log: /var/log/ceph/ceph-client.admin.682716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682716.log.gz 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210971.log.gz 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253476.log 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43166.log: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-03-18T22:41:25.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229727.log 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.43166.log.gz 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682523.log 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253476.log.gz 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49044.log 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229727.log: /var/log/ceph/ceph-client.admin.682523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682523.log.gz 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229727.log.gz 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126199.log 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359793.log 2024-03-18T22:41:25.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.126199.log: /var/log/ceph/ceph-client.admin.172766.log 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126199.log.gz 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357027.log 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359793.log: /var/log/ceph/ceph-client.admin.172766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.172766.log.gz 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.49044.log.gz 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359793.log.gz 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857918.log 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696625.log 2024-03-18T22:41:25.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357027.log: /var/log/ceph/ceph-client.admin.857918.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357027.log.gz 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.857918.log.gz 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267747.log 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600031.log 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.696625.log: /var/log/ceph/ceph-client.admin.267747.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267747.log.gz 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696625.log.gz 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239989.log 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117807.log 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600031.log.gz 2024-03-18T22:41:25.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853421.log 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239989.log: /var/log/ceph/ceph-client.admin.117807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117807.log.gz 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239989.log.gz 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227049.log 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155403.log 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853421.log.gz 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330419.log 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227049.log: /var/log/ceph/ceph-client.admin.155403.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155403.log.gz 2024-03-18T22:41:25.928 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227049.log.gz 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127001.log 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300247.log 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330419.log.gz 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339052.log 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127001.log: /var/log/ceph/ceph-client.admin.300247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300247.log.gz 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127001.log.gz 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845613.log 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636438.log 2024-03-18T22:41:25.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339052.log.gz 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318269.log 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.845613.log: /var/log/ceph/ceph-client.admin.636438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636438.log.gz 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845613.log.gz 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156232.log 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346797.log 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318269.log.gz 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702399.log 2024-03-18T22:41:25.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156232.log: /var/log/ceph/ceph-client.admin.346797.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346797.log.gz 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156232.log.gz 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599539.log 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702399.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288034.log 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702399.log.gz 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44725.log 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599539.log: /var/log/ceph/ceph-client.admin.288034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288034.log.gz 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599539.log.gz 2024-03-18T22:41:25.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222418.log 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395726.log 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558857.log 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395726.log: /var/log/ceph/ceph-client.admin.222418.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395726.log.gz 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222418.log.gz 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855824.log 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.558857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558857.log.gz 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122247.log 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.44725.log.gz 2024-03-18T22:41:25.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267760.log 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855824.log: /var/log/ceph/ceph-client.admin.122247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122247.log.gz 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855824.log.gz 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555044.log 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267760.log.gz 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308483.log 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857876.log 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555044.log.gz 2024-03-18T22:41:25.933 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715386.log 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308483.log: /var/log/ceph/ceph-client.admin.857876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308483.log.gz 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.857876.log.gz 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635485.log 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715386.log.gz 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699004.log 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169437.log 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635485.log.gz 2024-03-18T22:41:25.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306252.log 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699004.log.gz 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.169437.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169437.log.gz 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.117350.log 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143341.log 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306252.log: /var/log/ceph/ceph-client.admin.117350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117350.log.gz 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306252.log.gz 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682977.log 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684510.log 2024-03-18T22:41:25.935 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143341.log.gz 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621844.log 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682977.log: /var/log/ceph/ceph-client.admin.684510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684510.log.gz 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682977.log.gz 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46954.log 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608218.log 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621844.log.gz 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555981.log 2024-03-18T22:41:25.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46954.log: /var/log/ceph/ceph-client.admin.608218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243972.log 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608218.log.gz 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555981.log.gz 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240930.log 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570179.log 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243972.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46954.log.gz 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48918.log 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243972.log.gz 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570179.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570179.log.gz 2024-03-18T22:41:25.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411699.log 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240930.log.gz 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410199.log 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411699.log.gz 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583621.log 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635956.log 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410199.log: /var/log/ceph/ceph-client.admin.583621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583621.log.gz 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410199.log.gz 2024-03-18T22:41:25.938 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48918.log.gz 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126401.log 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635956.log.gz 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566002.log 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721588.log 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126401.log: /var/log/ceph/ceph-client.admin.566002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566002.log.gz 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126401.log.gz 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713355.log 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721588.log.gz 2024-03-18T22:41:25.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572843.log 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200143.log 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.713355.log: /var/log/ceph/ceph-client.admin.572843.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572843.log.gz 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713355.log.gz 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328380.log 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350924.log 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200143.log.gz 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215142.log 2024-03-18T22:41:25.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350924.log: /var/log/ceph/ceph-client.admin.328380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350924.log.gz 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328380.log.gz 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239044.log 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215142.log.gz 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250922.log 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46743.log 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239044.log.gz 2024-03-18T22:41:25.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175195.log 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46743.log: /var/log/ceph/ceph-client.admin.250922.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250922.log.gz 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46743.log.gz 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268226.log 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724695.log 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175195.log: /var/log/ceph/ceph-client.admin.268226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268226.log.gz 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175195.log.gz 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358257.log 2024-03-18T22:41:25.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724695.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724695.log.gz 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626749.log 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856975.log 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358257.log.gz 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204719.log 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856975.log: /var/log/ceph/ceph-client.admin.626749.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.856975.log.gz 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626749.log.gz 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126480.log 2024-03-18T22:41:25.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855310.log 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126480.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126480.log.gz 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204719.log.gz 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578571.log 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610411.log 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855310.log: /var/log/ceph/ceph-client.admin.578571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578571.log.gz 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855310.log.gz 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277098.log 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605888.log 2024-03-18T22:41:25.944 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610411.log.gz 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857246.log 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.277098.log: /var/log/ceph/ceph-client.admin.605888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605888.log.gz 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277098.log.gz 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396231.log 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701237.log 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857246.log: /var/log/ceph/ceph-client.admin.396231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396231.log.gz 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357288.log 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.857246.log.gz 2024-03-18T22:41:25.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385076.log 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701237.log: /var/log/ceph/ceph-client.admin.357288.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357288.log.gz 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701237.log.gz 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273115.log 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412330.log 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385076.log: /var/log/ceph/ceph-client.admin.273115.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273115.log.gz 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385076.log.gz 2024-03-18T22:41:25.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850070.log 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412330.log.gz 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567284.log 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.850070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294663.log 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.850070.log.gz 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567284.log.gz 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.538242.log 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.294663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303715.log 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294663.log.gz 2024-03-18T22:41:25.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124824.log 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.538242.log: /var/log/ceph/ceph-client.admin.303715.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303715.log.gz 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.538242.log.gz 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341814.log 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.124824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124824.log.gz 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630208.log 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314801.log 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341814.log: /var/log/ceph/ceph-client.admin.630208.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630208.log.gz 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341814.log.gz 2024-03-18T22:41:25.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718888.log 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.314801.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207550.log 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314801.log.gz 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244999.log 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718888.log: /var/log/ceph/ceph-client.admin.207550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207550.log.gz 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718888.log.gz 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.457910.log 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244999.log.gz 2024-03-18T22:41:25.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857059.log 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.457910.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384607.log 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.457910.log.gz 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333454.log 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857059.log: /var/log/ceph/ceph-client.admin.384607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384607.log.gz 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228024.log 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.857059.log.gz 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620647.log 2024-03-18T22:41:25.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333454.log: /var/log/ceph/ceph-client.admin.228024.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228024.log.gz 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333454.log.gz 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312516.log 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844175.log 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620647.log.gz 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158562.log 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312516.log: /var/log/ceph/ceph-client.admin.844175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844175.log.gz 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312516.log.gz 2024-03-18T22:41:25.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716970.log 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291798.log 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158562.log: /var/log/ceph/ceph-client.admin.716970.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716970.log.gz 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158562.log.gz 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387406.log 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274575.log 2024-03-18T22:41:25.952 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291798.log: /var/log/ceph/ceph-client.admin.387406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387406.log.gz 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291798.log.gz 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615113.log 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340980.log 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274575.log.gz 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222067.log 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615113.log: /var/log/ceph/ceph-client.admin.340980.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340980.log.gz 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615113.log.gz 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176803.log 2024-03-18T22:41:25.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222067.log.gz 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330628.log 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725402.log 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176803.log.gz 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587871.log 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330628.log: /var/log/ceph/ceph-client.admin.725402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725402.log.gz 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330628.log.gz 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161958.log 2024-03-18T22:41:25.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587871.log.gz 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273799.log 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634060.log 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161958.log: /var/log/ceph/ceph-client.admin.273799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273799.log.gz 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161958.log.gz 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331663.log 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319677.log 2024-03-18T22:41:25.955 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634060.log.gz 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584401.log 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331663.log: /var/log/ceph/ceph-client.admin.319677.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319677.log.gz 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331663.log.gz 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147295.log 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584401.log.gz 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703790.log 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.147295.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44894.log 2024-03-18T22:41:25.956 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147295.log.gz 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600497.log 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703790.log: /var/log/ceph/ceph-client.admin.44894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703790.log.gz 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123190.log 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352928.log 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600497.log: /var/log/ceph/ceph-client.admin.123190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123190.log.gz 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600497.log.gz 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566911.log 2024-03-18T22:41:25.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352928.log.gz 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44894.log.gz 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702587.log 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.566911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176262.log 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566911.log.gz 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615992.log 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702587.log: /var/log/ceph/ceph-client.admin.176262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176262.log.gz 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702587.log.gz 2024-03-18T22:41:25.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48582.log 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615992.log.gz 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720804.log 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269183.log 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48582.log: /var/log/ceph/ceph-client.admin.720804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720804.log.gz 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143624.log 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739410.log 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.48582.log.gz 2024-03-18T22:41:25.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.269183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269183.log.gz 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143624.log.gz 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223945.log 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346810.log 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739410.log: /var/log/ceph/ceph-client.admin.223945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223945.log.gz 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739410.log.gz 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701521.log 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.346810.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346810.log.gz 2024-03-18T22:41:25.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328393.log 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345851.log 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701521.log: /var/log/ceph/ceph-client.admin.328393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328393.log.gz 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701521.log.gz 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408646.log 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614590.log 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408646.log: /var/log/ceph/ceph-client.admin.345851.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408646.log.gz 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345851.log.gz 2024-03-18T22:41:25.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577147.log 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686876.log 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.614590.log: /var/log/ceph/ceph-client.admin.577147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577147.log.gz 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614590.log.gz 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210902.log 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256123.log 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686876.log.gz 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226546.log 2024-03-18T22:41:25.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210902.log: /var/log/ceph/ceph-client.admin.256123.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256123.log.gz 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210902.log.gz 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196737.log 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250717.log 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226546.log.gz 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290332.log 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196737.log.gz 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250717.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250717.log.gz 2024-03-18T22:41:25.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577640.log 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.290332.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683718.log 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290332.log.gz 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563241.log 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577640.log: /var/log/ceph/ceph-client.admin.683718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683718.log.gz 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577640.log.gz 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394395.log 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.563241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563241.log.gz 2024-03-18T22:41:25.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216538.log 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281908.log 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216538.log: /var/log/ceph/ceph-client.admin.394395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216538.log.gz 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394395.log.gz 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567366.log 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281908.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281908.log.gz 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228973.log 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307523.log 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567366.log.gz 2024-03-18T22:41:25.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605901.log 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307523.log.gz 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228973.log.gz 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273607.log 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850624.log 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.605901.log: /var/log/ceph/ceph-client.admin.273607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273607.log.gz 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.605901.log.gz 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330697.log 2024-03-18T22:41:25.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.850624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.711309.log 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.850624.log.gz 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602610.log 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330697.log: /var/log/ceph/ceph-client.admin.711309.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.711309.log.gz 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330697.log.gz 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704266.log 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567829.log 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602610.log.gz 2024-03-18T22:41:25.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164012.log 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.704266.log: /var/log/ceph/ceph-client.admin.567829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567829.log.gz 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704266.log.gz 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584447.log 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.164012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164012.log.gz 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244917.log 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584447.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410943.log 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584447.log.gz 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274767.log 2024-03-18T22:41:25.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410943.log.gz/var/log/ceph/ceph-client.admin.244917.log: 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244917.log.gz 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575566.log 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357301.log 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274767.log: /var/log/ceph/ceph-client.admin.575566.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575566.log.gz 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274767.log.gz 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287532.log 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551519.log 2024-03-18T22:41:25.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357301.log.gz 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302557.log 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287532.log: /var/log/ceph/ceph-client.admin.551519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551519.log.gz 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287532.log.gz 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291729.log 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586943.log 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302557.log.gz 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236552.log 2024-03-18T22:41:25.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291729.log: /var/log/ceph/ceph-client.admin.586943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586943.log.gz 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291729.log.gz 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384884.log 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235371.log 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236552.log.gz 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615568.log 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384884.log: /var/log/ceph/ceph-client.admin.235371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235371.log.gz 2024-03-18T22:41:25.971 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384884.log.gz 2024-03-18T22:41:26.062 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324928.log 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617367.log 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615568.log.gz 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565139.log 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324928.log: /var/log/ceph/ceph-client.admin.617367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617367.log.gz 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324928.log.gz 2024-03-18T22:41:26.063 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339891.log 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565139.log.gz 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682164.log 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632254.log 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339891.log.gz 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46110.log 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682164.log: /var/log/ceph/ceph-client.admin.632254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632254.log.gz 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682164.log.gz 2024-03-18T22:41:26.064 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327960.log 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.46110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42955.log 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.46110.log.gz 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735999.log 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327960.log: /var/log/ceph/ceph-client.admin.42955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327960.log.gz 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598777.log 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735999.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.42955.log.gz 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355346.log 2024-03-18T22:41:26.065 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735999.log.gz 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322281.log 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598777.log: /var/log/ceph/ceph-client.admin.355346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355346.log.gz 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598777.log.gz 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330227.log 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695965.log 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322281.log.gz 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330227.log.gz 2024-03-18T22:41:26.066 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125218.log 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.695965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257945.log 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695965.log.gz 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.125218.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125218.log.gz 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48204.log 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328744.log 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257945.log.gz 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713905.log 2024-03-18T22:41:26.067 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48204.log: /var/log/ceph/ceph-client.admin.328744.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.328744.log.gz 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412141.log 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42856.log 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48204.log.gz 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412141.log: /var/log/ceph/ceph-client.admin.713905.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412141.log.gz 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713905.log.gz 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146378.log 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.42856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719641.log 2024-03-18T22:41:26.068 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156678.log 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351465.log 0.0% 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.146378.log.gz 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42856.log.gz 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719641.log: /var/log/ceph/ceph-client.admin.156678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156678.log.gz 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719641.log.gz 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717464.log 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685468.log 2024-03-18T22:41:26.069 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351465.log.gz 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339345.log 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717464.log: /var/log/ceph/ceph-client.admin.685468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685468.log.gz 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717464.log.gz 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143354.log 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250935.log 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339345.log: /var/log/ceph/ceph-client.admin.143354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143354.log.gz 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339345.log.gz 2024-03-18T22:41:26.070 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624576.log 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201065.log 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250935.log: /var/log/ceph/ceph-client.admin.624576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624576.log.gz 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250935.log.gz 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718217.log 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142279.log 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201065.log.gz 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241204.log 2024-03-18T22:41:26.071 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718217.log: /var/log/ceph/ceph-client.admin.142279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142279.log.gz 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718217.log.gz 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321252.log 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206130.log 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241204.log.gz 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626487.log 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321252.log: /var/log/ceph/ceph-client.admin.206130.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206130.log.gz 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321252.log.gz 2024-03-18T22:41:26.072 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268157.log 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.626487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261223.log 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626487.log.gz 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239715.log 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.268157.log: /var/log/ceph/ceph-client.admin.261223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261223.log.gz 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268157.log.gz 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301712.log 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277377.log 2024-03-18T22:41:26.073 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239715.log.gz 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574691.log 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301712.log: /var/log/ceph/ceph-client.admin.277377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277377.log.gz 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301712.log.gz 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843789.log 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722259.log 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574691.log.gz 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715852.log 2024-03-18T22:41:26.074 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.843789.log: /var/log/ceph/ceph-client.admin.722259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722259.log.gz 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843789.log.gz 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348855.log 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.715852.log: --verbose -- /var/log/ceph/ceph-client.admin.211910.log 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715852.log.gz 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320803.log 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348855.log: /var/log/ceph/ceph-client.admin.211910.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211910.log.gz 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348855.log.gz 2024-03-18T22:41:26.075 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412343.log 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226340.log 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320803.log.gz 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395808.log 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412343.log: /var/log/ceph/ceph-client.admin.226340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226340.log.gz 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412343.log.gz 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386967.log 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337497.log 2024-03-18T22:41:26.076 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395808.log.gz 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575943.log 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337497.log: /var/log/ceph/ceph-client.admin.386967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337497.log.gz 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386967.log.gz 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147484.log 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623302.log 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575943.log.gz 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386954.log 2024-03-18T22:41:26.077 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.147484.log: /var/log/ceph/ceph-client.admin.623302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623302.log.gz 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147484.log.gz 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682785.log 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733565.log 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386954.log.gz 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193136.log 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682785.log: /var/log/ceph/ceph-client.admin.733565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733565.log.gz 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682785.log.gz 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726472.log 2024-03-18T22:41:26.078 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731315.log 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193136.log.gz 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250648.log 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726472.log: /var/log/ceph/ceph-client.admin.731315.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731315.log.gz 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726472.log.gz 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.706895.log 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618698.log 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250648.log.gz 2024-03-18T22:41:26.079 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682798.log 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.706895.log: /var/log/ceph/ceph-client.admin.618698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618698.log.gz 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.706895.log.gz 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220244.log 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238552.log 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682798.log.gz 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323063.log 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220244.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220244.log.gz 2024-03-18T22:41:26.080 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238552.log.gz 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856848.log 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628394.log 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323063.log.gz 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313455.log 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856848.log: /var/log/ceph/ceph-client.admin.628394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628394.log.gz 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282461.log 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313455.log.gz 2024-03-18T22:41:26.081 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.856848.log.gz 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229178.log 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857204.log 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282461.log.gz 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148204.log 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229178.log: /var/log/ceph/ceph-client.admin.857204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229178.log.gz 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.857204.log.gz 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574176.log 2024-03-18T22:41:26.082 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634997.log 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148204.log.gz 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623010.log 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634997.log.gz 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574176.log.gz 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288526.log 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143813.log 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623010.log: /var/log/ceph/ceph-client.admin.288526.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288526.log.gz 2024-03-18T22:41:26.083 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623010.log.gz 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568318.log 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277814.log 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143813.log.gz 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740061.log 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568318.log: /var/log/ceph/ceph-client.admin.277814.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277814.log.gz 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568318.log.gz 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338322.log 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.740061.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313748.log 2024-03-18T22:41:26.084 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.740061.log.gz 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145919.log 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338322.log: /var/log/ceph/ceph-client.admin.313748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313748.log.gz 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338322.log.gz 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268718.log 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145919.log.gz 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590642.log 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.268718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250730.log 2024-03-18T22:41:26.085 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268718.log.gz 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607322.log 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250730.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250730.log.gz 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590642.log.gz 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213469.log 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202945.log 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607322.log: /var/log/ceph/ceph-client.admin.213469.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213469.log.gz 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607322.log.gz 2024-03-18T22:41:26.086 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350487.log 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202945.log.gz 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408367.log 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248374.log 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350487.log: /var/log/ceph/ceph-client.admin.408367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408367.log.gz 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350487.log.gz 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681803.log 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261634.log 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.248374.log: /var/log/ceph/ceph-client.admin.681803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681803.log.gz 2024-03-18T22:41:26.087 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248374.log.gz 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278885.log 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385145.log 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.261634.log: /var/log/ceph/ceph-client.admin.278885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278885.log.gz 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261634.log.gz 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251671.log 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385145.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210692.log 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385145.log.gz 2024-03-18T22:41:26.088 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325348.log 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251671.log: /var/log/ceph/ceph-client.admin.210692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210692.log.gz 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251671.log.gz 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162507.log 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.325348.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727293.log 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325348.log.gz 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704253.log 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162507.log: /var/log/ceph/ceph-client.admin.727293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727293.log.gz 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162507.log.gz 2024-03-18T22:41:26.089 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350091.log 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.704253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704253.log.gz 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48462.log 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327094.log 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350091.log: /var/log/ceph/ceph-client.admin.48462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350091.log.gz 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163397.log 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310217.log 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327094.log.gz 2024-03-18T22:41:26.090 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292945.log 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163397.log: /var/log/ceph/ceph-client.admin.310217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310217.log.gz 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163397.log.gz 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306604.log 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292945.log.gz 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48462.log.gz 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316313.log 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684142.log 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306604.log: /var/log/ceph/ceph-client.admin.316313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316313.log.gz 2024-03-18T22:41:26.091 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306604.log.gz 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313679.log 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.684142.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684142.log.gz 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47175.log 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339039.log 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313679.log.gz 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200604.log 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339039.log.gz 2024-03-18T22:41:26.092 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.203157.log 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552164.log 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200604.log: /var/log/ceph/ceph-client.admin.203157.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.203157.log.gz 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47175.log.gz 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200604.log.gz 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261153.log 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.552164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552164.log.gz 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274283.log 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.261153.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308291.log 2024-03-18T22:41:26.093 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261153.log.gz 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243051.log 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274283.log: /var/log/ceph/ceph-client.admin.308291.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308291.log.gz 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274283.log.gz 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584787.log 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243051.log.gz 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853352.log 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584787.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632234.log 2024-03-18T22:41:26.094 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584787.log.gz 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604183.log 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853352.log: /var/log/ceph/ceph-client.admin.632234.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632234.log.gz 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853352.log.gz 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683636.log 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.604183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239031.log 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604183.log.gz 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355772.log 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.683636.log: /var/log/ceph/ceph-client.admin.239031.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239031.log.gz 2024-03-18T22:41:26.095 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683636.log.gz 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311436.log 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.355772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202450.log 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355772.log.gz 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290401.log 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311436.log: /var/log/ceph/ceph-client.admin.202450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202450.log.gz 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311436.log.gz 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125653.log 2024-03-18T22:41:26.096 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.290401.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290401.log.gz 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625759.log 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.125653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266845.log 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125653.log.gz 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154528.log 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625759.log: /var/log/ceph/ceph-client.admin.266845.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266845.log.gz 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625759.log.gz 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854343.log 2024-03-18T22:41:26.097 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589004.log 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154528.log.gz 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.854343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145906.log 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.854343.log.gz 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589004.log.gz 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234402.log 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570193.log 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145906.log: /var/log/ceph/ceph-client.admin.234402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234402.log.gz 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145906.log.gz 2024-03-18T22:41:26.098 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599470.log 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249542.log 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570193.log.gz 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192240.log 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599470.log: /var/log/ceph/ceph-client.admin.249542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249542.log.gz 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599470.log.gz 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223932.log 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303171.log 2024-03-18T22:41:26.099 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192240.log.gz 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551532.log 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223932.log: /var/log/ceph/ceph-client.admin.303171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303171.log.gz 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223932.log.gz 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293425.log 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.551532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311807.log 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551532.log.gz 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.326215.log 2024-03-18T22:41:26.100 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293425.log: /var/log/ceph/ceph-client.admin.311807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311807.log.gz 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293425.log.gz 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143083.log 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.326215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125300.log 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.326215.log.gz 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221086.log 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143083.log: /var/log/ceph/ceph-client.admin.125300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125300.log.gz 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143083.log.gz 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622805.log 2024-03-18T22:41:26.101 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206143.log 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622805.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622805.log.gz 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221086.log.gz 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568781.log 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329665.log 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206143.log: /var/log/ceph/ceph-client.admin.568781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568781.log.gz 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206143.log.gz 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162870.log 2024-03-18T22:41:26.102 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329665.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329665.log.gz 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603729.log 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618685.log 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162870.log.gz 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278175.log 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618685.log.gz 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603729.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603729.log.gz 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262147.log 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355264.log 2024-03-18T22:41:26.103 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.278175.log: /var/log/ceph/ceph-client.admin.262147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262147.log.gz 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278175.log.gz 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343571.log 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49645.log 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343571.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343571.log.gz 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.355264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355264.log.gz 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.2.46549.log 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212371.log 2024-03-18T22:41:26.104 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49645.log: /var/log/ceph/ceph-client.2.46549.log: 0.0% -- replaced with /var/log/ceph/ceph-client.2.46549.log.gz 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348638.log 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622294.log 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.49645.log.gz 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348638.log.gz 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212371.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212371.log.gz 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48294.log 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576025.log 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622294.log: /var/log/ceph/ceph-client.admin.48294.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622294.log.gz 2024-03-18T22:41:26.105 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734960.log 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576025.log.gz 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48294.log.gz 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148858.log 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635416.log 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734960.log.gz 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236265.log 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635416.log.gz 2024-03-18T22:41:26.106 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148858.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148858.log.gz 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728668.log 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236265.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236265.log.gz 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312529.log 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.728668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728668.log.gz 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244054.log 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318714.log 2024-03-18T22:41:26.107 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312529.log: /var/log/ceph/ceph-client.admin.244054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244054.log.gz 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312529.log.gz 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571996.log 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288513.log 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318714.log.gz 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346030.log 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571996.log: /var/log/ceph/ceph-client.admin.288513.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288513.log.gz 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571996.log.gz 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385956.log 2024-03-18T22:41:26.108 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.346030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346030.log.gz 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856891.log 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281698.log 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385956.log.gz 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413283.log 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281698.log.gz 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572379.log 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212750.log 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.856891.log.gz 2024-03-18T22:41:26.109 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413283.log: /var/log/ceph/ceph-client.admin.572379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572379.log.gz 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413283.log.gz 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267307.log 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289965.log/var/log/ceph/ceph-client.admin.212750.log: 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212750.log.gz 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267307.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43124.log 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267307.log.gz 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192675.log 2024-03-18T22:41:26.110 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43124.log: /var/log/ceph/ceph-client.admin.289965.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627120.log 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289965.log.gz 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280501.log 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.627120.log: 0.0%/var/log/ceph/ceph-client.admin.192675.log: -- replaced with /var/log/ceph/ceph-client.admin.627120.log.gz 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192675.log.gz 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719093.log 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857750.log 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280501.log.gz 2024-03-18T22:41:26.111 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681721.log 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719093.log: /var/log/ceph/ceph-client.admin.857750.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.857750.log.gz 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719093.log.gz 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279177.log 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317823.log 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.43124.log.gz 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254843.log 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681721.log.gz 2024-03-18T22:41:26.112 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317823.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317823.log.gz 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116816.log 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279177.log.gz 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410715.log 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116816.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116816.log.gz 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254843.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599264.log 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254843.log.gz 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611879.log 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599264.log.gz 2024-03-18T22:41:26.113 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265956.log 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410715.log.gz 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266776.log 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.265956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265956.log.gz 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.611879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45772.log 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611879.log.gz 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146365.log 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45772.log: /var/log/ceph/ceph-client.admin.266776.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734118.log 2024-03-18T22:41:26.114 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266776.log.gz 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225095.log 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45772.log.gz 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734118.log: 0.0%/var/log/ceph/ceph-client.admin.146365.log: -- replaced with /var/log/ceph/ceph-client.admin.734118.log.gz 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146365.log.gz 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45046.log 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.225095.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.626474.log 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225095.log.gz 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842361.log 2024-03-18T22:41:26.115 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.626474.log: /var/log/ceph/ceph-client.admin.45046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626474.log.gz 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316722.log 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.557085.log 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.45046.log.gz 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.842361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842361.log.gz 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599552.log 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316722.log: /var/log/ceph/ceph-client.admin.557085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.557085.log.gz 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316722.log.gz 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161151.log 2024-03-18T22:41:26.116 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207040.log 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276893.log 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599552.log.gz 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207040.log.gz 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161151.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305505.log 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161151.log.gz 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554040.log 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305505.log: /var/log/ceph/ceph-client.admin.276893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305505.log.gz 2024-03-18T22:41:26.117 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237752.log 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276893.log.gz 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.192688.log 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237752.log.gz 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.554040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850153.log 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554040.log.gz 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574245.log 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.192688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563310.log 2024-03-18T22:41:26.118 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192688.log.gz 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574245.log: 0.0%/var/log/ceph/ceph-client.admin.850153.log: -- replaced with /var/log/ceph/ceph-client.admin.574245.log.gz 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.850153.log.gz -5 --verbose -- 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr: /var/log/ceph/ceph-client.admin.204274.log 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148871.log 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204274.log: /var/log/ceph/ceph-client.admin.563310.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204274.log.gz 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251209.log 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563310.log.gz 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740130.log 2024-03-18T22:41:26.119 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251209.log.gz 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148871.log.gz 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285821.log 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317741.log 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285821.log.gz 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.740130.log: 0.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.740130.log.gz --verbose 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.852432.log 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242367.log 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852432.log: /var/log/ceph/ceph-client.admin.317741.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852432.log.gz 2024-03-18T22:41:26.120 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317741.log.gz 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194979.log 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556170.log 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194979.log.gz 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858451.log 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242367.log.gz 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302172.log 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858451.log: /var/log/ceph/ceph-client.admin.556170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147282.log 2024-03-18T22:41:26.121 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.858451.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556170.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302172.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161594.log 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.428107.log 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161594.log: /var/log/ceph/ceph-client.admin.147282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161594.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213690.log 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147282.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.428107.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.428107.log.gz 2024-03-18T22:41:26.122 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565574.log 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232070.log 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565574.log.gz 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213690.log.gz 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735228.log 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232070.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232070.log.gz 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255253.log 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735228.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360413.log 2024-03-18T22:41:26.123 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735228.log.gz 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175639.log 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360413.log.gz 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255253.log.gz 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48540.log 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716696.log 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48540.log: /var/log/ceph/ceph-client.admin.175639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.563323.log 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175639.log.gz 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716696.log.gz 2024-03-18T22:41:26.124 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308565.log 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2024-03-18T22:41:26.125 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2024-03-18T22:41:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315694.log 2024-03-18T22:41:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.563323.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.563323.log.gz 2024-03-18T22:41:26.231 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731710.log 2024-03-18T22:41:26.231 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308565.log.gz 2024-03-18T22:41:26.231 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48540.log.gz 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123870.log 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315694.log.gz 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148434.log 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123870.log.gz 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.731710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731710.log.gz 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584702.log 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148417.log 2024-03-18T22:41:26.232 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148434.log: /var/log/ceph/ceph-client.admin.584702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584702.log.gz 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148434.log.gz 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220706.log 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251684.log 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148417.log.gz 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849670.log 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251684.log.gz 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220706.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220706.log.gz 2024-03-18T22:41:26.233 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231596.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43771.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.849670.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849670.log.gz 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307043.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231596.log: gzip 0.0% -5 --verbose -- /var/log/ceph/ceph-client.admin.681790.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.231596.log.gz 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306170.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681790.log.gz 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384048.log 2024-03-18T22:41:26.234 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307043.log.gz 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686807.log 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384048.log.gz 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246101.log 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306170.log.gz 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562347.log 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246101.log.gz 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601890.log 2024-03-18T22:41:26.235 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686807.log.gz 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727889.log 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.601890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601890.log.gz 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.562347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627783.log 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562347.log.gz 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221985.log 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.627783.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627783.log.gz 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.727889.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695427.log 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727889.log.gz 2024-03-18T22:41:26.236 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.43771.log.gz 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353944.log 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.695427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695427.log.gz 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128667.log 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113361.log 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221985.log.gz 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128667.log.gz 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252523.log 2024-03-18T22:41:26.237 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353944.log.gz 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.385585.log 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252523.log.gz 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695883.log 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113361.log.gz 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851015.log 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.695883.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695883.log.gz 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.385585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322496.log 2024-03-18T22:41:26.238 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.385585.log.gz 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303158.log 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50436.log 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851015.log.gz 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303158.log.gz 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210463.log 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322496.log.gz 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720817.log 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210463.log.gz 2024-03-18T22:41:26.239 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128585.log 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249255.log 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353410.log 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720817.log: /var/log/ceph/ceph-client.admin.249255.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720817.log.gz 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249255.log.gz 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128585.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714405.log 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128585.log.gz 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353410.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353410.log.gz 2024-03-18T22:41:26.240 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352446.log 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285808.log 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352446.log.gz 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315254.log 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714405.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50436.log.gz 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609017.log 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714405.log.gz 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315254.log.gz 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338593.log 2024-03-18T22:41:26.241 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285808.log.gz 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148789.log 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338593.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338593.log.gz 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609017.log.gz 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725210.log 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695952.log 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.725210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725210.log.gz 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194009.log 2024-03-18T22:41:26.242 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148789.log.gz 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157740.log 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194009.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194009.log.gz/var/log/ceph/ceph-client.admin.695952.log: 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695952.log.gz 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681068.log 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249529.log 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358850.log 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157740.log.gz 2024-03-18T22:41:26.243 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249529.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249529.log.gz 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681068.log.gz 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239318.log 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176451.log 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358850.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358850.log.gz 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199154.log 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239318.log.gz 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579067.log 2024-03-18T22:41:26.244 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176451.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176451.log.gz 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220162.log 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844627.log 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199154.log.gz 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220162.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220162.log.gz 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579067.log.gz 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191730.log 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229466.log 2024-03-18T22:41:26.245 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.844627.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844627.log.gz 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739209.log 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.695509.log 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191730.log: /var/log/ceph/ceph-client.admin.739209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191730.log.gz 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739209.log.gz 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229466.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236042.log 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229466.log.gz 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858255.log 2024-03-18T22:41:26.246 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236042.log.gz 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.695509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555994.log 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.695509.log.gz 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.251196.log 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555994.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555994.log.gz 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145636.log 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703236.log 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145636.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145636.log.gz 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.251196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580140.log 2024-03-18T22:41:26.247 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.251196.log.gz 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.858255.log.gz 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703236.log.gz 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257062.log 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215995.log 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.580140.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235085.log 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580140.log.gz 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215995.log.gz 2024-03-18T22:41:26.248 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202876.log 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257062.log.gz 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852363.log 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202876.log.gz 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235085.log.gz 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607309.log 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575496.log 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194078.log 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852363.log.gz 2024-03-18T22:41:26.249 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114755.log 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607309.log.gz 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194078.log.gz 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585458.log 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575496.log.gz 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242846.log 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725484.log 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114755.log.gz 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242846.log.gz 2024-03-18T22:41:26.250 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247491.log 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585458.log: /var/log/ceph/ceph-client.admin.725484.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585458.log.gz 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725484.log.gz 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285603.log 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317314.log 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272159.log 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247491.log.gz 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317314.log.gz 2024-03-18T22:41:26.251 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320119.log 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285603.log.gz 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313253.log 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320119.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320119.log.gz 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272159.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272159.log.gz 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851920.log 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625772.log 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856543.log 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313253.log.gz 2024-03-18T22:41:26.252 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851920.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583691.log 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851920.log.gz 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856543.log: /var/log/ceph/ceph-client.admin.625772.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.856543.log.gz 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289952.log 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625772.log.gz 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249816.log 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289952.log.gz 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.583691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43687.log 2024-03-18T22:41:26.253 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%gzip -5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.583691.log.gz -- /var/log/ceph/ceph-client.admin.721296.log 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43687.log: /var/log/ceph/ceph-client.admin.249816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219701.log 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249816.log.gz 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721296.log.gz 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302639.log 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243575.log 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219701.log.gz 2024-03-18T22:41:26.254 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616429.log 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302639.log.gz 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144259.log 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622818.log 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243575.log.gz 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144259.log.gz 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.616429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616429.log.gz 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323462.log 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268705.log 2024-03-18T22:41:26.255 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214220.log 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622818.log.gz 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.268705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268705.log.gz 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323462.log.gz 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558926.log 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576474.log 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43687.log.gz 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.204192.log 2024-03-18T22:41:26.256 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214220.log: /var/log/ceph/ceph-client.admin.558926.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214220.log.gz 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576474.log.gz 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558926.log.gz 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587884.log 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301142.log 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.204192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.204192.log.gz 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359371.log 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587884.log.gz 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200617.log 2024-03-18T22:41:26.257 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317327.log 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301142.log.gz 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598570.log 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359371.log.gz 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317327.log.gz 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630729.log 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200617.log.gz 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722546.log 2024-03-18T22:41:26.258 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225861.log 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598570.log.gz 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722546.log.gz 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630729.log.gz 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258328.log 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49315.log: /var/log/ceph/ceph-client.admin.225861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225861.log.gz 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222897.log 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576012.log 2024-03-18T22:41:26.259 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222897.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222897.log.gz 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.258328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145190.log 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258328.log.gz 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330214.log 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145190.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145190.log.gz 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576012.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319664.log 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576012.log.gz 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330214.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330214.log.gz 2024-03-18T22:41:26.260 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636233.log 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566015.log 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636233.log.gz 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.319664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849657.log 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319664.log.gz 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.566015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566015.log.gz 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322089.log 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360152.log 2024-03-18T22:41:26.261 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322089.log.gz 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.849657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46911.log 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849657.log.gz 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50352.log 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46911.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736907.log 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49855.log 0.0% 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.360152.log.gz 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.46911.log.gz 2024-03-18T22:41:26.262 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736907.log.gz 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578862.log 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49855.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.50352.log.gz 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213772.log 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49855.log.gz 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.578862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304642.log 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213772.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578862.log.gz 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213772.log.gz 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213293.log 2024-03-18T22:41:26.263 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284594.log 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213293.log.gz 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304642.log.gz 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609099.log 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284594.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284594.log.gz 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176464.log 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609099.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609099.log.gz 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267678.log 2024-03-18T22:41:26.264 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117363.log 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267678.log.gz 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176464.log.gz 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200156.log 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117363.log.gz 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241696.log 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200156.log.gz 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620660.log 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241696.log.gz 2024-03-18T22:41:26.265 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636903.log 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620660.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620660.log.gz 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244533.log 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636903.log.gz 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636986.log 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719175.log 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636986.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636986.log.gz 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244533.log.gz 2024-03-18T22:41:26.266 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295198.log 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719175.log.gz 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414021.log 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225587.log 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295198.log: /var/log/ceph/ceph-client.admin.414021.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414021.log.gz 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295198.log.gz 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46869.log 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.225587.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.733831.log 2024-03-18T22:41:26.267 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225587.log.gz 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.339427.log 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46869.log: /var/log/ceph/ceph-client.admin.733831.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733831.log.gz 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111852.log 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.339427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413296.log 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.339427.log.gz 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609523.log 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111852.log.gz 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413296.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.413296.log.gz 2024-03-18T22:41:26.268 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.411220.log 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129565.log 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411220.log.gz 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609523.log.gz 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229658.log 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129565.log.gz 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110530.log 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49002.log 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.46869.log.gz 2024-03-18T22:41:26.269 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110530.log: /var/log/ceph/ceph-client.admin.229658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110530.log.gz 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587614.log 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229658.log.gz 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49002.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49002.log.gz 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112935.log 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722533.log 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.112935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.112935.log.gz 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587614.log.gz 2024-03-18T22:41:26.270 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857834.log 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722533.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722533.log.gz 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411438.log 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196276.log 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411438.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411438.log.gz 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848232.log 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196276.log.gz 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.857834.log.gz 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847849.log 2024-03-18T22:41:26.271 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.848232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848232.log.gz 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601352.log 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.484167.log 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.601352.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601352.log.gz 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.847849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847849.log.gz 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216064.log 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.484167.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.484167.log.gz 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630716.log 2024-03-18T22:41:26.272 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267965.log 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630716.log.gz 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216064.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216064.log.gz 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683705.log 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267965.log.gz 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318187.log 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44989.log 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318187.log: /var/log/ceph/ceph-client.admin.683705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318187.log.gz 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683705.log.gz 2024-03-18T22:41:26.273 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721575.log 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281022.log 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44989.log: /var/log/ceph/ceph-client.admin.721575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721575.log.gz 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252163.log 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.635498.log 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252163.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252163.log.gz 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702386.log 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.44989.log.gz 2024-03-18T22:41:26.274 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281022.log.gz 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635498.log.gz 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717246.log 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702386.log.gz 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.318632.log 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408949.log 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.318632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.318632.log.gz 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717246.log.gz 2024-03-18T22:41:26.275 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606740.log 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408949.log.gz 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.709634.log 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414238.log 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.709634.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.709634.log.gz 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.606740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606740.log.gz 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49170.log 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414238.log.gz 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584680.log 2024-03-18T22:41:26.276 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739667.log 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584680.log.gz 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553405.log 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739667.log.gz 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846887.log 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45172.log 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846887.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846887.log.gz 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345769.log 2024-03-18T22:41:26.277 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553405.log.gz 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49170.log.gz 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857960.log 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.345769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345769.log.gz 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217857.log 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234893.log 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564393.log 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234893.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234893.log.gz 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217857.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554560.log 2024-03-18T22:41:26.278 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217857.log.gz 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562801.log 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.857960.log.gz 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.554560.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554560.log.gz 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611338.log 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564393.log.gz 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.562801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562801.log.gz 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46827.log 2024-03-18T22:41:26.279 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.355841.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46827.log: /var/log/ceph/ceph-client.admin.611338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342019.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611338.log.gz 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310696.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342019.log.gz 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.355841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300329.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.355841.log.gz 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354427.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606262.log 2024-03-18T22:41:26.280 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310696.log.gz 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354427.log.gz 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.300329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351895.log 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300329.log.gz 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386482.log 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351895.log: 0.0%/var/log/ceph/ceph-client.admin.606262.log: -- replaced with /var/log/ceph/ceph-client.admin.351895.log.gz 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47217.log 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606262.log.gz 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722738.log 2024-03-18T22:41:26.281 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47217.log: /var/log/ceph/ceph-client.admin.386482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335718.log 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386482.log.gz 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150225.log 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722738.log.gz 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857666.log 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335718.log.gz 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334406.log 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.150225.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150225.log.gz 2024-03-18T22:41:26.282 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716503.log 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857666.log: /var/log/ceph/ceph-client.admin.334406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167619.log 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.45172.log.gz 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303089.log 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.334406.log.gz 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.857666.log.gz 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.167619.log: /var/log/ceph/ceph-client.admin.716503.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.167619.log.gz 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163835.log 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716503.log.gz 2024-03-18T22:41:26.283 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.46827.log.gz 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47217.log.gz 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303089.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118252.log 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303089.log.gz 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128211.log 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.163835.log: /var/log/ceph/ceph-client.admin.118252.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118252.log.gz 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163835.log.gz 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344242.log 2024-03-18T22:41:26.284 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278898.log 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128211.log.gz 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351908.log 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.344242.log: /var/log/ceph/ceph-client.admin.278898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278898.log.gz 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344242.log.gz 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115151.log 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351908.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.344047.log 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351908.log.gz 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237739.log 2024-03-18T22:41:26.285 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115151.log: /var/log/ceph/ceph-client.admin.344047.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.344047.log.gz 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115151.log.gz 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717259.log 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408633.log 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.237739.log: /var/log/ceph/ceph-client.admin.717259.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717259.log.gz 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237739.log.gz 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42997.log 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293952.log 2024-03-18T22:41:26.286 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408633.log: /var/log/ceph/ceph-client.admin.42997.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408633.log.gz 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579770.log 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849136.log 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293952.log.gz 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323270.log 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579770.log: /var/log/ceph/ceph-client.admin.849136.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849136.log.gz 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579770.log.gz 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357014.log 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679890.log 2024-03-18T22:41:26.287 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323270.log.gz 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599949.log 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357014.log: /var/log/ceph/ceph-client.admin.679890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679890.log.gz 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357014.log.gz 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168971.log 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599949.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599949.log.gz 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607038.log 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701885.log 2024-03-18T22:41:26.288 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168971.log.gz 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.708723.log 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607038.log: /var/log/ceph/ceph-client.admin.701885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701885.log.gz 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607038.log.gz 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552233.log 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.708723.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327012.log 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.708723.log.gz 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219322.log 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327012.log: /var/log/ceph/ceph-client.admin.552233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327012.log.gz 2024-03-18T22:41:26.289 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552233.log.gz 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266405.log 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.219322.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.154060.log 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219322.log.gz 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.266405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621926.log 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266405.log.gz 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559171.log 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42997.log.gz -- replaced with /var/log/ceph/ceph-client.admin.154060.log.gz 2024-03-18T22:41:26.290 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683178.log 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621926.log: /var/log/ceph/ceph-client.admin.559171.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621926.log.gz 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559171.log.gz 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856406.log 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.683178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271408.log 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683178.log.gz 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716984.log 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856406.log: /var/log/ceph/ceph-client.admin.271408.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271408.log.gz 2024-03-18T22:41:26.291 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601863.log 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253407.log 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.601863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601863.log.gz 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716984.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.856406.log.gz 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149319.log 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716984.log.gz 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253407.log.gz 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224137.log 2024-03-18T22:41:26.292 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44732.log 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149319.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242175.log 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149319.log.gz 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44732.log: /var/log/ceph/ceph-client.admin.224137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579259.log 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224137.log.gz 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242175.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242175.log.gz 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565057.log 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335269.log 2024-03-18T22:41:26.293 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270727.log 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579259.log.gz 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335269.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335269.log.gz 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282953.log 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565057.log.gz 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735246.log 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282953.log.gz 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151950.log 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270727.log.gz 2024-03-18T22:41:26.294 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566465.log 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151950.log.gz 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571927.log 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735246.log.gz 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262532.log 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571927.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571927.log.gz 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.566465.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.44732.log.gz 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630277.log 2024-03-18T22:41:26.295 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566465.log.gz 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141376.log 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630277.log.gz 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262532.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321077.log 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262532.log.gz 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.141376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141376.log.gz 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287519.log 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619815.log 2024-03-18T22:41:26.296 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287519.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287519.log.gz 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321077.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321077.log.gz 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243133.log 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248858.log 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243133.log.gz 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.619815.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.620852.log 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619815.log.gz 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408436.log 2024-03-18T22:41:26.297 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620852.log.gz 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.248858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409740.log 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248858.log.gz 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846065.log 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.409740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409740.log.gz 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.408436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195411.log 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408436.log.gz 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332581.log 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195411.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195411.log.gz 2024-03-18T22:41:26.298 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841988.log 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846065.log.gz 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235768.log 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841988.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841988.log.gz 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.414034.log 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332581.log.gz 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739598.log 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.414034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.414034.log.gz 2024-03-18T22:41:26.299 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289005.log 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235768.log.gz 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346043.log 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289005.log.gz 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127051.log 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739598.log.gz 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703803.log 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127051.log.gz 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.346043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317245.log 2024-03-18T22:41:26.300 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346043.log.gz 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714823.log 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317245.log.gz 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703803.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.725960.log 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703803.log.gz 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129578.log 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.725960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.725960.log.gz 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130229.log 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714823.log.gz 2024-03-18T22:41:26.301 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217478.log 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130229.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130229.log.gz 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174896.log 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129578.log.gz 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412625.log 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174896.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174896.log.gz 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307811.log 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217478.log.gz 2024-03-18T22:41:26.302 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412625.log.gz 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258397.log 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216077.log 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.258397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258397.log.gz 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307811.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47916.log 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307811.log.gz 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843720.log 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47916.log: /var/log/ceph/ceph-client.admin.216077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718901.log 2024-03-18T22:41:26.303 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216077.log.gz 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584589.log 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718901.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718901.log.gz 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.843720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413097.log 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843720.log.gz 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47343.log 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413097.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413097.log.gz 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584589.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584589.log.gzgzip 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.703318.log 2024-03-18T22:41:26.304 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221621.log 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703318.log.gz 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629724.log 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164025.log 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221621.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221621.log.gz 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.164025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.164025.log.gz 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.629724.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49230.log 2024-03-18T22:41:26.305 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629724.log.gz 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384525.log 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49230.log: /var/log/ceph/ceph-osd.3.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.47916.log.gz 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331210.log 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384525.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616866.log 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.47343.log.gz 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384525.log.gz 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331210.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723504.log 2024-03-18T22:41:26.306 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331210.log.gz 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302835.log 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.616866.log: /var/log/ceph/ceph-client.admin.723504.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723504.log.gz 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616866.log.gz 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155857.log 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272146.log 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302835.log.gz 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259375.log 2024-03-18T22:41:26.307 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155857.log: /var/log/ceph/ceph-client.admin.272146.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272146.log.gz 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155857.log.gz 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700112.log 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145177.log 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259375.log.gz 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856721.log 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700112.log: /var/log/ceph/ceph-client.admin.145177.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145177.log.gz 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700112.log.gz 2024-03-18T22:41:26.308 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234620.log 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122712.log 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856721.log: /var/log/ceph/ceph-client.admin.234620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234620.log.gz 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628407.log 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.856721.log.gz 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606822.log 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628407.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628407.log.gz 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122712.log.gz 2024-03-18T22:41:26.309 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305518.log 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576955.log 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.606822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335282.log 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606822.log.gz 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576955.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576955.log.gz 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633166.log 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305518.log.gz 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223654.log 2024-03-18T22:41:26.310 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633166.log.gz 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335282.log.gz 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.49230.log.gz 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291045.log 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.396313.log 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291045.log.gz 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223654.log.gz 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340719.log 2024-03-18T22:41:26.311 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584658.log 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340719.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340719.log.gz 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.396313.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.396313.log.gz 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724973.log 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50478.log 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724973.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724973.log.gz 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584658.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584658.log.gz 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607771.log 2024-03-18T22:41:26.312 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319595.log 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607771.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607771.log.gz 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320598.log 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.319595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319595.log.gz 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199167.log 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193498.log 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320598.log: /var/log/ceph/ceph-client.admin.199167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236334.log 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320598.log.gz 2024-03-18T22:41:26.313 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193498.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193498.log.gz -- replaced with /var/log/ceph/ceph-client.admin.199167.log.gz 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126212.log 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236334.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236334.log.gz 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625498.log 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857498.log 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625498.log.gz 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177488.log 2024-03-18T22:41:26.314 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126212.log.gz 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857498.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175953.log 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.857498.log.gz 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177488.log.gz 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216986.log 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.50478.log.gz 2024-03-18T22:41:26.315 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175953.log.gz 2024-03-18T22:41:26.445 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850139.log 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216986.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613361.log 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216986.log.gz 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609536.log 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.850139.log: /var/log/ceph/ceph-client.admin.613361.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613361.log.gz 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.850139.log.gz 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122178.log 2024-03-18T22:41:26.446 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160230.log 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122178.log.gz 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609536.log.gz 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394601.log 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152678.log 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394601.log: /var/log/ceph/ceph-client.admin.160230.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394601.log.gz 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160230.log.gz 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260185.log 2024-03-18T22:41:26.447 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.152678.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.282679.log 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152678.log.gz 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284852.log 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260185.log: /var/log/ceph/ceph-client.admin.282679.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282679.log.gz 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260185.log.gz 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.704184.log 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207481.log 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.704184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.704184.log.gz 2024-03-18T22:41:26.448 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284852.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284852.log.gz 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.606345.log 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303416.log 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.606345.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.606345.log.gz 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207481.log.gz 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333536.log 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590266.log 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333536.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333536.log.gz 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303416.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303416.log.gz 2024-03-18T22:41:26.449 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584425.log 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699488.log 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590266.log: /var/log/ceph/ceph-client.admin.584425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584425.log.gz 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590266.log.gz 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320995.log 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619746.log 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320995.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320995.log.gz 2024-03-18T22:41:26.450 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699488.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699488.log.gz 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343978.log 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271137.log 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619746.log: /var/log/ceph/ceph-client.admin.343978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343978.log.gz 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619746.log.gz 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607025.log 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.252592.log 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271137.log: /var/log/ceph/ceph-client.admin.607025.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607025.log.gz 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271137.log.gz 2024-03-18T22:41:26.451 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197685.log 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278693.log 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.252592.log: /var/log/ceph/ceph-client.admin.197685.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197685.log.gz 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.252592.log.gz 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222500.log 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.345391.log 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.278693.log: /var/log/ceph/ceph-client.admin.222500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222500.log.gz 2024-03-18T22:41:26.452 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278693.log.gz 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273525.log 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726044.log 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.345391.log: /var/log/ceph/ceph-client.admin.273525.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273525.log.gz 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.345391.log.gz 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680330.log 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143800.log 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726044.log: gzip/var/log/ceph/ceph-client.admin.680330.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.707989.log 2024-03-18T22:41:26.453 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726044.log.gz 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143800.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143800.log.gz 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680330.log.gz 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858002.log 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350993.log 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.707989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.707989.log.gz 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44653.log 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.858002.log.gz 2024-03-18T22:41:26.454 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282940.log 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350993.log.gz 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207122.log 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282940.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282940.log.gz 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109829.log 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682510.log 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109829.log: /var/log/ceph/ceph-client.admin.207122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109829.log.gz 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207122.log.gz 2024-03-18T22:41:26.455 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610603.log 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266418.log 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610603.log.gz 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682510.log.gz 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737853.log 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146567.log 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.266418.log: /var/log/ceph/ceph-client.admin.737853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737853.log.gz 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266418.log.gz 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723012.log 2024-03-18T22:41:26.456 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288718.log 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146567.log.gz 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411630.log 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723012.log: /var/log/ceph/ceph-client.admin.288718.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288718.log.gz 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723012.log.gz 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315612.log 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700327.log 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411630.log.gz 2024-03-18T22:41:26.457 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226066.log 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315612.log: /var/log/ceph/ceph-client.admin.700327.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.44653.log.gz 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700327.log.gz 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315612.log.gz 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590711.log 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410930.log 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226066.log.gz 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715591.log 2024-03-18T22:41:26.458 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590711.log: /var/log/ceph/ceph-client.admin.410930.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246945.log 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590711.log.gz 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410930.log.gz 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715591.log.gz 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587413.log 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701967.log 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587413.log.gz 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246945.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246945.log.gz 2024-03-18T22:41:26.459 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853897.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701967.log.gz 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43389.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218848.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853897.log: /var/log/ceph/ceph-client.admin.43389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853897.log.gz 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346728.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.218848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573371.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218848.log.gz 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853434.log 2024-03-18T22:41:26.460 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573371.log: /var/log/ceph/ceph-client.admin.346728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573371.log.gz 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346728.log.gz 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267952.log 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129964.log 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267952.log: /var/log/ceph/ceph-client.admin.853434.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267952.log.gz 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853434.log.gz 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325781.log 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243120.log 2024-03-18T22:41:26.461 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129964.log.gz 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413952.log 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243120.log: 0.0%/var/log/ceph/ceph-client.admin.325781.log: -- replaced with /var/log/ceph/ceph-client.admin.243120.log.gz 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.43389.log.gz 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325781.log.gz 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320790.log 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413952.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223462.log 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413952.log.gz 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143542.log 2024-03-18T22:41:26.462 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320790.log.gz 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223462.log.gz 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601421.log 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50646.log 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.601421.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601421.log.gz 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143542.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143542.log.gz 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240943.log 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628867.log 2024-03-18T22:41:26.463 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240943.log.gz 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50646.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241135.log 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159084.log 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241135.log.gz 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628867.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628867.log.gz 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225574.log 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159084.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159084.log.gz 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599744.log 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350009.log 2024-03-18T22:41:26.464 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599744.log: /var/log/ceph/ceph-client.admin.225574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599744.log.gz 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225574.log.gz 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342378.log 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620107.log 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350009.log: /var/log/ceph/ceph-client.admin.342378.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342378.log.gz 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350009.log.gz 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842444.log 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334828.log 2024-03-18T22:41:26.465 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620107.log: /var/log/ceph/ceph-client.admin.842444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842444.log.gz 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620107.log.gz 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.611256.log 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334828.log.gz 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555911.log 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587802.log 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.611256.log: /var/log/ceph/ceph-client.admin.555911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555911.log.gz 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116450.log 2024-03-18T22:41:26.466 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.611256.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587802.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587802.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.50646.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703509.log 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116450.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116450.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276880.log 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44113.log 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703509.log: /var/log/ceph/ceph-client.admin.276880.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276880.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703509.log.gz 2024-03-18T22:41:26.467 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343265.log 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44113.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727363.log 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277364.log 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343265.log: /var/log/ceph/ceph-client.admin.727363.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727363.log.gz 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343265.log.gz 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145378.log 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.277364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277364.log.gz 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299806.log 2024-03-18T22:41:26.468 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146554.log 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145378.log: /var/log/ceph/ceph-client.admin.299806.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299806.log.gz 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145378.log.gz 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150238.log 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161082.log 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146554.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.146554.log.gz /var/log/ceph/ceph-client.admin.615100.log 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.150238.log: /var/log/ceph/ceph-client.admin.161082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723696.log 2024-03-18T22:41:26.469 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150238.log.gz 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615100.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161082.log.gz -- replaced with /var/log/ceph/ceph-client.admin.615100.log.gz 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44113.log.gz 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731328.log 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723696.log.gz 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360139.log 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248305.log 2024-03-18T22:41:26.470 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.731328.log: /var/log/ceph/ceph-client.admin.360139.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360139.log.gz 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731328.log.gz 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156314.log 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.248305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844257.log 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248305.log.gz 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313764.log 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156314.log: /var/log/ceph/ceph-client.admin.844257.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844257.log.gz 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156314.log.gz 2024-03-18T22:41:26.471 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567353.log 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281424.log 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313764.log.gz 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271680.log 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567353.log: /var/log/ceph/ceph-client.admin.281424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281424.log.gz 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567353.log.gz 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616797.log 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123952.log 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271680.log.gz 2024-03-18T22:41:26.472 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45592.log 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123952.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123952.log.gz/var/log/ceph/ceph-client.admin.616797.log: 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616797.log.gz 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718683.log 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724204.log 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45592.log: /var/log/ceph/ceph-client.admin.718683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718683.log.gz 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589095.log 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724204.log.gz 2024-03-18T22:41:26.473 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280291.log 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287728.log 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280291.log: /var/log/ceph/ceph-client.admin.589095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280291.log.gz 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.267238.log -- replaced with /var/log/ceph/ceph-client.admin.589095.log.gz 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287728.log.gz 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584613.log 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267238.log.gz 2024-03-18T22:41:26.474 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45592.log.gz 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624645.log 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584613.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584613.log.gz 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268431.log 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286287.log 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.624645.log: /var/log/ceph/ceph-client.admin.268431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268431.log.gz 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624645.log.gz 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125287.log 2024-03-18T22:41:26.475 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286287.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286287.log.gz 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852445.log 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598501.log 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.125287.log: /var/log/ceph/ceph-client.admin.852445.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852445.log.gz 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125287.log.gz 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232996.log 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718422.log 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232996.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232996.log.gz 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598501.log.gz 2024-03-18T22:41:26.476 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201078.log 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175264.log 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718422.log: /var/log/ceph/ceph-client.admin.201078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201078.log.gz 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718422.log.gz 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330145.log 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618246.log 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330145.log: /var/log/ceph/ceph-client.admin.175264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330145.log.gz 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175264.log.gz 2024-03-18T22:41:26.477 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353931.log 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50604.log 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353931.log.gz 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618246.log.gz 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.350282.log 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586861.log 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.350282.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.350282.log.gz 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554122.log 2024-03-18T22:41:26.478 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.558967.log 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.554122.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554122.log.gz 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.586861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586861.log.gz 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617817.log 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.558967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.558967.log.gz 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716778.log 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697023.log 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.617817.log: /var/log/ceph/ceph-client.admin.716778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716778.log.gz 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617817.log.gz 2024-03-18T22:41:26.479 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260672.log 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697023.log.gz 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343069.log 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226053.log 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260672.log: /var/log/ceph/ceph-client.admin.343069.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343069.log.gz 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260672.log.gz 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857101.log 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226053.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226053.log.gz 2024-03-18T22:41:26.480 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129106.log 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602623.log 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857101.log: /var/log/ceph/ceph-client.admin.129106.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129106.log.gz 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571565.log 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602623.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602623.log.gz 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359358.log 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.857101.log.gz 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571565.log.gz 2024-03-18T22:41:26.481 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.408936.log 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.243562.log 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359358.log: /var/log/ceph/ceph-client.admin.408936.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.408936.log.gz 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359358.log.gz 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586346.log 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617298.log 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.586346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586346.log.gz 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.243562.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.243562.log.gz 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.622736.log 2024-03-18T22:41:26.482 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.617298.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.50604.log.gz 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617298.log.gz 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.679972.log 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841431.log 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.679972.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.679972.log.gz 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622736.log.gz 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857540.log 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.702857.log 2024-03-18T22:41:26.483 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841431.log.gz 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348109.log 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.702857.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.702857.log.gz/var/log/ceph/ceph-client.admin.857540.log: 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72169.log 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.857540.log.gz -5 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr: --verbose -- /var/log/ceph/ceph-client.admin.316056.log 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348109.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279820.log 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44775.log 2024-03-18T22:41:26.484 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113292.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281493.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700600.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310491.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235850.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234880.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697036.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712074.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254856.log 2024-03-18T22:41:26.485 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304998.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384061.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234141.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721985.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228216.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145837.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147025.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234811.log 2024-03-18T22:41:26.486 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.335705.log 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205332.log 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.72169.log: -- replaced with /var/log/ceph/ceph-client.admin.348109.log.gz 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282195.log 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700600.log: /var/log/ceph/ceph-client.admin.254856.log: /var/log/ceph/ceph-client.admin.697036.log: /var/log/ceph/ceph-client.admin.712074.log: 0.0% 0.0%/var/log/ceph/ceph-client.admin.721985.log: -- replaced with /var/log/ceph/ceph-client.admin.712074.log.gz -- replaced with /var/log/ceph/ceph-client.admin.697036.log.gz 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700600.log.gz 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304998.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254856.log.gz/var/log/ceph/ceph-client.admin.147025.log: 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316056.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304998.log.gz -- replaced with /var/log/ceph/ceph-client.admin.147025.log.gz 2024-03-18T22:41:26.487 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721985.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279820.log: /var/log/ceph/ceph-client.admin.281493.log: /var/log/ceph/ceph-client.admin.234811.log: 0.0% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281493.log.gz -- replaced with /var/log/ceph/ceph-client.admin.279820.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316056.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113292.log: /var/log/ceph/ceph-client.admin.384061.log: /var/log/ceph/ceph-client.admin.44775.log: /var/log/ceph/ceph-client.admin.145837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234811.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384061.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145837.log.gz 2024-03-18T22:41:26.488 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113292.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310491.log: /var/log/ceph/ceph-client.admin.234141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310491.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234141.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716285.log 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234880.log: /var/log/ceph/ceph-client.admin.235850.log: /var/log/ceph/ceph-client.admin.228216.log: /var/log/ceph/ceph-client.admin.205332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234880.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235850.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228216.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.335705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205332.log.gz 2024-03-18T22:41:26.489 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618962.log 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.335705.log.gz 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282195.log.gz 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37670.log 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618962.log: /var/log/ceph/ceph-client.admin.716285.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618962.log.gz 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716285.log.gz 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149062.log 2024-03-18T22:41:26.490 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43855.log: /var/log/ceph/ceph-client.admin.37670.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311162.log 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310204.log 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599072.log 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149062.log.gz 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310204.log.gz 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110972.log 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311162.log.gz 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599072.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599072.log.gz 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197116.log 2024-03-18T22:41:26.491 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292739.log 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110972.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263060.log 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110972.log.gz 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292739.log.gz 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.197116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239523.log 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197116.log.gz 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700985.log 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239523.log.gz 2024-03-18T22:41:26.492 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.263060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257075.log 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263060.log.gz 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572448.log 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114768.log 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700985.log.gz 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.572448.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572448.log.gz 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257075.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257075.log.gz 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282392.log 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259293.log 2024-03-18T22:41:26.493 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413015.log 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114768.log.gz 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259293.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259293.log.gz 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348178.log 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282392.log.gz 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384594.log 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348178.log: 0.0% 87.9% -- replaced with /var/log/ceph/ceph-client.admin.348178.log.gz 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.72169.log.gz 2024-03-18T22:41:26.494 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239784.log 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413015.log.gz 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44775.log.gz 89.3% 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.384594.log: /var/log/ceph/ceph-client.admin.231135.log 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384594.log.gz 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250282.log 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239784.log.gz 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142197.log 2024-03-18T22:41:26.495 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231135.log.gz 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590454.log 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250282.log.gz 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143165.log 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.142197.log: /var/log/ceph/ceph-client.admin.590454.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590454.log.gz 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142197.log.gz 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322771.log 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.143165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152691.log 2024-03-18T22:41:26.496 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.143165.log.gz 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357219.log 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322771.log: /var/log/ceph/ceph-client.admin.152691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152691.log.gz 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322771.log.gz 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.205248.log 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44450.log 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.205248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.205248.log.gz 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357219.log.gz 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587426.log 2024-03-18T22:41:26.497 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.44450.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.219783.log 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292191.log 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219783.log: /var/log/ceph/ceph-client.admin.587426.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219783.log.gz 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587426.log.gz 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358863.log 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384265.log 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292191.log.gz 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317515.log 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358863.log.gz 2024-03-18T22:41:26.498 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576667.log 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384265.log: /var/log/ceph/ceph-client.admin.317515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317515.log.gz 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384265.log.gz 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154073.log 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44450.log.gz 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160161.log 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.154073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154073.log.gz 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244041.log 2024-03-18T22:41:26.499 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576667.log.gz 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.160161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160161.log.gz 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195342.log 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600907.log 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195342.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195342.log.gz 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244041.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244041.log.gz 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395350.log 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600907.log.gz 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608576.log 2024-03-18T22:41:26.500 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37305.log 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.608576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608576.log.gz 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395350.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395350.log.gz 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410728.log 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210394.log 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633794.log 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410728.log.gz 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194966.log 2024-03-18T22:41:26.501 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633794.log: /var/log/ceph/ceph-client.admin.210394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633794.log.gz 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210394.log.gz 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316791.log 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250295.log 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316791.log.gz 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701535.log 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194966.log.gz 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684155.log 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701535.log.gz 2024-03-18T22:41:26.502 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250295.log.gz 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.37305.log.gz 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720133.log 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.684155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684155.log.gz 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265943.log 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351006.log 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720133.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720133.log.gz 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553203.log 2024-03-18T22:41:26.503 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351006.log: /var/log/ceph/ceph-client.admin.265943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351006.log.gz 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265943.log.gz 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352377.log 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713437.log 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352377.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352377.log.gz 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553203.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553203.log.gz 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585250.log 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173191.log 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585250.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585250.log.gz 2024-03-18T22:41:26.504 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.713437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713437.log.gz 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610616.log 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173191.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699928.log 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173191.log.gz 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324477.log 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610616.log: /var/log/ceph/ceph-client.admin.699928.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699928.log.gz 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610616.log.gz 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629289.log 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324477.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333019.log 2024-03-18T22:41:26.505 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324477.log.gz 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.273812.log 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.629289.log: /var/log/ceph/ceph-client.admin.333019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236055.log 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629289.log.gz 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.273812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.273812.log.gz 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333019.log.gz 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193580.log 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236055.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236055.log.gz 2024-03-18T22:41:26.506 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.604003.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353218.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.604003.log: /var/log/ceph/ceph-client.admin.193580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.604003.log.gz 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193580.log.gz 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47637.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160598.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353218.log.gz 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230220.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47637.log: /var/log/ceph/ceph-client.admin.160598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291811.log 2024-03-18T22:41:26.507 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230220.log.gz 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.160598.log.gz 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144529.log 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260742.log 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144529.log: /var/log/ceph/ceph-client.admin.291811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144529.log.gz 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291811.log.gz 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210015.log 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322294.log 2024-03-18T22:41:26.508 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210015.log.gz 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260742.log.gz 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351383.log 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.582158.log 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322294.log: /var/log/ceph/ceph-client.admin.351383.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351383.log.gz 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322294.log.gz 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.413562.log 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717738.log 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.413562.log: /var/log/ceph/ceph-client.admin.582158.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.413562.log.gz 2024-03-18T22:41:26.509 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.582158.log.gz 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255335.log 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153991.log 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255335.log: /var/log/ceph/ceph-client.admin.717738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255335.log.gz 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717738.log.gz 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222979.log 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.383979.log 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222979.log.gz 2024-03-18T22:41:26.510 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.153991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285124.log 0.0% 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.153991.log.gz 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44731.log 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285124.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285124.log.gz 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.383979.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.383979.log.gz 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281227.log 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608646.log 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281227.log.gz 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47637.log.gz 2024-03-18T22:41:26.511 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717725.log 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.608646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608646.log.gz 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144083.log 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174688.log 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144083.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144083.log.gz 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717725.log.gz 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628583.log 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174688.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174688.log.gz 2024-03-18T22:41:26.512 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634540.log 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726030.log 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634540.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634540.log.gz 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628583.log.gz 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.705935.log 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726030.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726030.log.gz 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270302.log 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.705935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282474.log 2024-03-18T22:41:26.513 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.705935.log.gz 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569666.log 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270302.log: /var/log/ceph/ceph-client.admin.282474.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282474.log.gz 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270302.log.gz 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309049.log 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.569666.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734314.log 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569666.log.gz 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309049.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600428.log 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309049.log.gz 2024-03-18T22:41:26.514 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176790.log 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734314.log.gz 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44731.log.gz 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600223.log 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600428.log.gz 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555509.log 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600223.log: /var/log/ceph/ceph-client.admin.176790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600223.log.gz 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176790.log.gz 2024-03-18T22:41:26.515 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730853.log 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.555509.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565933.log 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555509.log.gz 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633536.log 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.730853.log: /var/log/ceph/ceph-client.admin.565933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565933.log.gz 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730853.log.gz 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196724.log 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739397.log 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633536.log.gz 2024-03-18T22:41:26.516 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259739.log 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739397.log.gz 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196724.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196724.log.gz 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201507.log 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714418.log 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201507.log.gz 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259739.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259739.log.gz 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348625.log 2024-03-18T22:41:26.517 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338850.log 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.37670.log.gz 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348625.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348625.log.gz/var/log/ceph/ceph-client.admin.714418.log: 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322020.log 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714418.log.gz 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857708.log 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322020.log: 0.0%/var/log/ceph/ceph-client.admin.338850.log: -- replaced with /var/log/ceph/ceph-client.admin.322020.log.gz 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.338850.log.gz /var/log/ceph/ceph-client.admin.234333.log 2024-03-18T22:41:26.518 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716298.log 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720530.log 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716298.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716298.log.gz 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686611.log 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234333.log.gz 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8%gzip -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.857708.log.gz /var/log/ceph/ceph-client.admin.622363.log 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.519 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686611.log.gz 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349530.log 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720530.log.gz 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169368.log 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349530.log.gz 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.622363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588778.log 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.622363.log.gz 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.717656.log 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.169368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.169368.log.gz 2024-03-18T22:41:26.520 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149524.log 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588778.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588778.log.gz 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739680.log 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.717656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.717656.log.gz 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.850611.log 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149524.log.gz 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340168.log 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739680.log.gz 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302090.log 2024-03-18T22:41:26.521 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.850611.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.850611.log.gz 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225848.log 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340168.log.gz 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159676.log 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302090.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302090.log.gz 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327081.log 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225848.log.gz 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553392.log 2024-03-18T22:41:26.522 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.159676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159676.log.gz 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347743.log 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327081.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327081.log.gz 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322579.log 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842897.log 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.347743.log: 0.0%/var/log/ceph/ceph-client.admin.322579.log: -- replaced with /var/log/ceph/ceph-client.admin.553392.log.gz 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322579.log.gz 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347743.log.gz 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567760.log 2024-03-18T22:41:26.523 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686394.log 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.842897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628325.log 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842897.log.gz 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686394.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686394.log.gz 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567760.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567760.log.gz 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283750.log 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858045.log 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848301.log 2024-03-18T22:41:26.524 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628325.log.gz 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125735.log 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.283750.log: /var/log/ceph/ceph-client.admin.848301.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283750.log.gz 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848301.log.gz 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613043.log 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.125735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.125735.log.gz 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720338.log 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.858045.log.gz 2024-03-18T22:41:26.525 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225108.log 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720338.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720338.log.gz 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206354.log 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590441.log 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613043.log.gz 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206354.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206354.log.gz 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225108.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556881.log 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225108.log.gz 2024-03-18T22:41:26.526 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590441.log.gz 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286766.log 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247409.log 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556881.log.gz 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559415.log 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217465.log 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286766.log.gz 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247409.log.gz 2024-03-18T22:41:26.527 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634553.log 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.559415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559415.log.gz 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412072.log 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217465.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217465.log.gz 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634553.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634553.log.gz 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737353.log 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412072.log.gz 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571286.log 2024-03-18T22:41:26.528 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313471.log 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.737353.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737353.log.gz 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118618.log 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571286.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279602.log 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571286.log.gz 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118618.log.gz 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313471.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353205.log 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313471.log.gz 2024-03-18T22:41:26.529 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310409.log 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279602.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279602.log.gz 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848314.log 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353205.log.gz 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623750.log 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293137.log 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310409.log.gz 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623750.log.gz 2024-03-18T22:41:26.530 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.848314.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.853147.log 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848314.log.gz 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210655.log 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853147.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853147.log.gz 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682990.log 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293137.log.gz 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698544.log 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210655.log.gz 2024-03-18T22:41:26.531 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141736.log 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584567.log 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682990.log.gz 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.141736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141736.log.gz 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.698544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289485.log 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698544.log.gz 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584567.log.gz 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349346.log 2024-03-18T22:41:26.532 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247938.log 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50268.log 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289485.log.gz 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247938.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247938.log.gz 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349346.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349346.log.gz 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228697.log 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289472.log 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228697.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228697.log.gz 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.632698.log 2024-03-18T22:41:26.533 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50268.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564701.log 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48336.log 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289472.log.gz 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564701.log.gz 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.632698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293769.log 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.632698.log.gz 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.50268.log.gz 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127783.log 2024-03-18T22:41:26.534 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293769.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293769.log.gz 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301224.log 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227254.log 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218318.log 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127783.log.gz 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227254.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227254.log.gz 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48336.log.gz 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48378.log 2024-03-18T22:41:26.535 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.301224.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271598.log 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301224.log.gz 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48378.log: /var/log/ceph/ceph-client.admin.218318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218318.log.gz 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110890.log 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155334.log 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.110890.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.110890.log.gz 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610808.log 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271598.log.gz 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.48378.log.gz 2024-03-18T22:41:26.536 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.282182.log 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.155334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223667.log 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.155334.log.gz 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.282182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.282182.log.gz 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.683435.log 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610808.log.gz 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685953.log 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.683435.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.683435.log.gz 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722067.log 2024-03-18T22:41:26.537 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223667.log.gz 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239797.log 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722067.log.gz 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685953.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685953.log.gz 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.634073.log 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732669.log 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239797.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551450.log 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239797.log.gz 2024-03-18T22:41:26.538 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.634073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323257.log 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.634073.log.gz 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.551450.log: 0.0%/var/log/ceph/ceph-client.admin.732669.log: -- replaced with /var/log/ceph/ceph-client.admin.551450.log.gz 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304125.log 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732669.log.gz 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308003.log 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.304125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304125.log.gz 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623023.log 2024-03-18T22:41:26.539 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323257.log.gz 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.219309.log 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623023.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623023.log.gz 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308003.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308003.log.gz 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236539.log 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337943.log 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.219309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347212.log 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.219309.log.gz 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337943.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337943.log.gz 2024-03-18T22:41:26.540 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236539.log: gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.616442.log 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.236539.log.gz 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256192.log 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.616442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616442.log.gz 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.347212.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.347212.log.gz -5 --verbose 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr: -- /var/log/ceph/ceph-client.admin.635193.log 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579341.log 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.256192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.580222.log 2024-03-18T22:41:26.541 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256192.log.gz 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579341.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579341.log.gz 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.635193.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556183.log 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.635193.log.gz 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726485.log 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556183.log: /var/log/ceph/ceph-client.admin.580222.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556183.log.gz 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.580222.log.gz 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307125.log 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.218861.log 2024-03-18T22:41:26.542 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726485.log.gz 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697957.log 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.218861.log: /var/log/ceph/ceph-client.admin.307125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.218861.log.gz 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307125.log.gz 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44733.log 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281990.log 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44733.log: /var/log/ceph/ceph-client.admin.697957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697957.log.gz 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147947.log 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.281990.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.853813.log 2024-03-18T22:41:26.543 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281990.log.gz 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116898.log 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.853813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.853813.log.gz 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.147947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147947.log.gz 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144542.log 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310683.log 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.116898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116898.log.gz 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280583.log 2024-03-18T22:41:26.544 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144542.log.gz 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221168.log 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280583.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280583.log.gz 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310683.log.gz 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609086.log 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590900.log 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221168.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221168.log.gz 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336066.log 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609086.log.gz 2024-03-18T22:41:26.545 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.44733.log.gz 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256993.log 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590900.log.gz 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241217.log 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336066.log.gz 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.256993.log: -- /var/log/ceph/ceph-client.admin.111921.log 2024-03-18T22:41:26.546 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256993.log.gz 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241217.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286561.log 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241217.log.gz 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238839.log 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111921.log.gz 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561098.log 2024-03-18T22:41:26.691 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238839.log: /var/log/ceph/ceph-client.admin.286561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238839.log.gz 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286561.log.gz 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729209.log 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287053.log 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561098.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561098.log.gz 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222966.log 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287053.log: /var/log/ceph/ceph-client.admin.729209.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287053.log.gz 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729209.log.gz 2024-03-18T22:41:26.692 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45550.log 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.222966.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.128224.log 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222966.log.gz 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45550.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277801.log 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193054.log 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.277801.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277801.log.gz 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128224.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128224.log.gz 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230687.log 2024-03-18T22:41:26.693 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630905.log 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193054.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193054.log.gz 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621487.log 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230687.log.gz 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222692.log 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630905.log.gz 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.45550.log.gz 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50310.log 2024-03-18T22:41:26.694 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621487.log: /var/log/ceph/ceph-client.admin.222692.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222692.log.gz 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621487.log.gz 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701452.log 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.237305.log 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701452.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701452.log.gz 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.320516.log 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.237305.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.127033.log 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.237305.log.gz 2024-03-18T22:41:26.695 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360878.log 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127033.log.gz 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.320516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577832.log 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.320516.log.gz 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232983.log 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360878.log: /var/log/ceph/ceph-client.admin.577832.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577832.log.gz 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360878.log.gz 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719380.log 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354795.log 2024-03-18T22:41:26.696 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719380.log.gz 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163822.log 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232983.log.gz 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213759.log 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354795.log: /var/log/ceph/ceph-client.admin.163822.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.163822.log.gz 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354795.log.gz 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215616.log 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213759.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221552.log 2024-03-18T22:41:26.697 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213759.log.gz 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612402.log 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215616.log: /var/log/ceph/ceph-client.admin.221552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221552.log.gz 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215616.log.gz 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.50310.log.gz 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113731.log 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612402.log.gz 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/xfstests-dev-results/results/check.log 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603437.log 2024-03-18T22:41:26.698 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113731.log.gz 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636699.log 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/xfstests-dev-results/results/check.log: /var/log/ceph/ceph-client.admin.603437.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603437.log.gz 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612415.log 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279095.log 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636699.log: /var/log/ceph/ceph-client.admin.612415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612415.log.gz 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636699.log.gz 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232057.log 2024-03-18T22:41:26.699 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279095.log.gz 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr: 90.0% -- replaced with /var/log/ceph/xfstests-dev-results/results/check.log.gz 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281009.log 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232057.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255770.log 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232057.log.gz 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354345.log 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281009.log: /var/log/ceph/ceph-client.admin.255770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255770.log.gz 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281009.log.gz 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242641.log 2024-03-18T22:41:26.700 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159071.log 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354345.log.gz 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.471017.log 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242641.log: /var/log/ceph/ceph-client.admin.159071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159071.log.gz 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242641.log.gz 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46683.log 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129496.log 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.471017.log: /var/log/ceph/ceph-client.admin.46683.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.471017.log.gz 2024-03-18T22:41:26.701 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.46683.log.gz 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.294202.log 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847339.log 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129496.log: /var/log/ceph/ceph-client.admin.294202.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.294202.log.gz 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129496.log.gz 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289403.log 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.847339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847339.log.gz 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47090.log 2024-03-18T22:41:26.702 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206599.log 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289403.log: /var/log/ceph/ceph-client.admin.47090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271885.log 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289403.log.gz 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206599.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206599.log.gz 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45508.log 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271885.log.gz 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231609.log 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721780.log 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45508.log: /var/log/ceph/ceph-client.admin.231609.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231609.log.gz 2024-03-18T22:41:26.703 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338404.log 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387419.log 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721780.log: /var/log/ceph/ceph-client.admin.338404.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338404.log.gz 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721780.log.gz 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274296.log 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387419.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387419.log.gz 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.193123.log 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608659.log 2024-03-18T22:41:26.704 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.193123.log: /var/log/ceph/ceph-client.admin.274296.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.193123.log.gz 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409822.log 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274296.log.gz 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.608659.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608659.log.gz 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342652.log 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.409822.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.583901.log 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409822.log.gz 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290840.log 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342652.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342652.log.gz 2024-03-18T22:41:26.705 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249734.log 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.583901.log: /var/log/ceph/ceph-client.admin.290840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290840.log.gz 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.583901.log.gz 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574678.log 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 88.4% -5 --verbose -- /var/log/ceph/ceph-client.admin.713918.log 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.47090.log.gz 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574678.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574678.log.gz 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249734.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.728750.log 2024-03-18T22:41:26.706 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249734.log.gz 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336614.log 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.728750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.728750.log.gz 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.713918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325794.log 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713918.log.gz 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256627.log 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.325794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.325794.log.gz 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107116.log 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336614.log.gz 2024-03-18T22:41:26.707 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.299888.log 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107116.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107116.log.gz 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.256627.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269170.log 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256627.log.gz 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564197.log 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.299888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.684073.log 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.299888.log.gz 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564197.log.gz 2024-03-18T22:41:26.708 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.269170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719162.log 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269170.log.gz 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49395.log 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719162.log: /var/log/ceph/ceph-client.admin.684073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719162.log.gz 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.221634.log 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.684073.log.gz 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734105.log 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.221634.log: /var/log/ceph/ceph-client.admin.49395.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.221634.log.gz 2024-03-18T22:41:26.709 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124312.log 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732600.log 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.124312.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124312.log.gz 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700916.log 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734105.log.gz 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613786.log 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700916.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700916.log.gz 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.732600.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149511.log 2024-03-18T22:41:26.710 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732600.log.gzgzip 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.307331.log 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.149511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.149511.log.gz 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.613786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852645.log 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.45508.log.gz 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0%/var/log/ceph/ceph-client.admin.307331.log: -- replaced with /var/log/ceph/ceph-client.admin.613786.log.gz 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307331.log.gz 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714628.log 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49395.log.gz 2024-03-18T22:41:26.711 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579054.log 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714628.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714628.log.gz 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.625690.log 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852645.log.gz 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307605.log 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.625690.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.625690.log.gz 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310888.log 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579054.log.gz 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329939.log 2024-03-18T22:41:26.712 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310888.log.gz 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.307318.log 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307605.log.gz 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247478.log 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.307318.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.307318.log.gz 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202368.log 2024-03-18T22:41:26.713 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329939.log.gz 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285055.log 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202368.log.gz 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394888.log 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247478.log.gz 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281214.log 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394888.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.394888.log.gz 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.360865.log 2024-03-18T22:41:26.714 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285055.log.gz 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584765.log 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.360865.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.360865.log.gz 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700125.log 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281214.log.gz 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.302626.log 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700125.log.gz 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.732223.log 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584765.log.gz 2024-03-18T22:41:26.715 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259808.log 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.732223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732223.log.gz 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.302626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196655.log 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.302626.log.gz 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.395268.log 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259808.log.gz 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848684.log 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196655.log.gz 2024-03-18T22:41:26.716 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633153.log 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.395268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.395268.log.gz 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384871.log 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.848684.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848684.log.gz 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.564619.log 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633153.log: /var/log/ceph/ceph-client.admin.384871.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633153.log.gz 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384871.log.gz 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.310012.log 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152019.log 2024-03-18T22:41:26.717 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.564619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734520.log 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.564619.log.gz 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.152019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152019.log.gz 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.310012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.310012.log.gz 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.347283.log 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276614.log 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734520.log.gz 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324846.log 2024-03-18T22:41:26.718 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.347283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253042.log 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.347283.log.gz 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324846.log.gz 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.276614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276614.log.gz 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.854261.log 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309254.log 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.854261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.854261.log.gz 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253042.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253042.log.gz 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.321265.log 2024-03-18T22:41:26.719 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.200535.log 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.321265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.321265.log.gz 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309254.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572461.log 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309254.log.gz 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233393.log 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.572461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572461.log.gz 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.200535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561463.log 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.200535.log.gz 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.739140.log 2024-03-18T22:41:26.720 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233393.log.gz 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235098.log 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124837.log 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561463.log.gz 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.739140.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.739140.log.gz 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235098.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.716490.log 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235098.log.gz 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736461.log 2024-03-18T22:41:26.721 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.124837.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.124837.log.gz 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.213482.log 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.716490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.716490.log.gz 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585061.log 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223380.log 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736461.log.gz 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585061.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585061.log.gz 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213482.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213482.log.gz 2024-03-18T22:41:26.722 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.612110.log 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287752.log 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285329.log 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223380.log.gz 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287752.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287752.log.gz 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568510.log 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.612110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.612110.log.gz 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117794.log 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285329.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285329.log.gz 2024-03-18T22:41:26.723 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735540.log 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568510.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568510.log.gz 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610877.log 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117794.log.gz 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626762.log 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852002.log 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735540.log.gz 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.626762.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626762.log.gz 2024-03-18T22:41:26.724 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610877.log.gz 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.410268.log 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141818.log 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.410268.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.410268.log.gz 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857288.log 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852002.log.gz 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174172.log 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857288.log: /var/log/ceph/ceph-client.admin.141818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126768.log 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.857288.log.gz 2024-03-18T22:41:26.725 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.141818.log.gz 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351182.log 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.217939.log 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174172.log.gz 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351182.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351182.log.gz 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616879.log 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126768.log.gz 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682233.log 2024-03-18T22:41:26.726 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.616879.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616879.log.gz 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.217939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275046.log 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.217939.log.gz 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223184.log 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275046.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275046.log.gz 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.196232.log 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682233.log.gz 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246551.log 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.196232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.196232.log.gz 2024-03-18T22:41:26.727 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.223184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409382.log 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223184.log.gz 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161164.log 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.409382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409382.log.gz 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246551.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357742.log 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246551.log.gz 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715303.log 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357742.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357742.log.gz 2024-03-18T22:41:26.728 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.303702.log 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161164.log.gz 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.303702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.303702.log.gz 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156950.log 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715303.log.gz 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.687073.log 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156950.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156950.log.gz 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194091.log 2024-03-18T22:41:26.729 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246564.log 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.687073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142640.log 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.687073.log.gz 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.246564.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246564.log.gz 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194091.log.gz 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333101.log 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857624.log 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.142640.log: /var/log/ceph/ceph-client.admin.333101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333101.log.gz 2024-03-18T22:41:26.730 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142640.log.gz 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713836.log 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.328813.log 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50900.log 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.328813.log: 0.0%/var/log/ceph/ceph-client.admin.713836.log: -- replaced with /var/log/ceph/ceph-client.admin.328813.log.gz 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713836.log.gz 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565561.log 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.857624.log.gz 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173641.log 2024-03-18T22:41:26.731 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.0.50900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269101.log 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565561.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.50900.log.gz 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588323.log 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565561.log.gz 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.269101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269101.log.gz 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173641.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855379.log 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173641.log.gz 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126388.log 2024-03-18T22:41:26.732 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855379.log.gz 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571552.log 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588323.log.gz 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.126388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126388.log.gz 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584469.log 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.285137.log 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571552.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43939.log 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571552.log.gz 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.285137.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.285137.log.gz 2024-03-18T22:41:26.733 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584469.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323532.log 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584469.log.gz 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618616.log 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323532.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323532.log.gz 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411712.log 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337510.log 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618616.log.gz 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721283.log 2024-03-18T22:41:26.734 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411712.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411712.log.gz 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846435.log 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337510.log.gz 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857582.log 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721283.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721283.log.gz 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.315172.log 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846435.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.43939.log.gz 2024-03-18T22:41:26.735 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846435.log.gz 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576680.log 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.207953.log 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576680.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.857582.log.gz 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576680.log.gz 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.315172.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.315172.log.gz 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151577.log 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.207953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309241.log 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.207953.log.gz 2024-03-18T22:41:26.736 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.226516.log 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151577.log: /var/log/ceph/ceph-client.admin.309241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309241.log.gz 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151577.log.gz 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234607.log 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.586415.log 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234607.log.gz 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.226516.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.226516.log.gz 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284184.log 2024-03-18T22:41:26.737 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261716.log 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284184.log: /var/log/ceph/ceph-client.admin.586415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284184.log.gz 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.586415.log.gz 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242654.log 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.240738.log 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.261716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331223.log 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261716.log.gz 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.240738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.240738.log.gz 2024-03-18T22:41:26.738 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242654.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242654.log.gz 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146837.log 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737271.log 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331223.log.gz 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.146837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600510.log 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.146837.log.gz 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.737271.log: -- /var/log/ceph/ceph-client.admin.213211.log 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737271.log.gz 2024-03-18T22:41:26.739 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.555440.log 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600510.log.gz 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.277295.log 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.213211.log: /var/log/ceph/ceph-client.admin.555440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.555440.log.gz 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.213211.log.gz 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386413.log 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191812.log 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386413.log.gz 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.277295.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.277295.log.gz 2024-03-18T22:41:26.740 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257510.log 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349063.log 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257510.log: /var/log/ceph/ceph-client.admin.191812.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257510.log.gz 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191812.log.gz 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291524.log 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.608205.log 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349063.log.gz 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295129.log 2024-03-18T22:41:26.741 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.608205.log: /var/log/ceph/ceph-client.admin.291524.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.608205.log.gz 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291524.log.gz 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584183.log 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44109.log 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295129.log.gz 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589304.log 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584183.log: /var/log/ceph/ceph-client.admin.44109.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584183.log.gz 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.239236.log 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589304.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589304.log.gz 2024-03-18T22:41:26.742 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573101.log 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858339.log 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573101.log.gz 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.239236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.239236.log.gz 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412638.log 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.551246.log 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44109.log.gz 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412638.log: gzip -5 --verbose 87.8% -- /var/log/ceph/ceph-client.admin.279807.log -- replaced with /var/log/ceph/ceph-client.admin.858339.log.gz 2024-03-18T22:41:26.743 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412638.log.gz 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241422.log 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.551246.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43519.log 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.551246.log.gz 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241422.log.gz 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279807.log.gz 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284389.log 2024-03-18T22:41:26.744 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730784.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284389.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284389.log.gz 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857792.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50138.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857792.log: /var/log/ceph/ceph-client.admin.730784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603990.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.857792.log.gz 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730784.log.gz 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598990.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348817.log 2024-03-18T22:41:26.745 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603990.log.gz 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353492.log 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348817.log: /var/log/ceph/ceph-client.admin.598990.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348817.log.gz 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598990.log.gz 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48792.log 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713642.log 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353492.log.gz 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.301725.log 2024-03-18T22:41:26.746 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308967.log/var/log/ceph/ceph-client.admin.713642.log: 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713642.log.gz 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.301725.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.618177.log 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.301725.log.gz 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722943.log 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.43519.log.gz 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308967.log.gz 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553216.log 2024-03-18T22:41:26.747 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618177.log.gz 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227543.log 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722943.log.gz 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588709.log 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553216.log.gz 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227543.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.223863.log 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227543.log.gz 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600018.log 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588709.log: /var/log/ceph/ceph-client.admin.223863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.223863.log.gz 2024-03-18T22:41:26.748 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588709.log.gz 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.359862.log 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278680.log 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600018.log.gz 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271395.log 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.359862.log: /var/log/ceph/ceph-client.admin.278680.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278680.log.gz 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.359862.log.gz 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.858087.log 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220231.log 2024-03-18T22:41:26.749 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271395.log.gz 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844709.log 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.858087.log: /var/log/ceph/ceph-client.admin.220231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220231.log.gz 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311367.log 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50138.log.gz 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.858087.log.gz 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211828.log 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.844709.log: /var/log/ceph/ceph-client.admin.311367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311367.log.gz 2024-03-18T22:41:26.750 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844709.log.gz 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584492.log 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211828.log.gz 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.48792.log.gz 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352459.log 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280017.log 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584492.log.gz 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177406.log 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352459.log: /var/log/ceph/ceph-client.admin.280017.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280017.log.gz 2024-03-18T22:41:26.751 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352459.log.gz 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152405.log 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.177406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.844696.log 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177406.log.gz 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151495.log 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.152405.log: /var/log/ceph/ceph-client.admin.844696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.844696.log.gz 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.152405.log.gz 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842815.log 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.304629.log 2024-03-18T22:41:26.752 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151495.log.gz 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.212819.log 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.842815.log: /var/log/ceph/ceph-client.admin.304629.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.304629.log.gz 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842815.log.gz 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.202958.log 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.212819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254774.log 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.212819.log.gz 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851559.log 2024-03-18T22:41:26.753 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254774.log.gz 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.202958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387337.log 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.202958.log.gz 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.626128.log 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260961.log 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387337.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851559.log.gz 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.626128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.626128.log.gz 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387337.log.gz 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412154.log 2024-03-18T22:41:26.754 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260961.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260961.log.gz 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.245591.log 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199628.log 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.245591.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.245591.log.gz 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412154.log.gz 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849588.log 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109898.log 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.849588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849588.log.gz 2024-03-18T22:41:26.755 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199628.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336353.log 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199628.log.gz 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.109898.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.109898.log.gz 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.211436.log 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220693.log 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.211436.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.211436.log.gz 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336353.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598089.log 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336353.log.gz 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.322566.log 2024-03-18T22:41:26.756 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598089.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598089.log.gz 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.220693.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220693.log.gz 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.571273.log 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.322566.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242859.log 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.322566.log.gz 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735042.log 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.571273.log: /var/log/ceph/ceph-client.admin.242859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242859.log.gz 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571273.log.gz 2024-03-18T22:41:26.757 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128142.log 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.842884.log 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735042.log.gz 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.128142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.715110.log 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.128142.log.gz 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.842884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343278.log 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.842884.log.gz 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168424.log 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.343278.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343278.log.gz 2024-03-18T22:41:26.758 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.715110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.715110.log.gz 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600715.log 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116885.log 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600715.log: /var/log/ceph/ceph-client.admin.168424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600715.log.gz 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168424.log.gz 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49128.log 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.116885.log: -- /var/log/ceph/ceph-client.admin.227735.log 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.116885.log.gz 2024-03-18T22:41:26.759 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47595.log 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227735.log: /var/log/ceph/ceph-client.admin.49128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227735.log.gz 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412813.log 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148135.log 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47595.log: /var/log/ceph/ceph-client.admin.412813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584114.log 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412813.log.gz 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228779.log 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584114.log.gz 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148135.log.gz 2024-03-18T22:41:26.760 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46996.log 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117725.log 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228779.log.gz 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615923.log 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117725.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117725.log.gz 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46996.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.250213.log 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615923.log: /var/log/ceph/ceph.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615923.log.gz 2024-03-18T22:41:26.761 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.348191.log 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49128.log.gz 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736448.log 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.250213.log: gzip 0.0% -- replaced with /var/log/ceph/ceph-client.admin.250213.log.gz 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.573114.log 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.736448.log: -- replaced with /var/log/ceph/ceph-client.admin.47595.log.gz 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736448.log.gz 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.348191.log: 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.348191.log.gz 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.631933.log 2024-03-18T22:41:26.762 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46996.log.gz 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609960.log 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573114.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573114.log.gz 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44444.log 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.631933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.631933.log.gz 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.576461.log 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609960.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609960.log.gz 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44444.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216456.log 2024-03-18T22:41:26.763 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242093.log 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44444.log.gz 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.576461.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.576461.log.gz 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.201903.log 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216456.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216456.log.gz 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598791.log 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242093.log.gz 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.621913.log 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.201903.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.201903.log.gz 2024-03-18T22:41:26.764 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629220.log 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598791.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598791.log.gz 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228011.log 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.621913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.621913.log.gz 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.629220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144001.log 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629220.log.gz 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283668.log 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228011.log.gz 2024-03-18T22:41:26.765 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168046.log 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144001.log.gz 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.283668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331141.log 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283668.log.gz 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313957.log 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168046.log.gz 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627770.log 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331141.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331141.log.gz 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341468.log 2024-03-18T22:41:26.766 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313957.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313957.log.gz 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.627770.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311449.log 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627770.log.gz 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288047.log 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.341468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341468.log.gz 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.386885.log 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311449.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311449.log.gz 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.288047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697686.log 2024-03-18T22:41:26.767 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288047.log.gz 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43040.log 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.386885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568034.log 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.386885.log.gz 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697686.log.gz 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168902.log 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288992.log 2024-03-18T22:41:26.768 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568034.log.gz 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168902.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113800.log 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168902.log.gz 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206668.log 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.288992.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288992.log.gz 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.113800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.234128.log 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.113800.log.gz 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619541.log 2024-03-18T22:41:26.769 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206668.log.gz 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122725.log 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.234128.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.234128.log.gz 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619541.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.215073.log 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619541.log.gz 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.122725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.258814.log 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.122725.log.gz 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.215073.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.215073.log.gz 2024-03-18T22:41:26.770 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.734036.log 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.258814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175708.log 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.258814.log.gz 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.734036.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.734036.log.gz 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.242162.log 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111335.log 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175708.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175708.log.gz 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.43040.log.gz 2024-03-18T22:41:26.771 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.242162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248387.log 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.242162.log.gz 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.111335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353862.log 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.111335.log.gz 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.248387.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248387.log.gz 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.353862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.733844.log 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353862.log.gz 2024-03-18T22:41:26.772 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.280099.log 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.733844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846052.log 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.733844.log.gz 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.280099.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356280.log 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.280099.log.gz 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846052.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577160.log 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846052.log.gz 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.356280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.283737.log 2024-03-18T22:41:26.773 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356280.log.gz 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619554.log 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577160.log.gz 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.256640.log 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.283737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.283737.log.gz 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619554.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699406.log 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619554.log.gz 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.256640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45634.log 2024-03-18T22:41:26.774 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256640.log.gz 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.680412.log 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699406.log.gz 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147934.log 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127770.log 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.680412.log: /var/log/ceph/ceph-client.admin.147934.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.147934.log.gz 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.680412.log.gz 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46785.log 2024-03-18T22:41:26.775 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127770.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127770.log.gz 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281711.log 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.45634.log.gz 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.46785.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47385.log 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281711.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281711.log.gz 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275978.log 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172238.log 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47385.log: /var/log/ceph/ceph-client.admin.275978.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275978.log.gz 2024-03-18T22:41:26.776 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.206681.log 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47679.log 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.206681.log: /var/log/ceph/ceph-client.admin.172238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.206681.log.gz 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.46785.log.gz 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- 0.0% /var/log/ceph/ceph-client.admin.192253.log 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.172238.log.gz 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681038.log 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554478.log 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681038.log: /var/log/ceph/ceph-client.admin.192253.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681038.log.gz 2024-03-18T22:41:26.777 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.192253.log.gz 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617804.log 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.332147.log 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.554478.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554478.log.gz 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.617804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714123.log 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617804.log.gz 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.332147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584992.log 2024-03-18T22:41:26.778 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.332147.log.gz 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714123.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.47385.log.gz 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130033.log 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714123.log.gz 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.47679.log.gz 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.584992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.411425.log 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584992.log.gz 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286300.log 2024-03-18T22:41:26.779 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.411425.log: /var/log/ceph/ceph-client.admin.130033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.411425.log.gz 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130033.log.gz 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620094.log 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224424.log 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620094.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620094.log.gz 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286300.log.gz 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293965.log 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727876.log 2024-03-18T22:41:26.780 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293965.log.gz 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224424.log.gz 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324490.log 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552246.log 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324490.log.gz 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.727876.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727876.log.gz 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681279.log 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845161.log 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681279.log.gz 2024-03-18T22:41:26.781 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.552246.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552246.log.gz 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.845161.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845161.log.gz 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327947.log 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50003.log 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327947.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327947.log.gz 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696368.log 2024-03-18T22:41:26.782 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48078.log 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.696368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696368.log.gz 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.857017.log 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48078.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.605818.log 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.857017.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287245.log 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.300766.log 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287245.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287245.log.gz 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.605818.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.857017.log.gz 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253846.log 0.0% 2024-03-18T22:41:26.783 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.605818.log.gz 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.300766.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.571068.log 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.300766.log.gz 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.617735.log 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.253846.log: /var/log/ceph/ceph-client.admin.571068.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.571068.log.gz 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253846.log.gz 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.567842.log 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.617735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723025.log 2024-03-18T22:41:26.784 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.617735.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.567842.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.341827.log 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.567842.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578366.log 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723025.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr: 88.6%/var/log/ceph/ceph-client.admin.341827.log: -- replaced with /var/log/ceph/ceph-client.admin.50003.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290414.log 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.341827.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.48078.log.gz 2024-03-18T22:41:26.785 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.578366.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.288444.log 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578366.log.gz 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.290414.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249803.log 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290414.log.gz 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.601434.log 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249803.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249803.log.gz 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.288444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.288444.log.gz 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.712981.log 2024-03-18T22:41:26.786 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855392.log 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.601434.log: /var/log/ceph/ceph-client.admin.712981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.712981.log.gz 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.601434.log.gz 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.278611.log 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198178.log 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855392.log.gz 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714892.log 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.278611.log: /var/log/ceph/ceph-client.admin.198178.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198178.log.gz 2024-03-18T22:41:26.787 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.278611.log.gz 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222705.log 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159002.log 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714892.log.gz 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.619167.log 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.222705.log: /var/log/ceph/ceph-client.admin.159002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.159002.log.gz 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222705.log.gz 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162027.log 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.619167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126755.log 2024-03-18T22:41:26.788 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.619167.log.gz 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199085.log 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.162027.log: /var/log/ceph/ceph-client.admin.126755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587344.log 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.162027.log.gz 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199085.log.gz 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.126755.log.gz 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721091.log 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.349333.log 2024-03-18T22:41:26.789 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587344.log: /var/log/ceph/ceph-client.admin.721091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721091.log.gz 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587344.log.gz 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.228986.log 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.349333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598103.log 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.349333.log.gz 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270945.log 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.228986.log: /var/log/ceph/ceph-client.admin.598103.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598103.log.gz 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.228986.log.gz 2024-03-18T22:41:26.790 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724708.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.566396.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270945.log.gz 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48420.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724708.log: /var/log/ceph/ceph-client.admin.566396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.566396.log.gz 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724708.log.gz 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142722.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48420.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.575579.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.142722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48750.log 2024-03-18T22:41:26.791 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142722.log.gz 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.279164.log 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.575579.log: /var/log/ceph/ceph-client.admin.48750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.575579.log.gz 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229247.log 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.279164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579701.log 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.279164.log.gz 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.616360.log 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229247.log.gz 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579701.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175277.log 2024-03-18T22:41:26.792 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579701.log.gz 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.48420.log.gz 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.616360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.616360.log.gz 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50226.log 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48750.log.gz 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.175277.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309720.log 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.175277.log.gz 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.50226.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44452.log 2024-03-18T22:41:26.793 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340360.log 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44452.log: /var/log/ceph/ceph-client.admin.309720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309720.log.gz 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636520.log 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630290.log 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636520.log.gz 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340360.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173710.log 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340360.log.gz 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610890.log 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630290.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630290.log.gz 2024-03-18T22:41:26.794 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.210668.log 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.173710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614672.log 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173710.log.gz 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.210668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.210668.log.gz 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329473.log 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610890.log.gz 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123939.log 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329473.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329473.log.gz 2024-03-18T22:41:26.795 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.614672.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.50226.log.gz 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151055.log 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614672.log.gz 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44452.log.gz 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208035.log 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148217.log 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123939.log.gz 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208035.log.gz 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.151055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562883.log 2024-03-18T22:41:26.796 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151055.log.gz 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.148217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.148217.log.gz 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319076.log 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144919.log 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.562883.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292932.log 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562883.log.gz 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144919.log.gz 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.319076.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.249337.log 2024-03-18T22:41:26.797 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319076.log.gz 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.292932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572009.log 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292932.log.gz 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267035.log 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249337.log.gz 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.603368.log 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.572009.log: /var/log/ceph/ceph-client.admin.267035.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267035.log.gz 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572009.log.gz 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.194897.log 2024-03-18T22:41:26.798 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.603368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568021.log 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.603368.log.gz 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.194897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624926.log 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.194897.log.gz 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45382.log 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568021.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195604.log 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568021.log.gz 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45382.log: /var/log/ceph/ceph-client.admin.624926.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599059.log 2024-03-18T22:41:26.799 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624926.log.gz 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195604.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.195604.log.gz 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578584.log 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225369.log 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599059.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337051.log 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599059.log.gz 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.225369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225369.log.gz 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.578584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722272.log 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45382.log.gz -- replaced with /var/log/ceph/ceph-client.admin.578584.log.gz 2024-03-18T22:41:26.800 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47511.log 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722272.log: /var/log/ceph/ceph-client.admin.337051.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722272.log.gz 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337051.log.gz 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123177.log 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173274.log 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123177.log: /var/log/ceph/ceph-client.admin.47511.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123177.log.gz 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161525.log 2024-03-18T22:41:26.801 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.173274.log: --verbose -- /var/log/ceph/ceph-client.admin.732236.log 2024-03-18T22:41:26.802 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.173274.log.gz 2024-03-18T22:41:26.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.614659.log 2024-03-18T22:41:26.802 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.161525.log: /var/log/ceph/ceph-client.admin.732236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.732236.log.gz 2024-03-18T22:41:26.802 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.161525.log.gz 2024-03-18T22:41:26.802 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144731.log 2024-03-18T22:41:26.898 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.614659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340993.log 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.47511.log.gz 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.614659.log.gz 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238278.log 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.144731.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.144731.log.gz 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409300.log 2024-03-18T22:41:26.899 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340993.log.gz 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227062.log 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238278.log: /var/log/ceph/ceph-client.admin.409300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409300.log.gz 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238278.log.gz 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846956.log 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323750.log 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227062.log.gz 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255322.log 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323750.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323750.log.gz 2024-03-18T22:41:26.900 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846956.log.gz 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158644.log 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.343790.log 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255322.log.gz 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.855755.log 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158644.log: /var/log/ceph/ceph-client.admin.343790.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.343790.log.gz 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158644.log.gz 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235837.log 2024-03-18T22:41:26.901 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.855755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.855755.log.gz 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856679.log 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.225382.log 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235837.log.gz 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740331.log 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856679.log: /var/log/ceph/ceph-client.admin.225382.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.225382.log.gz 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266336.log 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.856679.log.gz 2024-03-18T22:41:26.902 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236347.log 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.740331.log: /var/log/ceph/ceph-client.admin.266336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266336.log.gz 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.740331.log.gz 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.577422.log 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.579783.log 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236347.log.gz 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.577422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569258.log 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.577422.log.gz 2024-03-18T22:41:26.903 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.569271.log 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.579783.log: /var/log/ceph/ceph-client.admin.569258.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569258.log.gz 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.579783.log.gz 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685032.log 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338391.log 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685032.log: /var/log/ceph/ceph-client.admin.569271.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685032.log.gz 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.569271.log.gz 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.697481.log 2024-03-18T22:41:26.904 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338391.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.736014.log 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338391.log.gz 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.281506.log 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.697481.log: /var/log/ceph/ceph-client.admin.736014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.736014.log.gz 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.697481.log.gz 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313266.log 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.618259.log 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313266.log.gz 2024-03-18T22:41:26.905 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.281506.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.281506.log.gz 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286082.log 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585263.log 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.618259.log: /var/log/ceph/ceph-client.admin.286082.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.286082.log.gz 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.618259.log.gz 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719846.log 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248776.log 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585263.log.gz 2024-03-18T22:41:26.906 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.199812.log 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719846.log: /var/log/ceph/ceph-client.admin.248776.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248776.log.gz 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719846.log.gz 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.351195.log 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.199812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.317502.log 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.199812.log.gz 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235576.log 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.351195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.351195.log.gz 2024-03-18T22:41:26.907 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.317502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.224411.log 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.317502.log.gz 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.314732.log 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.235576.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235576.log.gz 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.305080.log 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.224411.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703305.log 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.224411.log.gz 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.305080.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.305080.log.gz 2024-03-18T22:41:26.908 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.314732.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.314732.log.gz 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.336148.log 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176275.log 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703305.log.gz 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.333523.log 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.336148.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.570999.log 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.336148.log.gz 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.333523.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.333523.log.gz 2024-03-18T22:41:26.909 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.176275.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176275.log.gz 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700396.log 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.346324.log 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.570999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.570999.log.gz 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.584635.log 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718614.log 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700396.log.gz 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.346324.log: /var/log/ceph/ceph-client.admin.584635.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.584635.log.gz 2024-03-18T22:41:26.910 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.346324.log.gz 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.629655.log 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323050.log 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718614.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718614.log.gz 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.629655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.306686.log 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.629655.log.gz 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274780.log 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.306686.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.306686.log.gz 2024-03-18T22:41:26.911 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323050.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323050.log.gz 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696707.log 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274780.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633618.log 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274780.log.gz 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287965.log 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.696707.log: /var/log/ceph/ceph-client.admin.633618.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633618.log.gz 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696707.log.gz 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591102.log 2024-03-18T22:41:26.912 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.313944.log 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287965.log: /var/log/ceph/ceph-client.admin.591102.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591102.log.gz 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287965.log.gz 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114192.log 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.313944.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227530.log 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.313944.log.gz 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588241.log 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.114192.log: /var/log/ceph/ceph-client.admin.227530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227530.log.gz 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.114192.log.gz 2024-03-18T22:41:26.913 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.220624.log 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247856.log 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588241.log.gz 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284663.log 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247856.log: /var/log/ceph/ceph-client.admin.220624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247856.log.gz 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.220624.log.gz 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.235358.log 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630016.log 2024-03-18T22:41:26.914 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284663.log.gz 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227817.log 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630016.log: /var/log/ceph/ceph-client.admin.235358.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630016.log.gz 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.235358.log.gz 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561545.log 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip/var/log/ceph/ceph-client.admin.227817.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.737340.log 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227817.log.gz 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.699915.log 2024-03-18T22:41:26.915 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.737340.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737340.log.gz 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561545.log.gz 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.197603.log 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.630003.log 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.699915.log: /var/log/ceph/ceph-client.admin.197603.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.197603.log.gz 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.699915.log.gz 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158113.log 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.630003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.246019.log 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.630003.log.gz 2024-03-18T22:41:26.916 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724217.log 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.158113.log: /var/log/ceph/ceph-client.admin.246019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262601.log 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.158113.log.gz 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.246019.log.gz 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724217.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724217.log.gz 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156747.log 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262601.log.gz 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.599277.log 2024-03-18T22:41:26.917 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115934.log 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.599277.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.599277.log.gz 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156747.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308085.log 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156747.log.gz 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.227323.log 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308085.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308085.log.gz 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.115934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.266858.log 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.115934.log.gz 2024-03-18T22:41:26.918 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276327.log 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.227323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.722464.log 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.227323.log.gz 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.276327.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276327.log.gz 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.266858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275251.log 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.266858.log.gz 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49086.log 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275251.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275251.log.gz 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.722464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.722464.log.gz 2024-03-18T22:41:26.919 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44118.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275530.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.241901.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275530.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275530.log.gz 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44118.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334393.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.387645.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.334393.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334393.log.gz 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.241901.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.324408.log 2024-03-18T22:41:26.920 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.241901.log.gz 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.387645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.387645.log.gz 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.311889.log 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.49086.log.gz 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.329734.log 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.44118.log.gz 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.311889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.311889.log.gz 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.276396.log 2024-03-18T22:41:26.921 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.324408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352185.log 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.324408.log.gz 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.276396.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.276396.log.gz 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.329734.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.329734.log.gz 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719367.log 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.323545.log 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719367.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719367.log.gz 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.352185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.851476.log 2024-03-18T22:41:26.922 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.562416.log 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352185.log.gz 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.851476.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.851476.log.gz 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.323545.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.323545.log.gz 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.588310.log 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720120.log 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.562416.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.587125.log 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.562416.log.gz 2024-03-18T22:41:26.923 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.588310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623220.log 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.587125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.588310.log.gz 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.587125.log.gz 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49897.log 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720120.log.gz 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590914.log 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623220.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623220.log.gz 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.730866.log 2024-03-18T22:41:26.924 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262134.log 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.730866.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.730866.log.gz 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738763.log 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590914.log.gz 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636507.log 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262134.log.gz 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.735527.log 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738763.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738763.log.gz 2024-03-18T22:41:26.925 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.272351.log 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636507.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636507.log.gz 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.735527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145001.log 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.49897.log.gz 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.735527.log.gz 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573302.log 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.272351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.198624.log 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.272351.log.gz 2024-03-18T22:41:26.926 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573302.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573302.log.gz 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.145001.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123108.log 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.145001.log.gz 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718135.log 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.123108.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.123108.log.gz 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.198624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.198624.log.gz 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.624110.log 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.253489.log 2024-03-18T22:41:26.927 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.624110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.624110.log.gz 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718135.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718135.log.gz 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47790.log 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.255048.log 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47790.log: /var/log/ceph/ceph-client.admin.253489.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.253489.log.gz 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.319145.log 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.290853.log 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.255048.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.255048.log.gz 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.257863.log 2024-03-18T22:41:26.928 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.290853.log: /var/log/ceph/ceph-client.admin.319145.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.290853.log.gz 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.319145.log.gz 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846517.log 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.257863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284115.log 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.257863.log.gz 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846517.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620381.log 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846517.log.gz 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47790.log.gz 2024-03-18T22:41:26.929 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.682246.log 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284115.log.gz 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620381.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.334759.log 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620381.log.gz 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.287715.log 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.682246.log: /var/log/ceph/ceph-client.admin.334759.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.334759.log.gz 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.682246.log.gz 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.718204.log 2024-03-18T22:41:26.930 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.287715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154959.log 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.287715.log.gz 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.718204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49518.log 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.718204.log.gz 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.573819.log 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.49518.log: /var/log/ceph/ceph-client.admin.154959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154959.log.gzgzip 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.256205.log 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.628854.log 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.573819.log: /var/log/ceph/ceph-client.admin.256205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.256205.log.gz 2024-03-18T22:41:26.931 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.573819.log.gz 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.443645.log 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312251.log 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.628854.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.628854.log.gz 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43082.log 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.443645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.443645.log.gz 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.358339.log 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841906.log 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312251.log.gz 2024-03-18T22:41:26.932 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.358339.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.358339.log.gz 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43296.log 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.244520.log 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.719859.log 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841906.log.gz 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.244520.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.244520.log.gz 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.43296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.849205.log 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49518.log.gz 2024-03-18T22:41:26.933 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.271219.log 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.719859.log: /var/log/ceph/ceph-client.admin.849205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.849205.log.gz 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.719859.log.gz 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354877.log 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.271219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.271219.log.gz 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 87.8% 88.1% -5 --verbose -- /var/log/ceph/ceph-client.admin.232914.log 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr: -- replaced with /var/log/ceph/ceph-client.admin.43082.log.gz -- replaced with /var/log/ceph/ceph-client.admin.43296.log.gz 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.934 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720051.log 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232914.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232914.log.gz 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354877.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354877.log.gz 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316804.log 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118700.log 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316804.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316804.log.gz 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.720051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284402.log 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720051.log.gz 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229453.log 2024-03-18T22:41:26.935 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284402.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284402.log.gz 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118700.log.gz 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.585984.log 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.565492.log 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.585984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.585984.log.gz 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.261237.log 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229453.log.gz 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.248845.log 2024-03-18T22:41:26.936 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.261237.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.261237.log.gz 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.565492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.565492.log.gz 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342639.log 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.701954.log 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342639.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342639.log.gz 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.248845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312827.log 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.248845.log.gz 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274091.log 2024-03-18T22:41:26.937 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.701954.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.701954.log.gz 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686598.log 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312827.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.696638.log 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312827.log.gz 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.589826.log 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274091.log.gz 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.696638.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.696638.log.gz 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.686598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.214233.log 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686598.log.gz 2024-03-18T22:41:26.938 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726918.log 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.214233.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.214233.log.gz 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.589826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.267320.log 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.589826.log.gz 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.561989.log 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.267320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.267320.log.gz 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.726918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.312320.log 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726918.log.gz 2024-03-18T22:41:26.939 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157241.log 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.312320.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.312320.log.gz 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.561989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.337956.log 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.561989.log.gz 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.157241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.157241.log.gz 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45340.log 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.231148.log 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337956.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337956.log.gz 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.609973.log 2024-03-18T22:41:26.940 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.247014.log 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.231148.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.231148.log.gz 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.731794.log 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.620921.log 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.609973.log: /var/log/ceph/ceph-client.admin.731794.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.731794.log.gz 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45340.log.gz 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.609973.log.gz 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.247014.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856345.log 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.247014.log.gz 2024-03-18T22:41:26.941 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.713629.log 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.620921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.620921.log.gz 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331846.log 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.259088.log 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331846.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331846.log.gz 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.713629.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.623736.log 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.713629.log.gz 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.856345.log.gz 2024-03-18T22:41:26.942 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.610329.log 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.623736.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.623736.log.gz 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.259088.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340155.log 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.259088.log.gz 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44457.log 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340155.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340155.log.gz 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.610329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129024.log 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.610329.log.gz 2024-03-18T22:41:26.943 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.720325.log 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44457.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.574609.log 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.129024.log: /var/log/ceph/ceph-client.admin.720325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.720325.log.gz 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.129024.log.gz 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127339.log 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738694.log 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.574609.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168059.log 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.574609.log.gz 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738694.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738694.log.gz 2024-03-18T22:41:26.944 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.127339.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.229933.log 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127339.log.gz 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556371.log 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168059.log.gz 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44446.log 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.229933.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.229933.log.gz 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.270932.log 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.295211.log 2024-03-18T22:41:26.945 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556371.log.gz 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.270932.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.270932.log.gz 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44446.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45298.log 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.598584.log 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.295211.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.295211.log.gz 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.331859.log 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.45298.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150156.log 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.331859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.331859.log.gz 2024-03-18T22:41:26.946 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.598584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356737.log 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.598584.log.gz 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130242.log 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.150156.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.150156.log.gz 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49603.log 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.356737.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356737.log.gz 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.316992.log 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.130242.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.130242.log.gz 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.44457.log.gz 2024-03-18T22:41:26.947 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.49603.log: -- /var/log/ceph/ceph-client.admin.337428.log 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.44446.log.gz 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.316992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.269663.log 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.316992.log.gz 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.510884.log 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.337428.log: /var/log/ceph/ceph-client.admin.269663.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.269663.log.gz 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.337428.log.gz 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559497.log 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.841501.log 2024-03-18T22:41:26.948 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.510884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.274078.log 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.559497.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.510884.log.gz 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.841501.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559497.log.gz 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.841501.log.gz 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.721506.log 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.308278.log 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.274078.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.274078.log.gz 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.738250.log 2024-03-18T22:41:26.949 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.721506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.600236.log 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.721506.log.gz 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.308278.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.291537.log 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.308278.log.gz 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.600236.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.600236.log.gz 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.738250.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.740143.log 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.738250.log.gz 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342101.log 2024-03-18T22:41:26.950 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.291537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.291537.log.gz 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852872.log 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.740143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327514.log 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.740143.log.gz 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852872.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852872.log.gz 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602884.log 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342101.log.gz 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.846504.log 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602884.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602884.log.gz 2024-03-18T22:41:26.951 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.700587.log 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327514.log.gz 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.412556.log 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.700587.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.700587.log.gz 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.846504.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.49603.log.gz 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.848766.log 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.846504.log.gz 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.45298.log.gz 2024-03-18T22:41:26.952 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685673.log 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.848766.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.848766.log.gz 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.412556.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.412556.log.gz 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602262.log 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.727376.log 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685673.log: /var/log/ceph/ceph-client.admin.602262.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602262.log.gz 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685673.log.gz 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.232531.log 2024-03-18T22:41:26.953 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.727376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.222487.log 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.727376.log.gz 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117983.log 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.232531.log: /var/log/ceph/ceph-client.admin.222487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.222487.log.gz 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.232531.log.gz 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118687.log 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.117983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.384318.log 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.117983.log.gz 2024-03-18T22:41:26.954 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.118687.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.353479.log 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.118687.log.gz 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.845079.log 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.384318.log: /var/log/ceph/ceph-client.admin.353479.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.353479.log.gz 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.384318.log.gz 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.260948.log 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.845079.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.590184.log 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.845079.log.gz 2024-03-18T22:41:26.955 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.286095.log 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.590184.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.590184.log.gz 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.260948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.275059.log 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.260948.log.gz 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.289198.log 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.275059.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.275059.log.gz 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.286095.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.286095.log.gz /var/log/ceph/ceph-client.admin.852630.log 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.723422.log 2024-03-18T22:41:26.956 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852630.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852630.log.gz 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.289198.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.289198.log.gz 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.714110.log 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.262065.log 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.714110.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.714110.log.gz 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.723422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.723422.log.gz 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.357824.log 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.578849.log 2024-03-18T22:41:26.957 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.357824.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.357824.log.gz 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.262065.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.262065.log.gz 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.729931.log 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.578849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.578849.log.gz 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.236813.log 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.284865.log 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.236813.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.236813.log.gz 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.729931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.729931.log.gz 2024-03-18T22:41:26.958 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.254394.log 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.284865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.554547.log 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.284865.log.gz 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.191799.log 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.254394.log: /var/log/ceph/ceph-client.admin.554547.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.554547.log.gz 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.254394.log.gz 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681348.log 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.191799.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.191799.log.gz 2024-03-18T22:41:26.959 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293219.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681348.log: /var/log/ceph/ceph-client.admin.293219.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293219.log.gz 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681348.log.gz 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.627701.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.238757.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-mds.a.log: /var/log/ceph/ceph-client.admin.627701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.627701.log.gz 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293756.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.409369.log 2024-03-18T22:41:26.960 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.238757.log: /var/log/ceph/ceph-client.admin.293756.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293756.log.gz 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.238757.log.gz 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37556.log 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.681051.log 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.37556.log: /var/log/ceph/ceph-client.admin.409369.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.409369.log.gz 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.559153.log 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.216917.log 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.681051.log: /var/log/ceph/ceph-client.admin.559153.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.559153.log.gz 2024-03-18T22:41:26.961 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.681051.log.gz 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.263073.log 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.216917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.737840.log 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.216917.log.gz 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142266.log 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.263073.log: /var/log/ceph/ceph-client.admin.737840.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.737840.log.gz 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.263073.log.gz 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.568712.log 2024-03-18T22:41:26.962 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.142266.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.142266.log.gz 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156937.log 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.568712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.208552.log 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.568712.log.gz 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.615555.log 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.208552.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.208552.log.gz 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.156937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.633807.log 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156937.log.gz 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.342365.log 2024-03-18T22:41:26.963 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.615555.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.37556.log.gz 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.633807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.633807.log.gz 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.615555.log.gz 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.325361.log 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.724478.log 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.342365.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.342365.log.gz 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.843803.log 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.556440.log 2024-03-18T22:41:26.964 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.325361.log: 0.0%/var/log/ceph/ceph-client.admin.843803.log: -- replaced with /var/log/ceph/ceph-client.admin.325361.log.gz 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.843803.log.gz 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.724478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.338863.log 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.724478.log.gz 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268444.log 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.338863.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.338863.log.gz 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.556440.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.553593.log 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.556440.log.gz 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48624.log 2024-03-18T22:41:26.965 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.268444.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268444.log.gz 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.591171.log 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.553593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44120.log 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.553593.log.gz 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.48624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.552667.log 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.44120.log: /var/log/ceph/ceph-client.admin.591171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.602897.log 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.591171.log.gz 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.613799.log 2024-03-18T22:41:26.966 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.602897.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.48624.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.602897.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.552667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.394875.log 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.552667.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.265417.log 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.394875.log: 0.0%/var/log/ceph/ceph-client.admin.613799.log: -- replaced with /var/log/ceph/ceph-client.admin.394875.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44120.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.249324.log 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.613799.log.gz 2024-03-18T22:41:26.967 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.265417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.686325.log 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.265417.log.gz 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.268239.log 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.249324.log: /var/log/ceph/ceph-client.admin.686325.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.686325.log.gz 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.249324.log.gz 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.327878.log 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5/var/log/ceph/ceph-client.admin.268239.log: --verbose -- /var/log/ceph/ceph-client.admin.127701.log 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.268239.log.gz 2024-03-18T22:41:26.968 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.607784.log 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.327878.log: /var/log/ceph/ceph-client.admin.127701.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.127701.log.gz 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.327878.log.gz 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.352941.log 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.607784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.847862.log 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.607784.log.gz 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107045.log 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.847862.log: /var/log/ceph/ceph-client.admin.352941.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.847862.log.gz 2024-03-18T22:41:26.969 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.352941.log.gz 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.852656.log 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.856501.log 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.107045.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.107045.log.gz 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.698557.log 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.852656.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.852656.log.gz 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.195424.log 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.856501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.703721.log 2024-03-18T22:41:26.970 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.195424.log: 0.0%/var/log/ceph/ceph-client.admin.698557.log: -- replaced with /var/log/ceph/ceph-client.admin.195424.log.gz 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.340911.log 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.698557.log.gz 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.856501.log.gz 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.309515.log 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.340911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.340911.log.gz 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.703721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168984.log 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.703721.log.gz 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47046.log 2024-03-18T22:41:26.971 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.168984.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.168984.log.gz 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.309515.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.309515.log.gz 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.233475.log 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.292726.log 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.233475.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.233475.log.gz 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.47046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.636973.log 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.330710.log 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.636973.log: /var/log/ceph/ceph-client.admin.292726.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.636973.log.gz 2024-03-18T22:41:26.972 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.292726.log.gz 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.685481.log 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.47046.log.gz 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.330710.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.330710.log.gz 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174619.log 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.685481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.685481.log.gz 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.354414.log 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.230138.log 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.354414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.354414.log.gz 2024-03-18T22:41:26.973 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.174619.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.293687.log 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.174619.log.gz 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.572912.log 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.293687.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.293687.log.gz 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.230138.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.230138.log.gz 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.726848.log 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.356668.log 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.572912.log: /var/log/ceph/ceph-client.admin.726848.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.726848.log.gz 2024-03-18T22:41:26.974 INFO:teuthology.orchestra.run.smithi152.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.572912.log.gz 2024-03-18T22:41:26.975 INFO:teuthology.orchestra.run.smithi152.stderr:/var/log/ceph/ceph-client.admin.356668.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.356668.log.gz 2024-03-18T22:41:27.837 INFO:teuthology.orchestra.run.smithi186.stderr: 94.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-03-18T22:41:28.480 INFO:teuthology.orchestra.run.smithi152.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-03-18T22:41:29.533 INFO:teuthology.orchestra.run.smithi186.stderr: 94.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-03-18T22:41:30.710 INFO:teuthology.orchestra.run.smithi186.stderr: 95.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-03-18T22:41:45.913 INFO:teuthology.orchestra.run.smithi186.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-03-18T22:42:29.072 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-03-18T22:43:17.565 INFO:teuthology.orchestra.run.smithi186.stderr: 92.6% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-03-18T22:43:25.345 INFO:teuthology.orchestra.run.smithi186.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-03-18T22:43:44.088 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-03-18T22:44:21.883 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-03-18T22:44:24.579 INFO:teuthology.orchestra.run.smithi186.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-03-18T22:44:24.581 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-03-18T22:44:24.581 INFO:teuthology.orchestra.run.smithi186.stderr:real 2m59.411s 2024-03-18T22:44:24.582 INFO:teuthology.orchestra.run.smithi186.stderr:user 3m6.243s 2024-03-18T22:44:24.582 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m8.469s 2024-03-18T22:46:34.813 INFO:teuthology.orchestra.run.smithi152.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-03-18T22:47:34.756 INFO:teuthology.orchestra.run.smithi152.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-03-18T22:47:58.328 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-03-18T22:49:13.118 INFO:teuthology.orchestra.run.smithi152.stderr: 93.5% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-03-18T22:50:27.216 INFO:teuthology.orchestra.run.smithi152.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-03-18T22:52:12.159 INFO:teuthology.orchestra.run.smithi152.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-03-18T22:52:12.161 INFO:teuthology.orchestra.run.smithi152.stderr: 2024-03-18T22:52:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:real 10m47.013s 2024-03-18T22:52:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:user 14m20.248s 2024-03-18T22:52:12.161 INFO:teuthology.orchestra.run.smithi152.stderr:sys 0m36.990s 2024-03-18T22:52:12.162 INFO:tasks.ceph:Archiving logs... 2024-03-18T22:52:12.164 DEBUG:teuthology.misc:Transferring archived files from smithi152:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi152/log 2024-03-18T22:52:12.165 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T23:05:28.246 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi186/log 2024-03-18T23:05:28.269 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-18T23:11:41.364 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-18T23:11:41.374 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-18T23:11:41.375 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T23:11:41.378 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-18T23:11:41.817 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-18T23:11:41.826 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-18T23:11:41.826 DEBUG:teuthology.orchestra.run.smithi152:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T23:11:41.830 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-18T23:11:41.845 INFO:teuthology.orchestra.run.smithi186.stderr:bash: line 1: ntpq: command not found 2024-03-18T23:11:41.858 INFO:teuthology.orchestra.run.smithi152.stderr:bash: line 1: ntpq: command not found 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 14 +1523us[+1495us] +/- 111ms 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 13 -315us[ -343us] +/- 59ms 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 10 -561us[ -561us] +/- 67ms 2024-03-18T23:11:41.872 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T23:11:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-18T23:11:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:=============================================================================== 2024-03-18T23:11:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 62 +1552us[+1552us] +/- 110ms 2024-03-18T23:11:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:^* hv02.front.sepia.ceph.com 3 7 377 128 -297us[ -287us] +/- 58ms 2024-03-18T23:11:41.878 INFO:teuthology.orchestra.run.smithi152.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 7 -515us[ -515us] +/- 67ms 2024-03-18T23:11:41.879 INFO:teuthology.orchestra.run.smithi152.stdout:^? hv04.front.sepia.ceph.com 0 10 0 - +0ns[ +0ns] +/- 0ns 2024-03-18T23:11:41.879 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-18T23:11:41.889 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-18T23:11:41.889 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-18T23:11:41.912 DEBUG:teuthology.orchestra.run.smithi152:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T23:11:42.264 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-18T23:11:42.430 DEBUG:teuthology.orchestra.run.smithi152:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T23:11:42.512 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T23:11:42.513 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-03-18T23:11:42.548 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T23:11:42.548 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-18T23:11:42.559 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-18T23:11:42.671 INFO:teuthology.task.internal:Duration was 29888.483178 seconds 2024-03-18T23:11:42.672 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-18T23:11:42.703 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-18T23:11:42.705 DEBUG:teuthology.orchestra.run.smithi152:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T23:11:42.709 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-18T23:11:42.798 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T23:11:42.854 INFO:teuthology.orchestra.run.smithi152.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-18T23:11:43.287 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-18T23:11:43.288 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi152.front.sepia.ceph.com 2024-03-18T23:11:43.288 DEBUG:teuthology.orchestra.run.smithi152:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T23:11:43.339 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-03-18T23:11:43.339 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-18T23:11:43.372 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-18T23:11:43.372 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T23:11:43.376 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-18T23:11:43.444 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-18T23:11:43.444 DEBUG:teuthology.orchestra.run.smithi152:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T23:11:43.447 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-18T23:11:44.740 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-18T23:11:44.753 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-18T23:11:44.754 DEBUG:teuthology.orchestra.run.smithi152:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T23:11:44.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-18T23:11:44.902 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-18T23:11:44.913 DEBUG:teuthology.orchestra.run.smithi152:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T23:11:44.916 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-18T23:11:44.976 INFO:teuthology.orchestra.run.smithi152.stdout:kernel.core_pattern = core 2024-03-18T23:11:45.055 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-03-18T23:11:45.090 DEBUG:teuthology.orchestra.run.smithi152:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T23:11:45.124 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T23:11:45.124 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-18T23:11:45.140 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-18T23:11:45.141 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-18T23:11:45.151 INFO:teuthology.task.internal:Transferring archived files... 2024-03-18T23:11:45.153 DEBUG:teuthology.misc:Transferring archived files from smithi152:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi152 2024-03-18T23:11:45.153 DEBUG:teuthology.orchestra.run.smithi152:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T23:11:45.246 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860/remote/smithi186 2024-03-18T23:11:45.247 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-18T23:11:45.287 INFO:teuthology.task.internal:Removing archive directory... 2024-03-18T23:11:45.287 DEBUG:teuthology.orchestra.run.smithi152:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T23:11:45.291 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-18T23:11:45.337 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-18T23:11:45.349 INFO:teuthology.task.internal:Not uploading archives. 2024-03-18T23:11:45.349 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-18T23:11:45.371 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-18T23:11:45.371 DEBUG:teuthology.orchestra.run.smithi152:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T23:11:45.374 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-18T23:11:45.394 INFO:teuthology.orchestra.run.smithi186.stdout: 265865 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 23:11 /home/ubuntu/cephtest 2024-03-18T23:11:45.405 INFO:teuthology.orchestra.run.smithi152.stdout: 265617 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Mar 18 23:11 /home/ubuntu/cephtest 2024-03-18T23:11:45.408 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-18T23:11:45.418 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-18T23:11:45.471 INFO:teuthology.nuke:Checking targets against current locks 2024-03-18T23:11:45.498 DEBUG:teuthology.nuke:shortname: smithi152 2024-03-18T23:11:45.499 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T23:11:45.522 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi152.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:44:53.984115', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDCksRV3cHBxdsEvyK7DHWX2QmJoaxL64VcPYmHZTV4Hk8Z2+s6w0V1cQ6ZA5f2XoOoQl+qrrcBVzhDQJBoLU8Y='} 2024-03-18T23:11:45.526 DEBUG:teuthology.nuke:shortname: smithi186 2024-03-18T23:11:45.527 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-18T23:11:45.551 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/pdonnell-2024-03-18_14:19:46-fs-wip-batrick-testing-20240314.183243-distro-default-smithi/7608860', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-18 14:44:53.982494', 'locked_by': 'scheduled_pdonnell@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP0MtjsXhFMj20MQvMw9MSYPKt3X6PTmgCv/fUJI4FtPLbbbKUHKsliA28MPvH0MTXnH55596gpRK8awdgwjF2o='} 2024-03-18T23:11:45.572 INFO:teuthology.orchestra.console.smithi152:Power off 2024-03-18T23:11:45.573 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T23:11:45.597 DEBUG:teuthology.orchestra.console.smithi152:power off output: Chassis Power Control: Down/Off 2024-03-18T23:11:45.597 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:45.615 INFO:teuthology.orchestra.console.smithi186:Power off 2024-03-18T23:11:45.616 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-18T23:11:45.626 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-03-18T23:11:45.642 DEBUG:teuthology.orchestra.console.smithi186:power off output: Chassis Power Control: Down/Off 2024-03-18T23:11:45.642 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:45.665 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-03-18T23:11:49.627 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:49.666 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:49.738 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-03-18T23:11:49.774 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is on 2024-03-18T23:11:53.740 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:53.775 DEBUG:teuthology.orchestra.console.smithi186:pexpect command: ipmitool -H smithi186.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:53.850 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is on 2024-03-18T23:11:53.885 DEBUG:teuthology.orchestra.console.smithi186:check power output: Chassis Power is off 2024-03-18T23:11:53.986 INFO:teuthology.orchestra.console.smithi186:Power off completed 2024-03-18T23:11:57.854 DEBUG:teuthology.orchestra.console.smithi152:pexpect command: ipmitool -H smithi152.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-18T23:11:57.964 DEBUG:teuthology.orchestra.console.smithi152:check power output: Chassis Power is off 2024-03-18T23:11:58.065 INFO:teuthology.orchestra.console.smithi152:Power off completed 2024-03-18T23:11:58.169 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{ubuntu_latest} mount/kclient/{mount-syntax/{v2} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} subvol_versions/create_subvol_version_v2 tasks/xfstests-dev} duration: 29888.483178138733 failure_reason: 'Test failure: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev)' flavor: default owner: scheduled_pdonnell@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=e1a996d84b2b4f59811219290cb0a14e status: fail success: false 2024-03-18T23:11:58.170 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-18T23:11:58.253 INFO:teuthology.run:FAIL